2023-10-06T03:02:28.056 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T03:02:28.056 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187 --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/orig.config.yaml 2023-10-06T03:02:28.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:02:28.182 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} email: yweinste@redhat.com first_in_suite: false job_id: '7412187' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMy/QwPsuOe8hxxDl+5G9LNQRSwewKwbEWYrb0IuRgGltzsRGG9XVzJ8bncKi3DC7kgmnyuNgdHqcp2vTqc2c4U= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKzgy/QeSyqY7bSn2aIcVHxWMgsDJfrpNbKgQ5X1o55HSoMVmaqDavwcj+YJO0eb97kDNvcKC6Zcl1SvGSRyWg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T03:02:28.183 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T03:02:28.183 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T03:02:28.184 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T03:02:28.185 INFO:teuthology.task.internal:Checking packages... 2023-10-06T03:02:28.211 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T03:02:28.212 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T03:02:28.212 INFO:teuthology.packaging:ref: None 2023-10-06T03:02:28.212 INFO:teuthology.packaging:tag: None 2023-10-06T03:02:28.212 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T03:02:28.212 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:02:28.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T03:02:28.430 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T03:02:28.430 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T03:02:28.438 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T03:02:28.438 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T03:02:28.452 INFO:teuthology.task.internal:Saving configuration 2023-10-06T03:02:28.467 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T03:02:28.478 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:02:28.503 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:57:23.469678', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMy/QwPsuOe8hxxDl+5G9LNQRSwewKwbEWYrb0IuRgGltzsRGG9XVzJ8bncKi3DC7kgmnyuNgdHqcp2vTqc2c4U='} 2023-10-06T03:02:28.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:57:23.471682', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKzgy/QeSyqY7bSn2aIcVHxWMgsDJfrpNbKgQ5X1o55HSoMVmaqDavwcj+YJO0eb97kDNvcKC6Zcl1SvGSRyWg='} 2023-10-06T03:02:28.526 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T03:02:28.534 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T03:02:28.535 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T03:02:28.535 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T03:02:28.607 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbd7b825b80>, signals=[15]) 2023-10-06T03:02:28.608 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T03:02:28.615 INFO:teuthology.task.internal:Opening connections... 2023-10-06T03:02:28.615 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:02:28.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:02:28.684 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:02:28.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:02:28.753 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T03:02:28.759 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-10-06T03:02:28.776 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-10-06T03:02:28.776 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.4" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T03:02:28.835 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-10-06T03:02:28.863 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-10-06T03:02:28.880 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-10-06T03:02:28.880 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-10-06T03:02:28.937 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T03:02:28.937 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T03:02:28.937 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-10-06T03:02:28.937 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.4" 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T03:02:28.940 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T03:02:28.940 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T03:02:28.940 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T03:02:28.940 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-10-06T03:02:28.979 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T03:02:28.989 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T03:02:29.015 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T03:02:29.015 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2023-10-06T03:02:29.017 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2023-10-06T03:02:29.033 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T03:02:29.039 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T03:02:29.040 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2023-10-06T03:02:29.073 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2023-10-06T03:02:29.088 INFO:teuthology.orchestra.run.smithi082.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T03:02:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T03:02:29.090 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T03:02:29.147 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T03:02:29.160 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T03:02:29.160 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T03:02:29.160 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T03:02:29.161 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T03:02:29.161 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T03:02:29.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:29.176 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-10-06T03:02:29.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:29.177 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-10-06T03:02:29.232 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:02:29.233 INFO:teuthology.task.kernel:Running kernel on smithi134: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:02:29.233 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2023-10-06T03:02:29.234 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:02:29.234 INFO:teuthology.task.kernel:Running kernel on smithi082: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:02:29.234 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2023-10-06T03:02:30.681 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-10-06T03:02:30.682 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2023-10-06T03:02:30.731 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-10-06T03:02:30.732 INFO:teuthology.orchestra.run.smithi082.stdout:Unable to read consumer identity 2023-10-06T03:02:32.024 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-06T03:02:32.071 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-10-06T03:02:32.795 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-10-06T03:02:34.341 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 16 MB 00:02 2023-10-06T03:02:36.035 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-06T03:02:36.814 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T03:02:36.814 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T03:02:36.814 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-10-06T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-10-06T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-10-06T03:02:37.098 DEBUG:teuthology.orchestra.run.smithi134:> echo no | sudo yum reinstall kernel || true 2023-10-06T03:02:37.442 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-10-06T03:02:37.443 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2023-10-06T03:02:37.676 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-06T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 03:02:36 AM UTC. 2023-10-06T03:02:37.862 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T03:02:37.862 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:02:37.862 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:02:37.897 INFO:teuthology.orchestra.run.smithi134.stderr:Error: No packages marked for reinstall. 2023-10-06T03:02:37.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum reinstall -y kernel || true 2023-10-06T03:02:38.290 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-10-06T03:02:38.290 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2023-10-06T03:02:38.380 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T03:02:38.380 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T03:02:38.380 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T03:02:38.538 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-10-06T03:02:38.539 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-10-06T03:02:38.539 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-10-06T03:02:38.582 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 03:02:36 AM UTC. 2023-10-06T03:02:38.651 DEBUG:teuthology.orchestra.run.smithi082:> echo no | sudo yum reinstall kernel || true 2023-10-06T03:02:38.722 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T03:02:38.722 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:02:38.722 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:02:38.743 INFO:teuthology.orchestra.run.smithi134.stderr:Error: No packages marked for reinstall. 2023-10-06T03:02:38.799 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T03:02:38.924 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:38.925 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:38.925 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:38.925 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T03:02:38.925 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T03:02:38.925 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T03:02:38.925 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T03:02:38.925 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T03:02:38.993 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-10-06T03:02:38.993 INFO:teuthology.orchestra.run.smithi082.stdout:Unable to read consumer identity 2023-10-06T03:02:39.049 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:39.049 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:39.050 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2023-10-06T03:02:39.076 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2023-10-06T03:02:39.076 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2023-10-06T03:02:39.076 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.02 2023-10-06T03:02:39.076 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 99.el8_4.1 2023-10-06T03:02:39.076 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Group : System Environment/Base 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 9264631 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Relocations : (not relocatable) 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : Red Hat, Inc. 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : Red Hat, Inc. 2023-10-06T03:02:39.077 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:02:39.078 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T03:02:39.079 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T03:02:39.079 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:39.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T03:02:39.281 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 03:02:37 AM UTC. 2023-10-06T03:02:39.408 INFO:teuthology.orchestra.run.smithi082.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T03:02:39.408 INFO:teuthology.orchestra.run.smithi082.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:02:39.408 INFO:teuthology.orchestra.run.smithi082.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:02:39.441 INFO:teuthology.orchestra.run.smithi082.stderr:Error: No packages marked for reinstall. 2023-10-06T03:02:39.496 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum reinstall -y kernel || true 2023-10-06T03:02:39.837 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-10-06T03:02:39.838 INFO:teuthology.orchestra.run.smithi082.stdout:Unable to read consumer identity 2023-10-06T03:02:40.119 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 03:02:37 AM UTC. 2023-10-06T03:02:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T03:02:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:02:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T03:02:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:Error: No packages marked for reinstall. 2023-10-06T03:02:40.339 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T03:02:40.463 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:40.464 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:40.464 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:40.464 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T03:02:40.464 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T03:02:40.464 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T03:02:40.464 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T03:02:40.464 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T03:02:40.476 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2023-10-06T03:02:40.588 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:40.588 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:40.589 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2023-10-06T03:02:40.615 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2023-10-06T03:02:40.615 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2023-10-06T03:02:40.615 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.02 2023-10-06T03:02:40.615 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 99.el8_4.1 2023-10-06T03:02:40.615 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2023-10-06T03:02:40.615 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T03:02:40.615 INFO:teuthology.orchestra.run.smithi082.stdout:Group : System Environment/Base 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 9264631 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:Relocations : (not relocatable) 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : Red Hat, Inc. 2023-10-06T03:02:40.616 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : Red Hat, Inc. 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:02:40.617 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T03:02:40.618 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T03:02:40.618 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:40.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T03:02:41.980 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2023-10-06T03:02:42.235 INFO:teuthology.orchestra.run.smithi134.stderr:done 2023-10-06T03:02:42.236 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-10-06T03:02:42.250 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.s2xgj8QUDZ 2023-10-06T03:02:42.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.s2xgj8QUDZ 2023-10-06T03:02:42.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.s2xgj8QUDZ 2023-10-06T03:02:42.486 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.s2xgj8QUDZ is 6KB 2023-10-06T03:02:42.535 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.s2xgj8QUDZ 2023-10-06T03:02:42.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T03:02:42.612 INFO:teuthology.orchestra.run.smithi134.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T03:02:42.612 INFO:teuthology.orchestra.run.smithi134.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T03:02:42.612 INFO:teuthology.orchestra.run.smithi134.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T03:02:42.612 INFO:teuthology.orchestra.run.smithi134.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T03:02:42.613 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:42.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2023-10-06T03:02:44.062 INFO:teuthology.orchestra.run.smithi082.stderr:done 2023-10-06T03:02:44.064 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-10-06T03:02:44.078 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.dc5fJoeZZg 2023-10-06T03:02:44.078 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dc5fJoeZZg 2023-10-06T03:02:44.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.dc5fJoeZZg 2023-10-06T03:02:44.312 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.dc5fJoeZZg is 6KB 2023-10-06T03:02:44.360 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.dc5fJoeZZg 2023-10-06T03:02:44.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T03:02:44.449 INFO:teuthology.orchestra.run.smithi082.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T03:02:44.449 INFO:teuthology.orchestra.run.smithi082.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T03:02:44.449 INFO:teuthology.orchestra.run.smithi082.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T03:02:44.449 INFO:teuthology.orchestra.run.smithi082.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T03:02:44.450 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T03:02:44.609 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2023-10-06T03:03:12.816 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T03:03:12.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-10-06T03:03:12.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:03:14.614 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T03:03:14.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-10-06T03:03:14.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:03:31.195 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-10-06T03:03:32.986 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-10-06T03:03:40.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-10-06T03:03:40.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:03:41.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-10-06T03:03:41.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:03:43.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-10-06T03:03:45.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-10-06T03:03:55.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-10-06T03:03:55.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:03:57.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-10-06T03:03:57.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:04:15.482 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-10-06T03:04:27.024 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-10-06T03:04:27.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-10-06T03:04:27.329 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T03:04:27.330 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-10-06T03:04:27.343 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T03:04:27.343 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:04:27.344 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T03:04:27.344 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T03:04:28.345 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:30.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-10-06T03:04:30.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:04:30.758 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-10-06T03:04:31.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-10-06T03:04:31.114 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T03:04:31.115 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-10-06T03:04:31.130 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T03:04:31.131 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T03:04:31.131 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T03:04:31.131 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T03:04:32.132 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:32.132 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T03:04:32.139 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T03:04:32.139 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T03:04:32.150 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T03:04:32.174 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T03:04:32.180 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T03:04:32.190 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T03:04:32.190 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T03:04:32.233 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T03:04:32.451 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T03:04:32.457 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T03:04:32.457 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T03:04:32.510 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T03:04:32.617 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:04:32.640 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:04:33.046 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:04:33.292 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:04:33.295 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T03:04:33.303 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T03:04:33.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T03:04:33.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T03:04:33.609 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T03:04:33.617 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T03:04:33.618 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T03:04:33.684 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T03:04:33.979 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:04:34.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:04:34.176 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:04:34.259 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:04:34.297 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:04:34.297 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T03:04:34.362 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:04:34.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:04:34.479 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:04:34.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:04:34.564 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:04:34.564 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T03:04:34.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2023-10-06T03:04:34.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2023-10-06T03:04:34.730 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:04:35.020 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:04:35.433 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T03:04:35.440 INFO:teuthology.task.internal:Starting timer... 2023-10-06T03:04:35.441 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T03:04:35.451 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T03:04:35.458 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T03:04:35.459 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2023-10-06T03:04:35.518 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: [ OK ] 2023-10-06T03:04:35.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2023-10-06T03:04:35.587 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: [ OK ] 2023-10-06T03:04:35.588 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T03:04:35.588 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2023-10-06T03:04:35.604 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2023-10-06T03:04:35.605 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2023-10-06T03:04:35.624 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2023-10-06T03:04:35.625 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2023-10-06T03:04:35.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:04:35.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:04:35.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:04:35.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:04:35.694 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T03:04:35.695 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2023-10-06T03:04:35.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2023-10-06T03:04:35.759 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T03:04:35.768 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T03:04:35.768 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T03:04:35.784 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T03:04:35.785 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T03:12:44.955 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2023-10-06T03:12:44.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-10-06T03:12:44.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:12:45.024 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-10-06T03:12:45.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-10-06T03:12:45.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-10-06T03:12:45.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:12:45.159 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-10-06T03:12:45.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-10-06T03:12:45.225 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T03:12:45.237 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T03:12:45.237 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:12:45.237 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:12:45.240 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:12:45.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:12:45.267 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T03:12:45.281 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T03:12:45.294 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T03:12:45.309 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T03:12:45.312 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2023-10-06T03:12:45.322 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2023-10-06T03:12:45.336 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T03:12:45.345 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2023-10-06T03:12:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T03:12:45.353 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2023-10-06T03:12:45.367 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T03:12:45.380 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T03:12:45.409 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2023-10-06T03:12:45.413 INFO:teuthology.orchestra.run.smithi082.stdout:210 Number of sources = 4 2023-10-06T03:12:45.413 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:12:45.413 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2023-10-06T03:12:45.413 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:12:45.413 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:12:45.413 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:12:45.413 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:12:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2023-10-06T03:12:45.447 INFO:teuthology.orchestra.run.smithi134.stdout:210 Number of sources = 4 2023-10-06T03:12:45.447 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:12:45.447 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2023-10-06T03:12:45.447 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:12:45.447 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:12:45.447 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:12:45.447 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:12:45.448 INFO:teuthology.run_tasks:Running task install... 2023-10-06T03:12:45.456 DEBUG:teuthology.task.install:project ceph 2023-10-06T03:12:45.456 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T03:12:45.456 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T03:12:45.456 INFO:teuthology.task.install:Using flavor: default 2023-10-06T03:12:45.462 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T03:12:45.462 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T03:12:45.463 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T03:12:45.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:12:45.465 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T03:12:45.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:12:45.613 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T03:12:45.613 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T03:12:45.688 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T03:12:45.688 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T03:12:45.850 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T03:12:45.850 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:12:45.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T03:12:45.877 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T03:12:45.877 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T03:12:45.927 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T03:12:45.927 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:12:45.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T03:12:45.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T03:12:45.952 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T03:12:45.952 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T03:12:46.017 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T03:12:46.018 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T03:12:46.082 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2023-10-06T03:12:46.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2023-10-06T03:12:46.091 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T03:12:46.154 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2023-10-06T03:12:46.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2023-10-06T03:12:46.474 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-10-06T03:12:46.545 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-10-06T03:12:46.798 INFO:teuthology.orchestra.run.smithi134.stdout:44 files removed 2023-10-06T03:12:46.831 INFO:teuthology.orchestra.run.smithi082.stdout:44 files removed 2023-10-06T03:12:46.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T03:12:46.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T03:12:47.199 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-10-06T03:12:47.228 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-10-06T03:12:48.333 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 111 kB/s | 78 kB 00:00 2023-10-06T03:12:48.360 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 116 kB/s | 78 kB 00:00 2023-10-06T03:12:48.944 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 16 kB/s | 9.2 kB 00:00 2023-10-06T03:12:49.030 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 15 kB/s | 9.2 kB 00:00 2023-10-06T03:12:49.551 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 2.5 kB/s | 1.4 kB 00:00 2023-10-06T03:12:49.638 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 2.5 kB/s | 1.4 kB 00:00 2023-10-06T03:12:49.662 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T03:12:49.749 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T03:12:50.796 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-06T03:12:51.106 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-06T03:12:54.083 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-10-06T03:12:54.445 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-06T03:12:54.468 INFO:teuthology.orchestra.run.smithi134.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 126 MB/s | 38 MB 00:00 2023-10-06T03:12:54.798 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2023-10-06T03:12:59.967 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 127 MB/s | 38 MB 00:00 2023-10-06T03:13:00.021 INFO:teuthology.orchestra.run.smithi134.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 120 MB/s | 33 MB 00:00 2023-10-06T03:13:07.989 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:13:07.990 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:13:08.001 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T03:13:08.002 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T03:13:08.002 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T03:13:08.003 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T03:13:08.005 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T03:13:08.007 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T03:13:08.008 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T03:13:08.494 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-10-06T03:13:08.505 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================================================== 2023-10-06T03:13:08.505 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-10-06T03:13:08.505 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================================================== 2023-10-06T03:13:08.505 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-10-06T03:13:08.505 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T03:13:08.505 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T03:13:08.506 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T03:13:08.507 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T03:13:08.508 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T03:13:08.509 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T03:13:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T03:13:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T03:13:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T03:13:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T03:13:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T03:13:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T03:13:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T03:13:08.510 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T03:13:08.511 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T03:13:08.511 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T03:13:08.511 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T03:13:08.511 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T03:13:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T03:13:08.513 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T03:13:08.514 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T03:13:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T03:13:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================================================== 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout:Install 118 Packages 2023-10-06T03:13:08.517 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2023-10-06T03:13:08.518 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:13:08.518 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 201 M 2023-10-06T03:13:08.518 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-10-06T03:13:08.596 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:13:08.596 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:13:08.607 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T03:13:08.608 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T03:13:08.609 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T03:13:08.610 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T03:13:08.611 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T03:13:08.614 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T03:13:08.615 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T03:13:08.833 INFO:teuthology.orchestra.run.smithi134.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-10-06T03:13:09.112 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-10-06T03:13:09.123 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================================================== 2023-10-06T03:13:09.123 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-10-06T03:13:09.123 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================================================== 2023-10-06T03:13:09.123 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-10-06T03:13:09.123 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T03:13:09.123 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T03:13:09.123 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T03:13:09.123 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T03:13:09.124 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T03:13:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-10-06T03:13:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T03:13:09.127 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T03:13:09.128 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T03:13:09.129 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T03:13:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T03:13:09.131 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T03:13:09.132 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T03:13:09.133 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================================================== 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout:Install 118 Packages 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 2 Packages 2023-10-06T03:13:09.134 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:13:09.135 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 201 M 2023-10-06T03:13:09.135 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-10-06T03:13:09.378 INFO:teuthology.orchestra.run.smithi082.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 36 kB/s | 6.4 kB 00:00 2023-10-06T03:13:09.553 INFO:teuthology.orchestra.run.smithi134.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.2 MB/s | 876 kB 00:00 2023-10-06T03:13:09.685 INFO:teuthology.orchestra.run.smithi134.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 1.2 MB/s | 162 kB 00:00 2023-10-06T03:13:10.075 INFO:teuthology.orchestra.run.smithi082.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.2 MB/s | 876 kB 00:00 2023-10-06T03:13:10.216 INFO:teuthology.orchestra.run.smithi082.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 1.1 MB/s | 162 kB 00:00 2023-10-06T03:13:10.383 INFO:teuthology.orchestra.run.smithi134.stdout:(4/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 2.9 MB/s | 5.2 MB 00:01 2023-10-06T03:13:10.799 INFO:teuthology.orchestra.run.smithi134.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 3.8 MB/s | 1.6 MB 00:00 2023-10-06T03:13:10.889 INFO:teuthology.orchestra.run.smithi134.stdout:(6/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 1.9 MB/s | 2.3 MB 00:01 2023-10-06T03:13:11.428 INFO:teuthology.orchestra.run.smithi134.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 6.3 MB/s | 3.9 MB 00:00 2023-10-06T03:13:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:(4/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 1.7 MB/s | 5.2 MB 00:03 2023-10-06T03:13:12.792 INFO:teuthology.orchestra.run.smithi134.stdout:(8/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 5.6 MB/s | 23 MB 00:04 2023-10-06T03:13:12.865 INFO:teuthology.orchestra.run.smithi134.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 336 kB/s | 24 kB 00:00 2023-10-06T03:13:12.872 INFO:teuthology.orchestra.run.smithi082.stdout:(5/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 889 kB/s | 2.3 MB 00:02 2023-10-06T03:13:12.925 INFO:teuthology.orchestra.run.smithi082.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 2.5 MB/s | 1.6 MB 00:00 2023-10-06T03:13:13.883 INFO:teuthology.orchestra.run.smithi134.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 6.8 MB/s | 17 MB 00:02 2023-10-06T03:13:13.958 INFO:teuthology.orchestra.run.smithi134.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.3 MB/s | 255 kB 00:00 2023-10-06T03:13:14.023 INFO:teuthology.orchestra.run.smithi134.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 384 kB/s | 25 kB 00:00 2023-10-06T03:13:14.181 INFO:teuthology.orchestra.run.smithi134.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 4.9 MB/s | 797 kB 00:00 2023-10-06T03:13:14.253 INFO:teuthology.orchestra.run.smithi134.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.4 MB/s | 174 kB 00:00 2023-10-06T03:13:14.323 INFO:teuthology.orchestra.run.smithi134.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 1.8 MB/s | 130 kB 00:00 2023-10-06T03:13:14.400 INFO:teuthology.orchestra.run.smithi134.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 6.5 MB/s | 507 kB 00:00 2023-10-06T03:13:15.077 INFO:teuthology.orchestra.run.smithi134.stdout:(17/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 4.0 MB/s | 17 MB 00:04 2023-10-06T03:13:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:(18/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 8.0 MB/s | 5.6 MB 00:00 2023-10-06T03:13:16.262 INFO:teuthology.orchestra.run.smithi134.stdout:(19/120): python3-ceph-argparse-17.2.6-1296.g73 967 kB/s | 45 kB 00:00 2023-10-06T03:13:16.262 INFO:teuthology.orchestra.run.smithi134.stdout:(20/120): python3-ceph-common-17.2.6-1296.g736a 2.2 MB/s | 115 kB 00:00 2023-10-06T03:13:16.262 INFO:teuthology.orchestra.run.smithi134.stdout:(21/120): python3-cephfs-17.2.6-1296.g736ac5ba. 3.3 MB/s | 190 kB 00:00 2023-10-06T03:13:16.263 INFO:teuthology.orchestra.run.smithi134.stdout:(22/120): python3-rados-17.2.6-1296.g736ac5ba.e 5.4 MB/s | 371 kB 00:00 2023-10-06T03:13:16.263 INFO:teuthology.orchestra.run.smithi134.stdout:(23/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 5.0 MB/s | 358 kB 00:00 2023-10-06T03:13:16.263 INFO:teuthology.orchestra.run.smithi134.stdout:(24/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.8 MB/s | 107 kB 00:00 2023-10-06T03:13:16.263 INFO:teuthology.orchestra.run.smithi134.stdout:(25/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.7 MB/s | 90 kB 00:00 2023-10-06T03:13:16.263 INFO:teuthology.orchestra.run.smithi134.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.2 MB/s | 173 kB 00:00 2023-10-06T03:13:16.263 INFO:teuthology.orchestra.run.smithi134.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 338 kB/s | 23 kB 00:00 2023-10-06T03:13:16.264 INFO:teuthology.orchestra.run.smithi134.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.6 MB/s | 121 kB 00:00 2023-10-06T03:13:16.264 INFO:teuthology.orchestra.run.smithi134.stdout:(29/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 9.1 MB/s | 3.5 MB 00:00 2023-10-06T03:13:16.264 INFO:teuthology.orchestra.run.smithi134.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 4.2 MB/s | 1.7 MB 00:00 2023-10-06T03:13:16.264 INFO:teuthology.orchestra.run.smithi134.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.0 MB/s | 238 kB 00:00 2023-10-06T03:13:16.264 INFO:teuthology.orchestra.run.smithi134.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 673 kB/s | 47 kB 00:00 2023-10-06T03:13:16.265 INFO:teuthology.orchestra.run.smithi134.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 202 kB/s | 14 kB 00:00 2023-10-06T03:13:16.265 INFO:teuthology.orchestra.run.smithi134.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.3 MB/s | 267 kB 00:00 2023-10-06T03:13:16.288 INFO:teuthology.orchestra.run.smithi134.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-06T03:13:16.361 INFO:teuthology.orchestra.run.smithi134.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 250 kB/s | 18 kB 00:00 2023-10-06T03:13:16.409 INFO:teuthology.orchestra.run.smithi082.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 1.1 MB/s | 3.9 MB 00:03 2023-10-06T03:13:16.474 INFO:teuthology.orchestra.run.smithi134.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 9.0 MB/s | 7.4 MB 00:00 2023-10-06T03:13:16.724 INFO:teuthology.orchestra.run.smithi134.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 236 kB/s | 59 kB 00:00 2023-10-06T03:13:17.148 INFO:teuthology.orchestra.run.smithi134.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 826 kB/s | 306 kB 00:00 2023-10-06T03:13:17.166 INFO:teuthology.orchestra.run.smithi134.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 934 kB/s | 75 kB 00:00 2023-10-06T03:13:17.166 INFO:teuthology.orchestra.run.smithi134.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 4.2 MB/s | 476 kB 00:00 2023-10-06T03:13:17.167 INFO:teuthology.orchestra.run.smithi134.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 685 kB/s | 44 kB 00:00 2023-10-06T03:13:17.167 INFO:teuthology.orchestra.run.smithi134.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 3.2 MB/s | 185 kB 00:00 2023-10-06T03:13:17.167 INFO:teuthology.orchestra.run.smithi134.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 550 kB/s | 33 kB 00:00 2023-10-06T03:13:17.167 INFO:teuthology.orchestra.run.smithi134.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 334 kB/s | 16 kB 00:00 2023-10-06T03:13:17.167 INFO:teuthology.orchestra.run.smithi134.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.5 MB/s | 384 kB 00:00 2023-10-06T03:13:17.167 INFO:teuthology.orchestra.run.smithi134.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2023-10-06T03:13:17.168 INFO:teuthology.orchestra.run.smithi134.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.5 MB/s | 81 kB 00:00 2023-10-06T03:13:17.168 INFO:teuthology.orchestra.run.smithi134.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 227 kB/s | 11 kB 00:00 2023-10-06T03:13:17.168 INFO:teuthology.orchestra.run.smithi134.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 359 kB/s | 18 kB 00:00 2023-10-06T03:13:17.169 INFO:teuthology.orchestra.run.smithi134.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 975 kB/s | 49 kB 00:00 2023-10-06T03:13:17.220 INFO:teuthology.orchestra.run.smithi134.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-06T03:13:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 6.3 MB/s | 1.2 MB 00:00 2023-10-06T03:13:17.318 INFO:teuthology.orchestra.run.smithi134.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.1 MB/s | 60 kB 00:00 2023-10-06T03:13:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 321 kB/s | 16 kB 00:00 2023-10-06T03:13:17.335 INFO:teuthology.orchestra.run.smithi134.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 4.5 MB/s | 283 kB 00:00 2023-10-06T03:13:17.372 INFO:teuthology.orchestra.run.smithi134.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 683 kB/s | 34 kB 00:00 2023-10-06T03:13:17.392 INFO:teuthology.orchestra.run.smithi134.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 3.4 MB/s | 196 kB 00:00 2023-10-06T03:13:17.476 INFO:teuthology.orchestra.run.smithi082.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 3.7 MB/s | 17 MB 00:04 2023-10-06T03:13:17.476 INFO:teuthology.orchestra.run.smithi134.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-10-06T03:13:17.476 INFO:teuthology.orchestra.run.smithi134.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 361 kB/s | 19 kB 00:00 2023-10-06T03:13:17.493 INFO:teuthology.orchestra.run.smithi134.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 601 kB/s | 29 kB 00:00 2023-10-06T03:13:17.495 INFO:teuthology.orchestra.run.smithi082.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 635 kB/s | 24 kB 00:00 2023-10-06T03:13:17.496 INFO:teuthology.orchestra.run.smithi134.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 319 kB/s | 24 kB 00:00 2023-10-06T03:13:17.542 INFO:teuthology.orchestra.run.smithi134.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 567 kB/s | 27 kB 00:00 2023-10-06T03:13:17.554 INFO:teuthology.orchestra.run.smithi134.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 4.5 MB/s | 255 kB 00:00 2023-10-06T03:13:17.603 INFO:teuthology.orchestra.run.smithi134.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.0 MB/s | 251 kB 00:00 2023-10-06T03:13:17.604 INFO:teuthology.orchestra.run.smithi134.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-06T03:13:17.652 INFO:teuthology.orchestra.run.smithi134.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 474 kB/s | 23 kB 00:00 2023-10-06T03:13:17.655 INFO:teuthology.orchestra.run.smithi134.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 1.6 MB/s | 85 kB 00:00 2023-10-06T03:13:17.660 INFO:teuthology.orchestra.run.smithi134.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-10-06T03:13:17.690 INFO:teuthology.orchestra.run.smithi134.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 613 kB/s | 19 kB 00:00 2023-10-06T03:13:17.704 INFO:teuthology.orchestra.run.smithi134.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.0 MB/s | 43 kB 00:00 2023-10-06T03:13:17.719 INFO:teuthology.orchestra.run.smithi134.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 10 MB/s | 155 kB 00:00 2023-10-06T03:13:17.735 INFO:teuthology.orchestra.run.smithi134.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 14 MB/s | 220 kB 00:00 2023-10-06T03:13:17.751 INFO:teuthology.orchestra.run.smithi134.stdout:(74/120): thrift-0.13.0-2.el8.x86_64.rpm 18 MB/s | 1.7 MB 00:00 2023-10-06T03:13:17.752 INFO:teuthology.orchestra.run.smithi134.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.7 MB/s | 48 kB 00:00 2023-10-06T03:13:17.765 INFO:teuthology.orchestra.run.smithi134.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.4 MB/s | 43 kB 00:00 2023-10-06T03:13:17.781 INFO:teuthology.orchestra.run.smithi134.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.4 MB/s | 229 kB 00:00 2023-10-06T03:13:17.794 INFO:teuthology.orchestra.run.smithi134.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2023-10-06T03:13:17.805 INFO:teuthology.orchestra.run.smithi134.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 57 MB/s | 2.3 MB 00:00 2023-10-06T03:13:17.812 INFO:teuthology.orchestra.run.smithi134.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 33 MB/s | 605 kB 00:00 2023-10-06T03:13:17.819 INFO:teuthology.orchestra.run.smithi134.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 6.1 MB/s | 83 kB 00:00 2023-10-06T03:13:17.826 INFO:teuthology.orchestra.run.smithi134.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.2 MB/s | 59 kB 00:00 2023-10-06T03:13:17.834 INFO:teuthology.orchestra.run.smithi134.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-06T03:13:17.841 INFO:teuthology.orchestra.run.smithi134.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.6 MB/s | 38 kB 00:00 2023-10-06T03:13:17.849 INFO:teuthology.orchestra.run.smithi134.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.8 MB/s | 86 kB 00:00 2023-10-06T03:13:17.855 INFO:teuthology.orchestra.run.smithi134.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.0 MB/s | 58 kB 00:00 2023-10-06T03:13:17.863 INFO:teuthology.orchestra.run.smithi134.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.3 MB/s | 47 kB 00:00 2023-10-06T03:13:17.874 INFO:teuthology.orchestra.run.smithi134.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 29 MB/s | 559 kB 00:00 2023-10-06T03:13:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 33 MB/s | 639 kB 00:00 2023-10-06T03:13:17.888 INFO:teuthology.orchestra.run.smithi134.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.2 MB/s | 70 kB 00:00 2023-10-06T03:13:17.898 INFO:teuthology.orchestra.run.smithi134.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-06T03:13:17.902 INFO:teuthology.orchestra.run.smithi134.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.8 MB/s | 97 kB 00:00 2023-10-06T03:13:17.916 INFO:teuthology.orchestra.run.smithi134.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.1 MB/s | 44 kB 00:00 2023-10-06T03:13:17.929 INFO:teuthology.orchestra.run.smithi134.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.1 MB/s | 27 kB 00:00 2023-10-06T03:13:17.942 INFO:teuthology.orchestra.run.smithi134.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-10-06T03:13:17.958 INFO:teuthology.orchestra.run.smithi134.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-06T03:13:17.977 INFO:teuthology.orchestra.run.smithi134.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-10-06T03:13:18.056 INFO:teuthology.orchestra.run.smithi134.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 61 MB/s | 4.8 MB 00:00 2023-10-06T03:13:18.069 INFO:teuthology.orchestra.run.smithi134.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.1 MB/s | 39 kB 00:00 2023-10-06T03:13:18.179 INFO:teuthology.orchestra.run.smithi134.stdout:(100/120): python3-scipy-1.0.0-20.module+el8.1. 52 MB/s | 15 MB 00:00 2023-10-06T03:13:18.188 INFO:teuthology.orchestra.run.smithi134.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 5.7 MB/s | 688 kB 00:00 2023-10-06T03:13:18.194 INFO:teuthology.orchestra.run.smithi134.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 17 MB/s | 259 kB 00:00 2023-10-06T03:13:18.202 INFO:teuthology.orchestra.run.smithi134.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 15 MB/s | 225 kB 00:00 2023-10-06T03:13:18.208 INFO:teuthology.orchestra.run.smithi134.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.9 MB/s | 126 kB 00:00 2023-10-06T03:13:18.223 INFO:teuthology.orchestra.run.smithi134.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T03:13:18.243 INFO:teuthology.orchestra.run.smithi134.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 28 MB/s | 538 kB 00:00 2023-10-06T03:13:18.261 INFO:teuthology.orchestra.run.smithi134.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 64 MB/s | 3.7 MB 00:00 2023-10-06T03:13:18.265 INFO:teuthology.orchestra.run.smithi134.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-10-06T03:13:18.276 INFO:teuthology.orchestra.run.smithi134.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-06T03:13:18.278 INFO:teuthology.orchestra.run.smithi134.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 8.4 MB/s | 110 kB 00:00 2023-10-06T03:13:18.291 INFO:teuthology.orchestra.run.smithi134.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.6 MB/s | 20 kB 00:00 2023-10-06T03:13:18.292 INFO:teuthology.orchestra.run.smithi134.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2023-10-06T03:13:18.307 INFO:teuthology.orchestra.run.smithi134.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.7 MB/s | 54 kB 00:00 2023-10-06T03:13:18.313 INFO:teuthology.orchestra.run.smithi134.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 31 MB/s | 709 kB 00:00 2023-10-06T03:13:18.382 INFO:teuthology.orchestra.run.smithi134.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 64 MB/s | 4.7 MB 00:00 2023-10-06T03:13:18.399 INFO:teuthology.orchestra.run.smithi134.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 54 MB/s | 4.6 MB 00:00 2023-10-06T03:13:18.407 INFO:teuthology.orchestra.run.smithi134.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 28 MB/s | 713 kB 00:00 2023-10-06T03:13:18.971 INFO:teuthology.orchestra.run.smithi134.stdout:(118/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 6.4 MB/s | 3.6 MB 00:00 2023-10-06T03:13:19.105 INFO:teuthology.orchestra.run.smithi134.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 4.9 MB/s | 3.5 MB 00:00 2023-10-06T03:13:20.092 INFO:teuthology.orchestra.run.smithi082.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 4.6 MB/s | 17 MB 00:03 2023-10-06T03:13:20.143 INFO:teuthology.orchestra.run.smithi082.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 4.9 MB/s | 255 kB 00:00 2023-10-06T03:13:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 1.2 MB/s | 25 kB 00:00 2023-10-06T03:13:20.276 INFO:teuthology.orchestra.run.smithi082.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 7.0 MB/s | 797 kB 00:00 2023-10-06T03:13:20.299 INFO:teuthology.orchestra.run.smithi082.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 7.5 MB/s | 174 kB 00:00 2023-10-06T03:13:20.322 INFO:teuthology.orchestra.run.smithi082.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 5.7 MB/s | 130 kB 00:00 2023-10-06T03:13:20.386 INFO:teuthology.orchestra.run.smithi082.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 7.7 MB/s | 507 kB 00:00 2023-10-06T03:13:20.875 INFO:teuthology.orchestra.run.smithi134.stdout:(120/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 6.4 MB/s | 52 MB 00:08 2023-10-06T03:13:20.881 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-10-06T03:13:20.882 INFO:teuthology.orchestra.run.smithi134.stdout:Total 16 MB/s | 201 MB 00:12 2023-10-06T03:13:20.935 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-10-06T03:13:21.018 INFO:teuthology.orchestra.run.smithi082.stdout:(17/120): ceph-common-17.2.6-1296.g736ac5ba.el8 2.0 MB/s | 23 MB 00:11 2023-10-06T03:13:21.052 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-10-06T03:13:21.052 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-10-06T03:13:21.055 INFO:teuthology.orchestra.run.smithi082.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.2 MB/s | 45 kB 00:00 2023-10-06T03:13:21.095 INFO:teuthology.orchestra.run.smithi082.stdout:(19/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 7.8 MB/s | 5.6 MB 00:00 2023-10-06T03:13:21.096 INFO:teuthology.orchestra.run.smithi082.stdout:(20/120): python3-ceph-common-17.2.6-1296.g736a 2.8 MB/s | 115 kB 00:00 2023-10-06T03:13:21.117 INFO:teuthology.orchestra.run.smithi082.stdout:(21/120): python3-cephfs-17.2.6-1296.g736ac5ba. 8.4 MB/s | 190 kB 00:00 2023-10-06T03:13:21.161 INFO:teuthology.orchestra.run.smithi082.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 8.1 MB/s | 358 kB 00:00 2023-10-06T03:13:21.174 INFO:teuthology.orchestra.run.smithi082.stdout:(23/120): python3-rados-17.2.6-1296.g736ac5ba.e 4.7 MB/s | 371 kB 00:00 2023-10-06T03:13:21.182 INFO:teuthology.orchestra.run.smithi082.stdout:(24/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 4.8 MB/s | 107 kB 00:00 2023-10-06T03:13:21.211 INFO:teuthology.orchestra.run.smithi082.stdout:(25/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.4 MB/s | 90 kB 00:00 2023-10-06T03:13:21.251 INFO:teuthology.orchestra.run.smithi082.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 4.3 MB/s | 173 kB 00:00 2023-10-06T03:13:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 635 kB/s | 23 kB 00:00 2023-10-06T03:13:21.326 INFO:teuthology.orchestra.run.smithi082.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 3.1 MB/s | 121 kB 00:00 2023-10-06T03:13:21.543 INFO:teuthology.orchestra.run.smithi082.stdout:(29/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 9.6 MB/s | 3.5 MB 00:00 2023-10-06T03:13:21.661 INFO:teuthology.orchestra.run.smithi082.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 5.1 MB/s | 1.7 MB 00:00 2023-10-06T03:13:21.735 INFO:teuthology.orchestra.run.smithi082.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.2 MB/s | 238 kB 00:00 2023-10-06T03:13:21.771 INFO:teuthology.orchestra.run.smithi082.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 1.3 MB/s | 47 kB 00:00 2023-10-06T03:13:21.808 INFO:teuthology.orchestra.run.smithi082.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 396 kB/s | 14 kB 00:00 2023-10-06T03:13:21.882 INFO:teuthology.orchestra.run.smithi082.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.6 MB/s | 267 kB 00:00 2023-10-06T03:13:21.919 INFO:teuthology.orchestra.run.smithi082.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 2.1 MB/s | 80 kB 00:00 2023-10-06T03:13:21.955 INFO:teuthology.orchestra.run.smithi082.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 498 kB/s | 18 kB 00:00 2023-10-06T03:13:22.246 INFO:teuthology.orchestra.run.smithi082.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 11 MB/s | 7.4 MB 00:00 2023-10-06T03:13:22.632 INFO:teuthology.orchestra.run.smithi082.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 452 kB/s | 306 kB 00:00 2023-10-06T03:13:22.740 INFO:teuthology.orchestra.run.smithi082.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 699 kB/s | 75 kB 00:00 2023-10-06T03:13:22.799 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-10-06T03:13:22.803 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-10-06T03:13:22.957 INFO:teuthology.orchestra.run.smithi082.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-06T03:13:23.052 INFO:teuthology.orchestra.run.smithi082.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 463 kB/s | 44 kB 00:00 2023-10-06T03:13:23.162 INFO:teuthology.orchestra.run.smithi082.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-10-06T03:13:23.229 INFO:teuthology.orchestra.run.smithi082.stdout:(43/120): liboath-2.6.2-3.el8.x86_64.rpm 60 kB/s | 59 kB 00:00 2023-10-06T03:13:23.255 INFO:teuthology.orchestra.run.smithi082.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 352 kB/s | 33 kB 00:00 2023-10-06T03:13:23.363 INFO:teuthology.orchestra.run.smithi082.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-10-06T03:13:23.452 INFO:teuthology.orchestra.run.smithi082.stdout:(46/120): python3-certifi-2018.10.15-7.el8.noar 73 kB/s | 16 kB 00:00 2023-10-06T03:13:23.493 INFO:teuthology.orchestra.run.smithi082.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 2.9 MB/s | 384 kB 00:00 2023-10-06T03:13:23.586 INFO:teuthology.orchestra.run.smithi082.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 120 kB/s | 11 kB 00:00 2023-10-06T03:13:23.678 INFO:teuthology.orchestra.run.smithi082.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 192 kB/s | 18 kB 00:00 2023-10-06T03:13:23.784 INFO:teuthology.orchestra.run.smithi082.stdout:(50/120): python3-google-auth-1.1.1-10.el8.noar 245 kB/s | 81 kB 00:00 2023-10-06T03:13:23.890 INFO:teuthology.orchestra.run.smithi082.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 5.5 MB/s | 1.2 MB 00:00 2023-10-06T03:13:23.983 INFO:teuthology.orchestra.run.smithi082.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 634 kB/s | 59 kB 00:00 2023-10-06T03:13:24.046 INFO:teuthology.orchestra.run.smithi082.stdout:(53/120): python3-logutils-0.3.5-11.el8.noarch. 186 kB/s | 49 kB 00:00 2023-10-06T03:13:24.076 INFO:teuthology.orchestra.run.smithi082.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 651 kB/s | 60 kB 00:00 2023-10-06T03:13:24.167 INFO:teuthology.orchestra.run.smithi082.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 171 kB/s | 16 kB 00:00 2023-10-06T03:13:24.258 INFO:teuthology.orchestra.run.smithi082.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 368 kB/s | 34 kB 00:00 2023-10-06T03:13:24.357 INFO:teuthology.orchestra.run.smithi082.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 2.0 MB/s | 196 kB 00:00 2023-10-06T03:13:24.450 INFO:teuthology.orchestra.run.smithi082.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 691 kB/s | 64 kB 00:00 2023-10-06T03:13:24.543 INFO:teuthology.orchestra.run.smithi082.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 202 kB/s | 19 kB 00:00 2023-10-06T03:13:24.630 INFO:teuthology.orchestra.run.smithi082.stdout:(60/120): python3-pecan-1.3.2-9.el8.noarch.rpm 484 kB/s | 283 kB 00:00 2023-10-06T03:13:24.634 INFO:teuthology.orchestra.run.smithi082.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 262 kB/s | 24 kB 00:00 2023-10-06T03:13:24.725 INFO:teuthology.orchestra.run.smithi082.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 302 kB/s | 27 kB 00:00 2023-10-06T03:13:24.825 INFO:teuthology.orchestra.run.smithi082.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-06T03:13:24.838 INFO:teuthology.orchestra.run.smithi082.stdout:(64/120): python3-tempora-1.14.1-5.el8.noarch.r 141 kB/s | 29 kB 00:00 2023-10-06T03:13:24.925 INFO:teuthology.orchestra.run.smithi082.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.5 MB/s | 251 kB 00:00 2023-10-06T03:13:25.019 INFO:teuthology.orchestra.run.smithi082.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 912 kB/s | 85 kB 00:00 2023-10-06T03:13:25.061 INFO:teuthology.orchestra.run.smithi082.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 275 kB/s | 61 kB 00:00 2023-10-06T03:13:25.110 INFO:teuthology.orchestra.run.smithi082.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 251 kB/s | 23 kB 00:00 2023-10-06T03:13:25.115 INFO:teuthology.orchestra.run.smithi082.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-06T03:13:25.530 INFO:teuthology.orchestra.run.smithi082.stdout:(70/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 6.4 MB/s | 52 MB 00:08 2023-10-06T03:13:25.562 INFO:teuthology.orchestra.run.smithi082.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.4 MB/s | 44 kB 00:00 2023-10-06T03:13:25.577 INFO:teuthology.orchestra.run.smithi082.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.7 MB/s | 27 kB 00:00 2023-10-06T03:13:25.594 INFO:teuthology.orchestra.run.smithi082.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 9.9 MB/s | 161 kB 00:00 2023-10-06T03:13:25.614 INFO:teuthology.orchestra.run.smithi082.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 15 MB/s | 320 kB 00:00 2023-10-06T03:13:25.636 INFO:teuthology.orchestra.run.smithi082.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-10-06T03:13:25.816 INFO:teuthology.orchestra.run.smithi082.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 21 MB/s | 15 MB 00:00 2023-10-06T03:13:25.833 INFO:teuthology.orchestra.run.smithi082.stdout:(77/120): python3-babel-2.5.1-5.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-10-06T03:13:25.833 INFO:teuthology.orchestra.run.smithi082.stdout:(78/120): python3-markupsafe-0.23-19.el8.x86_64 2.1 MB/s | 39 kB 00:00 2023-10-06T03:13:25.852 INFO:teuthology.orchestra.run.smithi082.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2023-10-06T03:13:25.857 INFO:teuthology.orchestra.run.smithi082.stdout:(80/120): bison-3.0.4-10.el8.x86_64.rpm 28 MB/s | 688 kB 00:00 2023-10-06T03:13:25.866 INFO:teuthology.orchestra.run.smithi082.stdout:(81/120): thrift-0.13.0-2.el8.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2023-10-06T03:13:25.869 INFO:teuthology.orchestra.run.smithi082.stdout:(82/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 13 MB/s | 225 kB 00:00 2023-10-06T03:13:25.872 INFO:teuthology.orchestra.run.smithi082.stdout:(83/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 8.1 MB/s | 126 kB 00:00 2023-10-06T03:13:25.884 INFO:teuthology.orchestra.run.smithi082.stdout:(84/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-10-06T03:13:25.891 INFO:teuthology.orchestra.run.smithi082.stdout:(85/120): python3-jinja2-2.10.1-2.el8_0.noarch. 29 MB/s | 538 kB 00:00 2023-10-06T03:13:25.901 INFO:teuthology.orchestra.run.smithi082.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 18 MB/s | 302 kB 00:00 2023-10-06T03:13:25.908 INFO:teuthology.orchestra.run.smithi082.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 8.8 MB/s | 157 kB 00:00 2023-10-06T03:13:25.916 INFO:teuthology.orchestra.run.smithi082.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 7.1 MB/s | 110 kB 00:00 2023-10-06T03:13:25.927 INFO:teuthology.orchestra.run.smithi082.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 19 MB/s | 353 kB 00:00 2023-10-06T03:13:25.929 INFO:teuthology.orchestra.run.smithi082.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 1.5 MB/s | 20 kB 00:00 2023-10-06T03:13:25.945 INFO:teuthology.orchestra.run.smithi082.stdout:(91/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 48 MB/s | 3.7 MB 00:00 2023-10-06T03:13:25.946 INFO:teuthology.orchestra.run.smithi082.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.2 MB/s | 54 kB 00:00 2023-10-06T03:13:25.953 INFO:teuthology.orchestra.run.smithi082.stdout:(93/120): libtool-2.4.6-25.el8.x86_64.rpm 27 MB/s | 709 kB 00:00 2023-10-06T03:13:25.980 INFO:teuthology.orchestra.run.smithi082.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 26 MB/s | 713 kB 00:00 2023-10-06T03:13:25.993 INFO:teuthology.orchestra.run.smithi082.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.4 MB/s | 19 kB 00:00 2023-10-06T03:13:26.006 INFO:teuthology.orchestra.run.smithi082.stdout:(96/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.3 MB/s | 43 kB 00:00 2023-10-06T03:13:26.029 INFO:teuthology.orchestra.run.smithi082.stdout:(97/120): openblas-threads-0.3.12-1.el8.x86_64. 56 MB/s | 4.7 MB 00:00 2023-10-06T03:13:26.042 INFO:teuthology.orchestra.run.smithi082.stdout:(98/120): openblas-0.3.12-1.el8.x86_64.rpm 48 MB/s | 4.6 MB 00:00 2023-10-06T03:13:26.044 INFO:teuthology.orchestra.run.smithi082.stdout:(99/120): python3-oauthlib-2.1.0-1.el8.noarch.r 4.0 MB/s | 155 kB 00:00 2023-10-06T03:13:26.046 INFO:teuthology.orchestra.run.smithi082.stdout:(100/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-06T03:13:26.055 INFO:teuthology.orchestra.run.smithi082.stdout:(101/120): keyutils-libs-devel-1.5.10-6.el8.x86 3.6 MB/s | 48 kB 00:00 2023-10-06T03:13:26.059 INFO:teuthology.orchestra.run.smithi082.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 3.2 MB/s | 43 kB 00:00 2023-10-06T03:13:26.060 INFO:teuthology.orchestra.run.smithi082.stdout:(103/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 14 MB/s | 229 kB 00:00 2023-10-06T03:13:26.071 INFO:teuthology.orchestra.run.smithi082.stdout:(104/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.5 MB/s | 18 kB 00:00 2023-10-06T03:13:26.085 INFO:teuthology.orchestra.run.smithi082.stdout:(105/120): fuse-2.9.7-12.el8.x86_64.rpm 6.0 MB/s | 83 kB 00:00 2023-10-06T03:13:26.087 INFO:teuthology.orchestra.run.smithi082.stdout:(106/120): pcre2-devel-10.32-2.el8.x86_64.rpm 22 MB/s | 605 kB 00:00 2023-10-06T03:13:26.099 INFO:teuthology.orchestra.run.smithi082.stdout:(107/120): openssl-devel-1.1.1g-15.el8_3.x86_64 53 MB/s | 2.3 MB 00:00 2023-10-06T03:13:26.100 INFO:teuthology.orchestra.run.smithi082.stdout:(108/120): elfutils-libelf-devel-0.182-3.el8.x8 3.7 MB/s | 59 kB 00:00 2023-10-06T03:13:26.102 INFO:teuthology.orchestra.run.smithi082.stdout:(109/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-06T03:13:26.114 INFO:teuthology.orchestra.run.smithi082.stdout:(110/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.7 MB/s | 38 kB 00:00 2023-10-06T03:13:26.115 INFO:teuthology.orchestra.run.smithi082.stdout:(111/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.9 MB/s | 86 kB 00:00 2023-10-06T03:13:26.117 INFO:teuthology.orchestra.run.smithi082.stdout:(112/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.0 MB/s | 58 kB 00:00 2023-10-06T03:13:26.127 INFO:teuthology.orchestra.run.smithi082.stdout:(113/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.5 MB/s | 47 kB 00:00 2023-10-06T03:13:26.137 INFO:teuthology.orchestra.run.smithi082.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 25 MB/s | 559 kB 00:00 2023-10-06T03:13:26.140 INFO:teuthology.orchestra.run.smithi082.stdout:(115/120): libgfortran-8.4.1-1.el8.x86_64.rpm 27 MB/s | 639 kB 00:00 2023-10-06T03:13:26.141 INFO:teuthology.orchestra.run.smithi082.stdout:(116/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 4.8 MB/s | 70 kB 00:00 2023-10-06T03:13:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 13 MB/s | 200 kB 00:00 2023-10-06T03:13:26.154 INFO:teuthology.orchestra.run.smithi082.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 6.9 MB/s | 97 kB 00:00 2023-10-06T03:13:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 4.1 MB/s | 3.6 MB 00:00 2023-10-06T03:13:27.353 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-10-06T03:13:27.355 INFO:teuthology.orchestra.run.smithi082.stdout:(120/120): librados2-17.2.6-1296.g736ac5ba.el8. 2.9 MB/s | 3.5 MB 00:01 2023-10-06T03:13:27.359 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-10-06T03:13:27.359 INFO:teuthology.orchestra.run.smithi082.stdout:Total 11 MB/s | 201 MB 00:18 2023-10-06T03:13:27.405 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-10-06T03:13:27.516 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-10-06T03:13:27.517 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-10-06T03:13:27.575 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T03:13:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T03:13:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T03:13:28.117 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T03:13:28.505 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T03:13:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:13:29.138 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:13:29.281 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-10-06T03:13:29.286 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-10-06T03:13:29.350 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:13:29.485 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:13:29.667 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:13:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:13:29.917 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:13:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T03:13:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T03:13:31.134 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:13:31.246 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:13:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T03:13:31.657 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T03:13:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:13:32.002 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:13:32.205 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:13:32.282 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:13:32.420 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T03:13:32.690 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T03:13:32.891 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T03:13:33.073 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T03:13:33.208 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T03:13:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T03:13:33.533 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T03:13:34.082 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T03:13:34.179 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-10-06T03:13:34.250 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T03:13:34.409 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T03:13:34.643 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T03:13:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T03:13:34.844 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T03:13:34.977 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T03:13:34.991 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T03:13:35.194 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T03:13:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T03:13:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T03:13:35.810 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:13:35.986 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T03:13:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:13:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T03:13:36.468 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:13:36.479 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T03:13:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:13:36.647 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T03:13:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T03:13:36.810 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:13:36.909 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:13:37.033 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T03:13:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T03:13:37.274 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T03:13:37.534 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T03:13:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T03:13:37.986 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T03:13:38.360 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:13:38.476 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:13:38.738 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T03:13:38.942 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T03:13:39.160 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:13:39.266 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:13:39.477 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:13:39.544 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:13:39.737 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T03:13:39.823 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T03:13:39.926 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T03:13:40.061 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T03:13:40.188 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T03:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T03:13:40.817 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T03:13:41.017 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T03:13:41.205 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T03:13:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T03:13:41.554 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T03:13:41.776 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T03:13:41.826 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T03:13:42.053 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T03:13:42.277 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T03:13:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T03:13:42.490 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T03:13:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T03:13:42.803 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T03:13:42.907 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T03:13:43.032 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T03:13:43.164 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T03:13:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T03:13:43.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T03:13:43.533 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T03:13:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T03:13:43.752 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T03:13:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T03:13:43.932 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T03:13:44.044 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T03:13:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T03:13:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T03:13:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T03:13:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T03:13:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T03:13:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T03:13:44.720 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T03:13:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T03:13:44.899 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T03:13:45.042 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T03:13:45.186 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T03:13:45.413 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T03:13:45.568 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T03:13:45.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T03:13:45.909 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T03:13:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T03:13:46.195 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T03:13:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T03:13:46.540 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T03:13:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T03:13:46.805 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T03:13:46.898 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T03:13:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T03:13:47.123 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T03:13:47.336 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T03:13:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T03:13:47.564 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T03:13:47.738 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T03:13:47.943 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T03:13:48.092 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T03:13:48.265 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T03:13:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T03:13:48.708 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T03:13:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T03:13:49.053 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T03:13:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T03:13:49.474 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T03:13:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T03:13:49.720 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T03:13:49.802 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T03:13:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T03:13:50.087 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T03:13:50.263 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T03:13:50.319 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T03:13:50.462 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T03:13:50.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T03:13:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T03:13:50.754 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T03:13:50.976 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T03:13:51.196 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T03:13:51.403 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T03:13:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T03:13:51.767 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T03:13:51.843 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T03:13:51.952 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T03:13:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T03:13:52.187 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T03:13:52.351 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T03:13:52.465 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T03:13:52.689 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T03:13:52.795 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T03:13:52.985 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T03:13:53.057 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T03:13:53.255 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T03:13:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T03:13:53.632 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T03:13:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T03:13:53.847 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T03:13:53.897 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T03:13:54.039 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T03:13:54.122 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T03:13:54.329 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T03:13:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T03:13:54.723 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T03:13:54.806 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T03:13:55.023 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T03:13:55.242 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T03:13:55.448 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T03:13:55.628 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T03:13:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T03:13:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T03:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T03:13:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T03:13:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T03:13:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T03:13:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T03:13:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T03:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T03:13:57.928 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T03:13:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T03:13:58.443 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T03:13:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T03:13:58.986 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T03:13:59.024 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:13:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:13:59.330 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T03:13:59.563 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T03:13:59.832 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:13:59.875 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T03:14:00.131 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:14:00.248 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:14:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:14:01.063 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T03:14:01.428 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T03:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T03:14:02.063 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T03:14:02.390 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T03:14:02.760 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T03:14:03.031 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T03:14:03.238 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T03:14:03.463 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T03:14:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:14:08.845 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:14:09.431 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:14:10.892 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:14:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:14:11.094 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:14:18.064 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /run 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2023-10-06T03:14:18.065 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:18.477 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:14:19.956 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:14:20.152 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:14:20.381 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:14:20.551 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:14:20.954 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:14:21.143 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:14:21.160 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:14:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:14:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:14:24.315 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T03:14:24.515 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T03:14:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:14:24.905 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:14:25.109 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:14:26.080 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:14:26.275 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:14:26.372 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:14:26.724 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T03:14:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:14:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:14:27.116 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:14:27.127 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:14:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T03:14:28.951 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:14:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:14:29.077 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:14:29.077 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2023-10-06T03:14:29.077 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2023-10-06T03:14:29.077 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2023-10-06T03:14:29.077 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /run 2023-10-06T03:14:29.077 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2023-10-06T03:14:29.078 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2023-10-06T03:14:29.078 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2023-10-06T03:14:29.078 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2023-10-06T03:14:29.078 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2023-10-06T03:14:29.078 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:29.175 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:14:29.218 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:14:29.374 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:14:29.491 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:14:29.723 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:14:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:14:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:14:31.171 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:14:31.392 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:14:31.548 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:14:32.106 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:14:32.123 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:14:34.836 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:14:35.045 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:14:35.231 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:14:35.395 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T03:14:35.597 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T03:14:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T03:14:35.853 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:14:36.070 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:14:36.146 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T03:14:36.311 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:14:36.342 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T03:14:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T03:14:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T03:14:36.793 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T03:14:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T03:14:37.128 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T03:14:37.280 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:14:37.281 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T03:14:37.455 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T03:14:37.488 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:14:37.587 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:14:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T03:14:37.889 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T03:14:37.951 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T03:14:37.984 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T03:14:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T03:14:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T03:14:38.177 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:14:38.215 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:14:38.242 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T03:14:38.242 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:14:38.404 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:14:38.415 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:14:38.459 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:14:38.459 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:14:39.287 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:14:39.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T03:14:39.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T03:14:39.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T03:14:39.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:14:39.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T03:14:39.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T03:14:39.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T03:14:39.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T03:14:39.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T03:14:39.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T03:14:39.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T03:14:39.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T03:14:39.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T03:14:39.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T03:14:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T03:14:39.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T03:14:39.298 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T03:14:39.298 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T03:14:39.298 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T03:14:39.298 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T03:14:39.298 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T03:14:39.298 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T03:14:40.017 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T03:14:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:14:40.329 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:14:40.713 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:14:41.062 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:14:41.246 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:14:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:14:41.439 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:42 ago on Fri 06 Oct 2023 03:12:59 AM UTC. 2023-10-06T03:14:43.648 INFO:teuthology.orchestra.run.smithi134.stdout:Installed products updated. 2023-10-06T03:14:43.796 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:43.796 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2023-10-06T03:14:43.796 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.796 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.796 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.797 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.798 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T03:14:43.799 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.5-12.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T03:14:43.800 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T03:14:43.801 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T03:14:43.801 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T03:14:43.801 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.801 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.801 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T03:14:43.801 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.801 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T03:14:43.801 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T03:14:43.802 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T03:14:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T03:14:43.805 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T03:14:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.808 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:43.808 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T03:14:43.808 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T03:14:43.808 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T03:14:43.808 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T03:14:43.809 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T03:14:43.809 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:43.809 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-10-06T03:14:44.053 DEBUG:teuthology.parallel:result is None 2023-10-06T03:14:46.185 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:14:46.562 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T03:14:46.761 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T03:14:47.465 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T03:14:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T03:14:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 111/122 2023-10-06T03:14:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T03:14:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T03:14:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T03:14:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T03:14:49.068 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T03:14:49.262 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T03:14:49.512 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T03:14:49.735 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T03:14:49.796 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T03:14:49.994 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T03:14:50.003 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T03:14:50.003 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:14:51.121 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T03:14:51.122 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T03:14:51.123 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T03:14:51.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T03:14:51.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T03:14:51.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T03:14:51.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T03:14:51.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T03:14:51.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T03:14:51.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T03:14:51.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T03:14:51.132 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T03:14:51.132 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T03:14:51.132 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T03:14:51.132 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T03:14:51.132 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T03:14:51.132 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T03:14:51.132 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T03:14:51.132 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T03:14:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T03:14:51.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T03:14:51.135 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T03:14:51.136 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T03:14:51.137 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T03:14:51.138 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T03:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T03:14:53.487 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:14:53.487 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:54 ago on Fri 06 Oct 2023 03:12:59 AM UTC. 2023-10-06T03:14:55.520 INFO:teuthology.orchestra.run.smithi082.stdout:Installed products updated. 2023-10-06T03:14:55.670 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.671 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.672 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.5-12.el8.x86_64 2023-10-06T03:14:55.673 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.674 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T03:14:55.675 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.676 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T03:14:55.677 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T03:14:55.678 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T03:14:55.679 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:14:55.680 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T03:14:55.681 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T03:14:55.681 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T03:14:55.681 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T03:14:55.681 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T03:14:55.681 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:55.681 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-10-06T03:14:55.967 DEBUG:teuthology.parallel:result is None 2023-10-06T03:14:55.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:14:56.105 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T03:14:56.125 INFO:teuthology.orchestra.run.smithi082.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T03:14:56.126 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T03:14:56.126 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T03:14:56.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:14:56.346 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T03:14:56.368 INFO:teuthology.orchestra.run.smithi134.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T03:14:56.368 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T03:14:56.369 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T03:14:56.369 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T03:14:56.369 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:56.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:14:56.408 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:14:56.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:14:56.447 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T03:14:56.447 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:56.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:14:56.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:14:56.537 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:14:56.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:14:56.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:14:56.627 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T03:14:56.627 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:56.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:14:56.651 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:14:56.715 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:14:56.715 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:14:56.739 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:14:56.802 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T03:14:56.802 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:56.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:14:56.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:14:56.890 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:14:56.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:14:56.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:14:56.977 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T03:14:57.037 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T03:14:57.037 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2023-10-06T03:14:57.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2023-10-06T03:14:57.062 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T03:14:57.063 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:14:57.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:14:57.127 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T03:14:57.127 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:14:57.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:14:57.197 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T03:14:57.198 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T03:14:57.198 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T03:14:57.198 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:57.198 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:14:57.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:14:57.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T03:14:57.393 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:14:57.393 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:14:57.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:14:57.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T03:14:57.546 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T03:14:57.546 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T03:14:57.546 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412187', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMy/QwPsuOe8hxxDl+5G9LNQRSwewKwbEWYrb0IuRgGltzsRGG9XVzJ8bncKi3DC7kgmnyuNgdHqcp2vTqc2c4U=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKzgy/QeSyqY7bSn2aIcVHxWMgsDJfrpNbKgQ5X1o55HSoMVmaqDavwcj+YJO0eb97kDNvcKC6Zcl1SvGSRyWg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_quota']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T03:14:57.547 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:14:57.549 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:14:57.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:14:57.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:14:57.658 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:57.658 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:14:57.679 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:14:57.679 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 217750 Links: 1 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-10-06 03:14:50.691832866 +0000 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-10-06 03:12:16.186254484 +0000 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-10-06 03:12:16.186254484 +0000 2023-10-06T03:14:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-10-06T03:14:57.734 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:14:57.798 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-10-06T03:14:57.798 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-10-06T03:14:57.798 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000252662 s, 2.0 MB/s 2023-10-06T03:14:57.798 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:14:57.854 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2023-10-06T03:14:57.909 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:14:57.909 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:14:57.909 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 217014 Links: 1 2023-10-06T03:14:57.909 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:14:57.909 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:14:57.909 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-10-06 03:14:50.691832866 +0000 2023-10-06T03:14:57.909 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-10-06 03:12:16.677245352 +0000 2023-10-06T03:14:57.909 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-10-06 03:12:16.677245352 +0000 2023-10-06T03:14:57.910 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-10-06T03:14:57.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:14:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-10-06T03:14:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-10-06T03:14:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000229615 s, 2.2 MB/s 2023-10-06T03:14:57.973 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:14:58.028 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2023-10-06T03:14:58.083 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:14:58.083 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:14:58.083 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 220479 Links: 1 2023-10-06T03:14:58.083 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:14:58.084 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:14:58.084 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-10-06 03:14:50.691832866 +0000 2023-10-06T03:14:58.084 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-10-06 03:12:17.183235940 +0000 2023-10-06T03:14:58.084 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-10-06 03:12:17.183235940 +0000 2023-10-06T03:14:58.084 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-10-06T03:14:58.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:14:58.145 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-10-06T03:14:58.145 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-10-06T03:14:58.145 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000230463 s, 2.2 MB/s 2023-10-06T03:14:58.146 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:14:58.202 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2023-10-06T03:14:58.257 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:14:58.257 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:14:58.257 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 215737 Links: 1 2023-10-06T03:14:58.257 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:14:58.257 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:14:58.258 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-10-06 03:14:50.692832848 +0000 2023-10-06T03:14:58.258 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-10-06 03:12:17.670226883 +0000 2023-10-06T03:14:58.258 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-10-06 03:12:17.670226883 +0000 2023-10-06T03:14:58.258 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-10-06T03:14:58.258 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:14:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-10-06T03:14:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-10-06T03:14:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.0001968 s, 2.6 MB/s 2023-10-06T03:14:58.321 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:14:58.376 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:14:58.377 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:14:58.377 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:14:58.394 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:14:58.394 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2023-10-06T03:14:58.451 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:14:58.451 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:14:58.451 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 222215 Links: 1 2023-10-06T03:14:58.451 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:14:58.451 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:14:58.451 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-10-06 03:14:38.867056292 +0000 2023-10-06T03:14:58.451 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-10-06 03:12:13.761506428 +0000 2023-10-06T03:14:58.452 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-10-06 03:12:13.761506428 +0000 2023-10-06T03:14:58.452 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-10-06T03:14:58.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:14:58.516 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-10-06T03:14:58.516 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-10-06T03:14:58.516 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000230333 s, 2.2 MB/s 2023-10-06T03:14:58.517 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:14:58.574 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2023-10-06T03:14:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:14:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:14:58.630 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 219830 Links: 1 2023-10-06T03:14:58.630 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:14:58.630 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:14:58.631 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-10-06 03:14:38.867056292 +0000 2023-10-06T03:14:58.631 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-10-06 03:12:14.261495329 +0000 2023-10-06T03:14:58.631 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-10-06 03:12:14.261495329 +0000 2023-10-06T03:14:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-10-06T03:14:58.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:14:58.695 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-10-06T03:14:58.695 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-10-06T03:14:58.695 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000244504 s, 2.1 MB/s 2023-10-06T03:14:58.696 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:14:58.753 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2023-10-06T03:14:58.808 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:14:58.808 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:14:58.808 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 217618 Links: 1 2023-10-06T03:14:58.808 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:14:58.808 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:14:58.808 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-10-06 03:14:38.867056292 +0000 2023-10-06T03:14:58.808 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-10-06 03:12:14.770484030 +0000 2023-10-06T03:14:58.809 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-10-06 03:12:14.770484030 +0000 2023-10-06T03:14:58.809 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-10-06T03:14:58.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:14:58.986 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-10-06T03:14:58.987 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-10-06T03:14:58.987 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000237388 s, 2.2 MB/s 2023-10-06T03:14:58.988 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:14:59.003 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2023-10-06T03:14:59.059 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:14:59.060 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:14:59.060 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 218426 Links: 1 2023-10-06T03:14:59.060 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:14:59.060 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:14:59.060 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-10-06 03:14:38.867056292 +0000 2023-10-06T03:14:59.060 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-10-06 03:12:15.272472887 +0000 2023-10-06T03:14:59.060 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-10-06 03:12:15.272472887 +0000 2023-10-06T03:14:59.060 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-10-06T03:14:59.061 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:14:59.122 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-10-06T03:14:59.123 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-10-06T03:14:59.123 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000299124 s, 1.7 MB/s 2023-10-06T03:14:59.124 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:14:59.181 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:14:59.181 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:14:59.181 INFO:tasks.ceph:Generating config... 2023-10-06T03:14:59.182 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T03:14:59.182 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T03:14:59.182 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T03:14:59.182 INFO:tasks.ceph:[client] pid file = 2023-10-06T03:14:59.182 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T03:14:59.183 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T03:14:59.183 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T03:14:59.183 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T03:14:59.184 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T03:14:59.184 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T03:14:59.184 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T03:14:59.184 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T03:14:59.184 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T03:14:59.184 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T03:14:59.184 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T03:14:59.184 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T03:14:59.184 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T03:14:59.184 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T03:14:59.184 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T03:14:59.184 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T03:14:59.185 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T03:14:59.185 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T03:14:59.186 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T03:14:59.238 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T03:14:59.241 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T03:14:59.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:14:59.344 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.82'), ('mon.b', '172.21.15.134'), ('mon.c', '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]')] 2023-10-06T03:14:59.345 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.82,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T03:14:59.345 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:59.346 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:14:59.399 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.82 --add b 172.21.15.134 --addv c '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:14:59.482 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:14:59.482 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: generated fsid 968d6894-b90c-4b96-8e67-09d8a805d810 2023-10-06T03:14:59.482 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = octopus 2023-10-06T03:14:59.482 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 0 2023-10-06T03:14:59.482 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 968d6894-b90c-4b96-8e67-09d8a805d810 2023-10-06T03:14:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:last_changed 2023-10-06T03:14:59.482222+0000 2023-10-06T03:14:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:created 2023-10-06T03:14:59.482222+0000 2023-10-06T03:14:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:min_mon_release 15 (octopus) 2023-10-06T03:14:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:election_strategy: 1 2023-10-06T03:14:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2023-10-06T03:14:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2023-10-06T03:14:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:2: [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] mon.c 2023-10-06T03:14:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T03:14:59.484 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:14:59.539 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 968d6894-b90c-4b96-8e67-09d8a805d810... 2023-10-06T03:14:59.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:14:59.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:14:59.621 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.622 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.623 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:14:59.624 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2023-10-06T03:14:59.625 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.82,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 968d6894-b90c-4b96-8e67-09d8a805d810 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:14:59.626 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:14:59.627 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2023-10-06T03:14:59.628 INFO:teuthology.orchestra.run.smithi082.stdout: bdev async discard = True 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: bdev enable discard = True 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore allocator = bitmap 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2023-10-06T03:14:59.629 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:14:59.630 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:14:59.631 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.632 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2023-10-06T03:14:59.633 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2023-10-06T03:14:59.634 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2023-10-06T03:14:59.635 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2023-10-06T03:14:59.636 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2023-10-06T03:14:59.636 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2023-10-06T03:14:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2023-10-06T03:14:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:14:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2023-10-06T03:14:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2023-10-06T03:14:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:14:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.82,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 968d6894-b90c-4b96-8e67-09d8a805d810 2023-10-06T03:14:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2023-10-06T03:14:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = bitmap 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2023-10-06T03:14:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2023-10-06T03:14:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2023-10-06T03:14:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:14:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2023-10-06T03:14:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = "" 2023-10-06T03:14:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-10-06T03:14:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2023-10-06T03:14:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2023-10-06T03:14:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2023-10-06T03:14:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2023-10-06T03:14:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2023-10-06T03:14:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2023-10-06T03:14:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2023-10-06T03:14:59.651 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T03:14:59.652 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T03:14:59.741 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T03:14:59.742 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:59.742 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T03:14:59.756 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:59.756 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T03:14:59.811 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:14:59.811 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:59.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:14:59.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:14:59.884 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:14:59.884 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:14:59.939 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:14:59.939 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:14:59.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:14:59.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:14:59.980 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:14:59.980 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:00.036 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T03:15:00.036 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T03:15:00.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:15:00.083 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:15:00.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:15:00.151 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:15:00.154 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T03:15:00.154 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:15:00.202 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:15:00.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T03:15:00.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T03:15:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T03:15:00.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T03:15:00.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:15:00.392 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:15:00.395 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T03:15:00.419 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T03:15:00.507 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T03:15:00.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T03:15:00.533 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T03:15:00.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T03:15:00.571 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T03:15:00.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T03:15:00.660 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T03:15:00.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T03:15:00.711 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T03:15:00.723 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T03:15:00.801 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T03:15:00.813 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T03:15:00.813 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:15:00.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T03:15:00.837 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:15:00.837 INFO:tasks.ceph:role: osd.0 2023-10-06T03:15:00.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:15:00.837 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:15:00.908 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:15:00.908 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:15:00.909 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:15:00.909 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-10-06T03:15:00.909 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:15:00.909 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:15:00.909 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:15:00.909 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:15:00.909 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:15:00.909 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:15:01.341 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2023-10-06T03:15:01.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-10-06T03:15:01.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T03:15:01.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T03:15:01.542 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T03:15:01.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:15:01.607 INFO:tasks.ceph:role: osd.1 2023-10-06T03:15:01.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:15:01.607 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:15:01.677 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:15:01.678 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2023-10-06T03:15:02.110 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-10-06T03:15:02.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T03:15:02.210 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T03:15:02.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T03:15:02.302 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:15:02.302 INFO:tasks.ceph:role: osd.2 2023-10-06T03:15:02.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:15:02.302 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:15:02.374 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:15:02.375 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:15:02.818 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2023-10-06T03:15:02.819 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-10-06T03:15:02.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T03:15:02.994 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T03:15:03.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T03:15:03.091 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:15:03.092 INFO:tasks.ceph:role: osd.3 2023-10-06T03:15:03.092 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:15:03.092 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:15:03.164 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:15:03.164 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:15:03.164 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:15:03.164 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-10-06T03:15:03.164 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:15:03.164 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:15:03.164 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:15:03.164 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:15:03.165 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:15:03.165 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:15:03.604 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2023-10-06T03:15:03.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-10-06T03:15:03.605 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T03:15:03.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T03:15:03.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:03.892+0000 7f42c8989540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T03:15:03.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:03.893+0000 7f42c8989540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T03:15:03.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:03.893+0000 7f42c8989540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:15:03.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:03.893+0000 7f42c8989540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:15:03.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:03.893+0000 7f42c8989540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:15:03.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:03.893+0000 7f42c8989540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T03:15:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:04.417+0000 7f42c8989540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:05.184+0000 7f42c8989540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:05.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:05.945+0000 7f42c8989540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:06.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T03:15:06.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:06.845+0000 7f4c88afe540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T03:15:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:06.845+0000 7f4c88afe540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T03:15:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:06.845+0000 7f4c88afe540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:15:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:06.845+0000 7f4c88afe540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:15:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:06.845+0000 7f4c88afe540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:15:06.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:06.846+0000 7f4c88afe540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T03:15:07.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:07.368+0000 7f4c88afe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:08.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:08.130+0000 7f4c88afe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:08.893+0000 7f4c88afe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:09.692 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T03:15:09.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:09.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:09.847+0000 7f85894cb540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T03:15:09.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:09.847+0000 7f85894cb540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T03:15:09.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:09.847+0000 7f85894cb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:15:09.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:09.847+0000 7f85894cb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:15:09.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:09.847+0000 7f85894cb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:15:09.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:09.848+0000 7f85894cb540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T03:15:10.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:10.376+0000 7f85894cb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:11.147+0000 7f85894cb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:11.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:11.912+0000 7f85894cb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:12.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T03:15:12.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:12.823+0000 7f7c76808540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T03:15:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:12.823+0000 7f7c76808540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T03:15:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:12.823+0000 7f7c76808540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:15:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:12.823+0000 7f7c76808540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:15:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:12.823+0000 7f7c76808540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:15:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:12.823+0000 7f7c76808540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T03:15:13.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:13.347+0000 7f7c76808540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:14.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:14.112+0000 7f7c76808540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:14.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:14.877+0000 7f7c76808540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:15.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T03:15:15.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T03:15:15.724 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:15:15.724 INFO:tasks.ceph:role: osd.4 2023-10-06T03:15:15.725 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:15:15.725 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:15:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:15:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:15:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-10-06T03:15:16.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-10-06T03:15:16.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T03:15:16.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T03:15:16.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T03:15:16.500 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:15:16.501 INFO:tasks.ceph:role: osd.5 2023-10-06T03:15:16.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:15:16.501 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:15:16.573 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:15:16.573 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:15:16.573 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:15:16.573 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2023-10-06T03:15:16.573 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:15:16.573 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:15:16.573 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:15:16.574 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:15:16.574 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:15:16.574 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:15:16.995 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-10-06T03:15:16.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-10-06T03:15:16.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T03:15:17.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T03:15:17.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T03:15:17.197 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:15:17.197 INFO:tasks.ceph:role: osd.6 2023-10-06T03:15:17.198 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:15:17.198 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:15:17.269 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:15:17.270 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:15:17.270 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:15:17.270 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2023-10-06T03:15:17.270 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:15:17.270 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:15:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:15:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:15:17.271 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:15:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:15:17.726 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-10-06T03:15:17.728 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-10-06T03:15:17.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T03:15:17.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T03:15:17.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T03:15:17.973 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:15:17.974 INFO:tasks.ceph:role: osd.7 2023-10-06T03:15:17.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:15:17.974 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:15:18.045 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:15:18.045 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:15:18.045 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:15:18.045 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2023-10-06T03:15:18.045 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:15:18.045 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:15:18.046 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:15:18.046 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:15:18.046 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:15:18.046 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:15:18.496 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-10-06T03:15:18.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-10-06T03:15:18.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T03:15:18.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T03:15:18.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:18.796 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:18.795+0000 7fefdc43d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T03:15:18.797 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:18.795+0000 7fefdc43d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T03:15:18.797 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:18.795+0000 7fefdc43d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:15:18.797 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:18.795+0000 7fefdc43d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:15:18.797 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:18.795+0000 7fefdc43d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:15:18.797 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:18.796+0000 7fefdc43d540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T03:15:19.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:19.319+0000 7fefdc43d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:20.084+0000 7fefdc43d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:20.858 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:20.857+0000 7fefdc43d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:21.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T03:15:21.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:21.767 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:21.766+0000 7fd066cec540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T03:15:21.767 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:21.766+0000 7fd066cec540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T03:15:21.767 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:21.766+0000 7fd066cec540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:15:21.767 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:21.766+0000 7fd066cec540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:15:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:21.766+0000 7fd066cec540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:15:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:21.767+0000 7fd066cec540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T03:15:22.297 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:22.296+0000 7fd066cec540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:23.060 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:23.059+0000 7fd066cec540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:23.826 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:23.825+0000 7fd066cec540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:24.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T03:15:24.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:24.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:24.732+0000 7f853d92a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T03:15:24.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:24.733+0000 7f853d92a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T03:15:24.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:24.733+0000 7f853d92a540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:15:24.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:24.733+0000 7f853d92a540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:15:24.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:24.733+0000 7f853d92a540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:15:24.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:24.733+0000 7f853d92a540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T03:15:25.259 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:25.258+0000 7f853d92a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:26.022 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:26.022+0000 7f853d92a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:26.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:26.786+0000 7f853d92a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:27.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:15:27.551 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:15:27.593 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T03:15:27.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:27.769 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:27.767+0000 7faac8f86540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T03:15:27.769 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:27.767+0000 7faac8f86540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T03:15:27.769 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:27.767+0000 7faac8f86540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:15:27.769 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:27.767+0000 7faac8f86540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:15:27.769 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:27.767+0000 7faac8f86540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:15:27.769 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:27.767+0000 7faac8f86540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T03:15:28.292 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:28.290+0000 7faac8f86540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:29.058 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:29.056+0000 7faac8f86540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:29.823 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:29.821+0000 7faac8f86540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:15:30.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T03:15:30.682 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T03:15:30.682 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:30.682 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T03:15:30.707 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:30.707 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T03:15:30.771 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:30.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T03:15:30.836 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:30.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T03:15:30.900 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:30.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T03:15:30.964 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:30.965 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T03:15:31.028 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:31.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T03:15:31.091 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.146 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T03:15:31.171 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T03:15:31.236 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.236 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T03:15:31.301 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T03:15:31.364 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.364 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T03:15:31.428 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T03:15:31.493 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T03:15:31.557 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:31.557 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T03:15:31.575 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:31.575 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T03:15:31.630 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.630 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T03:15:31.645 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:31.645 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T03:15:31.699 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T03:15:31.699 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:15:31.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:15:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9l8Dr/BBAA/cTmol+xUbQ2HOUtowC/Zw== 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9l724PDBAAKY5FzGqpcmJ9nM/VzdTluA== 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9lTOzVEhAACwLXU1KFGLhLFDFKzj6g3Q== 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC3ex9lSwhPNRAAEuYJnr5peNQ+adzmaiVfuA== 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2023-10-06T03:15:31.743 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC6ex9lZ7t5MhAAm8vw3nhRW4ZVUaf1Ta7ytg== 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC9ex9lZyKZMhAAmnaJ8C9oe6oQYNe9flPP/w== 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDAex9lXgMXMRAABl0OhmR0JLg6lg2t0i34sg== 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9lsmYMCRAA1BY9VAWL0YXlNJAmkjau9w== 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9l2iFnFxAAnxKQmAHZarx6LfCeKkON3A== 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9le7I7HhAArFktlgVJrQpOrrUTVk22Xw== 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2023-10-06T03:15:31.744 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDGex9lsr9wLxAAQ41BKVQ/dy5Z9EOm/16qDw== 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDJex9l7He2LRAA8Xan1h5Sm60wJtAQP/FLzA== 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDMex9ldA63KxAAenPCZN/PLtQdV14ELvSBWg== 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDPex9lyQ7RLRAAzKpuBd2pcmtTiku1klhAew== 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9lylUIIhAA6GrLOJ3Kp6n7xUJ3VoBUiQ== 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:[client.2] 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9l5shkJxAA+IYYf2SQk8x/hSeuLH3NRQ== 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2023-10-06T03:15:31.745 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9l8UthKhAALxBTh0SRcmfHtgEIOjSuLA== 2023-10-06T03:15:31.746 INFO:teuthology.orchestra.run.smithi082.stdout:[client.3] 2023-10-06T03:15:31.746 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQC0ex9ljArALxAA7shG1AhpdCbRGUzZR4HHng== 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9l8Dr/BBAA/cTmol+xUbQ2HOUtowC/Zw== 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9l724PDBAAKY5FzGqpcmJ9nM/VzdTluA== 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9lTOzVEhAACwLXU1KFGLhLFDFKzj6g3Q== 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC3ex9lSwhPNRAAEuYJnr5peNQ+adzmaiVfuA== 2023-10-06T03:15:31.762 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC6ex9lZ7t5MhAAm8vw3nhRW4ZVUaf1Ta7ytg== 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC9ex9lZyKZMhAAmnaJ8C9oe6oQYNe9flPP/w== 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDAex9lXgMXMRAABl0OhmR0JLg6lg2t0i34sg== 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9lsmYMCRAA1BY9VAWL0YXlNJAmkjau9w== 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9l2iFnFxAAnxKQmAHZarx6LfCeKkON3A== 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9le7I7HhAArFktlgVJrQpOrrUTVk22Xw== 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2023-10-06T03:15:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDGex9lsr9wLxAAQ41BKVQ/dy5Z9EOm/16qDw== 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDJex9l7He2LRAA8Xan1h5Sm60wJtAQP/FLzA== 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDMex9ldA63KxAAenPCZN/PLtQdV14ELvSBWg== 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDPex9lyQ7RLRAAzKpuBd2pcmtTiku1klhAew== 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9lylUIIhAA6GrLOJ3Kp6n7xUJ3VoBUiQ== 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout:[client.2] 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9l5shkJxAA+IYYf2SQk8x/hSeuLH3NRQ== 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2023-10-06T03:15:31.764 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9l8UthKhAALxBTh0SRcmfHtgEIOjSuLA== 2023-10-06T03:15:31.765 INFO:teuthology.orchestra.run.smithi134.stdout:[client.3] 2023-10-06T03:15:31.765 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0ex9ljArALxAA7shG1AhpdCbRGUzZR4HHng== 2023-10-06T03:15:31.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:15:31.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:15:31.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:15:31.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:15:31.904 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:15:31.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:15:31.956 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:31.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.005 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.007 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.102 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.151 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:15:32.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:15:32.200 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:15:32.202 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:15:32.253 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:15:32.255 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:15:32.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.354 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.356 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.403 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:15:32.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:15:32.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:15:32.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:15:32.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:15:32.605 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:15:32.608 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:15:32.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:15:32.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:15:32.710 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T03:15:32.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T03:15:32.734 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:15:32.825 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T03:15:32.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T03:15:32.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:15:32.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T03:15:32.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T03:15:33.052 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:15:33.145 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T03:15:33.168 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:33.171 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:15:33.223 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T03:15:33.223 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T03:15:33.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T03:15:33.226 INFO:tasks.ceph.mon.a:Started 2023-10-06T03:15:33.226 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T03:15:33.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T03:15:33.265 INFO:tasks.ceph.mon.b:Started 2023-10-06T03:15:33.266 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T03:15:33.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T03:15:33.268 INFO:tasks.ceph.mon.c:Started 2023-10-06T03:15:33.268 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T03:15:33.268 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T03:15:33.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T03:15:33.270 INFO:tasks.ceph.mgr.y:Started 2023-10-06T03:15:33.270 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T03:15:33.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T03:15:33.272 INFO:tasks.ceph.mgr.x:Started 2023-10-06T03:15:33.272 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T03:15:33.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T03:15:33.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.387+0000 7f2460f12700 1 Processor -- start 2023-10-06T03:15:33.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.387+0000 7f2460f12700 1 -- start start 2023-10-06T03:15:33.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.388+0000 7f2460f12700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 0x7f245c158750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.388+0000 7f2460f12700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c1582c0 con 0x7f245c1553f0 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.388+0000 7f2460f12700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c157fc0 con 0x7f245c068ed0 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.388+0000 7f2460f12700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0af520 con 0x7f245c0cc090 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.389+0000 7f245a59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f245c1553f0 0x7f245c15b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55230/0 (socket says 172.21.15.82:55230) 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.389+0000 7f245a59c700 1 -- 172.21.15.82:0/776892309 learned_addr learned my addr 172.21.15.82:0/776892309 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.389+0000 7f2459d9b700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 0x7f245c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.389+0000 7f2459d9b700 1 -- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 msgr2=0x7f245c158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.389+0000 7f2459d9b700 1 -- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 msgr2=0x7f245c158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:15:33.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.389+0000 7f2459d9b700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 0x7f245c158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:15:33.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.389+0000 7f2459d9b700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 0x7f245c158750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:15:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.581+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187937373 0 0) 0x7f245c1582c0 con 0x7f245c1553f0 2023-10-06T03:15:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.581+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2444003570 con 0x7f245c1553f0 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.581+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663816540 0 0) 0x7f245c157fc0 con 0x7f245c068ed0 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.581+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f245c1582c0 con 0x7f245c068ed0 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2818148058 0 0) 0x7f245c1582c0 con 0x7f245c068ed0 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 msgr2=0x7f245c158750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 0x7f245c158750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 >> v1:172.21.15.82:6789/0 conn(0x7f245c1553f0 legacy=0x7f245c15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c15bd00 con 0x7f245c068ed0 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f24540017f0 con 0x7f245c068ed0 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 >> v1:172.21.15.134:6789/0 conn(0x7f245c068ed0 legacy=0x7f245c069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2444003bf0 0x7f2444003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 0x7f2444004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2444004d50 0x7f24440051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0af520 con 0x7f2444003bf0 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244400bc70 con 0x7f2444004d50 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244400be30 con 0x7f245c0cc090 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245a59c700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2444003bf0 0x7f2444003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f2459d9b700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 0x7f2444004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245ad9d700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2444004d50 0x7f24440051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245a59c700 1 -- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 msgr2=0x7f2444004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245a59c700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f245c0cc090 0x7f2444004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245a59c700 1 -- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2444004d50 msgr2=0x7f24440051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245a59c700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2444004d50 0x7f24440051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245a59c700 1 -- 172.21.15.82:0/776892309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c1582c0 con 0x7f2444003bf0 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245ad9d700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2444004d50 0x7f24440051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245a59c700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2444003bf0 0x7f2444003fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f244c001b00 tx=0x7f244c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1a549798e9ae33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0048f0 con 0x7f2444003bf0 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c004a70 con 0x7f2444003bf0 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.582+0000 7f245959a700 1 -- 172.21.15.82:0/776892309 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c004e30 con 0x7f2444003bf0 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.583+0000 7f2460f12700 1 -- 172.21.15.82:0/776892309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2444003bf0 msgr2=0x7f2444003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.583+0000 7f2460f12700 1 --2- 172.21.15.82:0/776892309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2444003bf0 0x7f2444003fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f244c001b00 tx=0x7f244c007de0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.583+0000 7f245ad9d700 1 -- 172.21.15.82:0/776892309 reap_dead start 2023-10-06T03:15:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.583+0000 7f2460f12700 1 -- 172.21.15.82:0/776892309 shutdown_connections 2023-10-06T03:15:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.583+0000 7f2460f12700 1 -- 172.21.15.82:0/776892309 >> 172.21.15.82:0/776892309 conn(0x7f245c06e910 msgr2=0x7f245c06be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.583+0000 7f2460f12700 1 -- 172.21.15.82:0/776892309 shutdown_connections 2023-10-06T03:15:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.583+0000 7f2460f12700 1 -- 172.21.15.82:0/776892309 wait complete. 2023-10-06T03:15:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.584+0000 7f2460f12700 1 Processor -- start 2023-10-06T03:15:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.584+0000 7f2460f12700 1 -- start start 2023-10-06T03:15:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f2460f12700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2444003bf0 0x7f245c0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f2460f12700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1680f0 0x7f245c06b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f2460f12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f245c168600 0x7f245c0ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f2460f12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0a5c30 con 0x7f245c168600 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f2460f12700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0a5f10 con 0x7f245c1680f0 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f2460f12700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c06c010 con 0x7f2444003bf0 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f245ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f245c168600 0x7f245c0ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f245ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f245c168600 0x7f245c0ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38184/0 (socket says 172.21.15.82:38184) 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f245ad9d700 1 -- 172.21.15.82:0/4025058254 learned_addr learned my addr 172.21.15.82:0/4025058254 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f2459d9b700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1680f0 0x7f245c06b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.585+0000 7f245a59c700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2444003bf0 0x7f245c0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.586+0000 7f245ad9d700 1 -- 172.21.15.82:0/4025058254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2444003bf0 msgr2=0x7f245c0aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.586+0000 7f245ad9d700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2444003bf0 0x7f245c0aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.586+0000 7f245ad9d700 1 -- 172.21.15.82:0/4025058254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1680f0 msgr2=0x7f245c06b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.586+0000 7f245ad9d700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1680f0 0x7f245c06b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.586+0000 7f245ad9d700 1 -- 172.21.15.82:0/4025058254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c06c2f0 con 0x7f245c168600 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.586+0000 7f245ad9d700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f245c168600 0x7f245c0ad3b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f245c06d4d0 tx=0x7f2454009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.587+0000 7f244a7fc700 1 -- 172.21.15.82:0/4025058254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454017070 con 0x7f245c168600 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.587+0000 7f244a7fc700 1 -- 172.21.15.82:0/4025058254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454006ba0 con 0x7f245c168600 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.587+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c06c5d0 con 0x7f245c168600 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.587+0000 7f244a7fc700 1 -- 172.21.15.82:0/4025058254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400c880 con 0x7f245c168600 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.587+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c168a80 con 0x7f245c168600 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.587+0000 7f244a7fc700 1 -- 172.21.15.82:0/4025058254 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f245400cbf0 con 0x7f245c168600 2023-10-06T03:15:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.587+0000 7f244a7fc700 1 -- 172.21.15.82:0/4025058254 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2454013d40 con 0x7f245c168600 2023-10-06T03:15:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.588+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c064050 con 0x7f245c168600 2023-10-06T03:15:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.591+0000 7f244a7fc700 1 -- 172.21.15.82:0/4025058254 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2454013420 con 0x7f245c168600 2023-10-06T03:15:33.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.663+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f245c067b80 con 0x7f245c168600 2023-10-06T03:15:33.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.670+0000 7f244a7fc700 1 -- 172.21.15.82:0/4025058254 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2454026480 con 0x7f245c168600 2023-10-06T03:15:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f245c168600 msgr2=0x7f245c0ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f245c168600 0x7f245c0ad3b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f245c06d4d0 tx=0x7f2454009040 comp rx=0 tx=0).stop 2023-10-06T03:15:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 shutdown_connections 2023-10-06T03:15:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f245c168600 0x7f245c0ad3b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2444003bf0 0x7f245c0aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 --2- 172.21.15.82:0/4025058254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1680f0 0x7f245c06b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 >> 172.21.15.82:0/4025058254 conn(0x7f245c06e910 msgr2=0x7f245c156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 shutdown_connections 2023-10-06T03:15:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:33.671+0000 7f2460f12700 1 -- 172.21.15.82:0/4025058254 wait complete. 2023-10-06T03:15:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2023-10-06T03:15:33.683 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T03:15:33.683 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:33.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T03:15:33.707 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:33.707 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T03:15:33.771 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:33.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T03:15:33.835 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-10-06T03:15:33.835 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T03:15:33.899 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:33.899 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T03:15:33.925 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:33.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T03:15:33.989 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:33.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T03:15:34.053 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-10-06T03:15:34.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T03:15:34.118 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 46b68dff-6549-4b57-b950-31549b337aef 0 2023-10-06T03:15:34.276 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.271+0000 7f650afc8700 1 Processor -- start 2023-10-06T03:15:34.276 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.271+0000 7f650afc8700 1 -- start start 2023-10-06T03:15:34.276 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f650afc8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f650406b470 0x7f650415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.276 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f650afc8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65040c80d0 0x7f6504159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.276 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f650afc8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040ae340 con 0x7f650406f270 2023-10-06T03:15:34.276 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f650afc8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650415e290 con 0x7f650406b470 2023-10-06T03:15:34.276 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f650afc8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040c8870 con 0x7f65040c80d0 2023-10-06T03:15:34.276 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f6508d64700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f650406b470 0x7f650415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f6509565700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65040c80d0 0x7f6504159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f6503fff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f650406f270 0x7f65040c79c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49656/0 (socket says 172.21.15.134:49656) 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.272+0000 7f6503fff700 1 -- 172.21.15.134:0/2352324592 learned_addr learned my addr 172.21.15.134:0/2352324592 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f6509565700 1 -- 172.21.15.134:0/2352324592 >> v2:172.21.15.134:3300/0 conn(0x7f650406b470 msgr2=0x7f650415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f6509565700 1 --2- 172.21.15.134:0/2352324592 >> v2:172.21.15.134:3300/0 conn(0x7f650406b470 0x7f650415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f6509565700 1 -- 172.21.15.134:0/2352324592 >> v1:172.21.15.134:6789/0 conn(0x7f650406f270 legacy=0x7f65040c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f6509565700 1 -- 172.21.15.134:0/2352324592 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65040afaa0 con 0x7f65040c80d0 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f65037fe700 1 -- 172.21.15.134:0/2352324592 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800196314 0 0) 0x7f65040ae340 con 0x7f650406f270 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f6508d64700 1 --2- 172.21.15.134:0/2352324592 >> v2:172.21.15.134:3300/0 conn(0x7f650406b470 0x7f650415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f6509565700 1 --2- 172.21.15.134:0/2352324592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65040c80d0 0x7f6504159a60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009e60 tx=0x7f64fc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f94e0dc3032838 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f65037fe700 1 -- 172.21.15.134:0/2352324592 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00e070 con 0x7f65040c80d0 2023-10-06T03:15:34.277 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f65037fe700 1 -- 172.21.15.134:0/2352324592 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc00bb60 con 0x7f65040c80d0 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.273+0000 7f65037fe700 1 -- 172.21.15.134:0/2352324592 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc012430 con 0x7f65040c80d0 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.274+0000 7f650afc8700 1 -- 172.21.15.134:0/2352324592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65040c80d0 msgr2=0x7f6504159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.274+0000 7f650afc8700 1 --2- 172.21.15.134:0/2352324592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65040c80d0 0x7f6504159a60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009e60 tx=0x7f64fc009780 comp rx=0 tx=0).stop 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.274+0000 7f650afc8700 1 -- 172.21.15.134:0/2352324592 shutdown_connections 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.274+0000 7f650afc8700 1 --2- 172.21.15.134:0/2352324592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65040c80d0 0x7f6504159a60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.274+0000 7f650afc8700 1 --2- 172.21.15.134:0/2352324592 >> v2:172.21.15.134:3300/0 conn(0x7f650406b470 0x7f650415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.274+0000 7f650afc8700 1 -- 172.21.15.134:0/2352324592 >> 172.21.15.134:0/2352324592 conn(0x7f650406e760 msgr2=0x7f650406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.274+0000 7f650afc8700 1 -- 172.21.15.134:0/2352324592 shutdown_connections 2023-10-06T03:15:34.278 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.274+0000 7f650afc8700 1 -- 172.21.15.134:0/2352324592 wait complete. 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.275+0000 7f650afc8700 1 Processor -- start 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.275+0000 7f650afc8700 1 -- start start 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f650afc8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f650406b470 0x7f65040c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f650afc8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650406f270 0x7f6504067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f650afc8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65040c80d0 0x7f6504068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f650afc8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040699c0 con 0x7f650406b470 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f650afc8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6504068b10 con 0x7f65040c80d0 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f650afc8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6504068df0 con 0x7f650406f270 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650406f270 0x7f6504067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.281 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6509565700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65040c80d0 0x7f6504068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650406f270 0x7f6504067ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52164/0 (socket says 172.21.15.134:52164) 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 -- 172.21.15.134:0/3627973613 learned_addr learned my addr 172.21.15.134:0/3627973613 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6508d64700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f650406b470 0x7f65040c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 -- 172.21.15.134:0/3627973613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65040c80d0 msgr2=0x7f6504068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65040c80d0 0x7f6504068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 -- 172.21.15.134:0/3627973613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f650406b470 msgr2=0x7f65040c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f650406b470 0x7f65040c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 -- 172.21.15.134:0/3627973613 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f8009420 con 0x7f650406f270 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6508d64700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f650406b470 0x7f65040c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6509565700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65040c80d0 0x7f6504068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:34.282 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6503fff700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650406f270 0x7f6504067ec0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f64f000c7e0 tx=0x7f64f0007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.276+0000 7f6500ff9700 1 -- 172.21.15.134:0/3627973613 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0005b30 con 0x7f650406f270 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.277+0000 7f6500ff9700 1 -- 172.21.15.134:0/3627973613 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0005c90 con 0x7f650406f270 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.277+0000 7f6500ff9700 1 -- 172.21.15.134:0/3627973613 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0007300 con 0x7f650406f270 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.277+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc009a20 con 0x7f650406f270 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.277+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65040c3d70 con 0x7f650406f270 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.277+0000 7f6500ff9700 1 -- 172.21.15.134:0/3627973613 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f64f001c440 con 0x7f650406f270 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.277+0000 7f6500ff9700 1 -- 172.21.15.134:0/3627973613 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f64f0012750 con 0x7f650406f270 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.277+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504069310 con 0x7f650406f270 2023-10-06T03:15:34.283 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.281+0000 7f6500ff9700 1 -- 172.21.15.134:0/3627973613 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6504069310 con 0x7f650406f270 2023-10-06T03:15:34.365 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.363+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46b68dff-6549-4b57-b950-31549b337aef", "id": 0} v 0) v1 -- 0x7f6504069790 con 0x7f650406f270 2023-10-06T03:15:34.371 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.369+0000 7f6500ff9700 1 -- 172.21.15.134:0/3627973613 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46b68dff-6549-4b57-b950-31549b337aef", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f64f0017070 con 0x7f650406f270 2023-10-06T03:15:34.371 INFO:teuthology.orchestra.run.smithi134.stdout:0 2023-10-06T03:15:34.372 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650406f270 msgr2=0x7f6504067ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.372 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650406f270 0x7f6504067ec0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f64f000c7e0 tx=0x7f64f0007df0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.372 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 shutdown_connections 2023-10-06T03:15:34.372 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65040c80d0 0x7f6504068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.373 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f650406b470 0x7f65040c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.373 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 --2- 172.21.15.134:0/3627973613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650406f270 0x7f6504067ec0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.373 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 >> 172.21.15.134:0/3627973613 conn(0x7f650406e760 msgr2=0x7f650415ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:34.373 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 shutdown_connections 2023-10-06T03:15:34.373 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.370+0000 7f650afc8700 1 -- 172.21.15.134:0/3627973613 wait complete. 2023-10-06T03:15:34.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea 1 2023-10-06T03:15:34.500 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.498+0000 7f409d530700 1 Processor -- start 2023-10-06T03:15:34.500 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.498+0000 7f409d530700 1 -- start start 2023-10-06T03:15:34.502 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f409d530700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fc20 0x7f40980aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.502 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f409d530700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980af1d0 con 0x7f409813fff0 2023-10-06T03:15:34.502 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f409d530700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980af470 con 0x7f40980cca50 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f409d530700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40980af750 con 0x7f409813fc20 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f4096ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fc20 0x7f40980aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f40977fe700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f40980cca50 0x7f40980caeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49658/0 (socket says 172.21.15.134:49658) 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f4096ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fc20 0x7f40980aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52180/0 (socket says 172.21.15.134:52180) 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f40977fe700 1 -- 172.21.15.134:0/737094597 learned_addr learned my addr 172.21.15.134:0/737094597 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f4095ffb700 1 -- 172.21.15.134:0/737094597 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490516421 0 0) 0x7f40980af470 con 0x7f40980cca50 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f4096ffd700 1 -- 172.21.15.134:0/737094597 >> v1:172.21.15.134:6789/0 conn(0x7f40980cca50 legacy=0x7f40980caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f4096ffd700 1 -- 172.21.15.134:0/737094597 >> v1:172.21.15.82:6789/0 conn(0x7f409813fff0 legacy=0x7f40980cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.499+0000 7f4096ffd700 1 -- 172.21.15.134:0/737094597 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980ca3d0 con 0x7f409813fc20 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f4096ffd700 1 --2- 172.21.15.134:0/737094597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fc20 0x7f40980aec90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f408c009910 tx=0x7f408c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f93cd8c431bba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f4095ffb700 1 -- 172.21.15.134:0/737094597 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00b860 con 0x7f409813fc20 2023-10-06T03:15:34.503 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f4095ffb700 1 -- 172.21.15.134:0/737094597 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c00b9c0 con 0x7f409813fc20 2023-10-06T03:15:34.504 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f4095ffb700 1 -- 172.21.15.134:0/737094597 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00bd60 con 0x7f409813fc20 2023-10-06T03:15:34.504 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f409d530700 1 -- 172.21.15.134:0/737094597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fc20 msgr2=0x7f40980aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.504 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f409d530700 1 --2- 172.21.15.134:0/737094597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fc20 0x7f40980aec90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f408c009910 tx=0x7f408c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.504 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f409d530700 1 -- 172.21.15.134:0/737094597 shutdown_connections 2023-10-06T03:15:34.504 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f409d530700 1 --2- 172.21.15.134:0/737094597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fc20 0x7f40980aec90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.504 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f409d530700 1 -- 172.21.15.134:0/737094597 >> 172.21.15.134:0/737094597 conn(0x7f409806e600 msgr2=0x7f409806ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:34.504 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f409d530700 1 -- 172.21.15.134:0/737094597 shutdown_connections 2023-10-06T03:15:34.504 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.500+0000 7f409d530700 1 -- 172.21.15.134:0/737094597 wait complete. 2023-10-06T03:15:34.506 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f409d530700 1 Processor -- start 2023-10-06T03:15:34.506 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f409d530700 1 -- start start 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f409d530700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40980cca50 0x7f40981637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f409d530700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f409813fc20 0x7f4098154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f409d530700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fff0 0x7f4098155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f409d530700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40981504d0 con 0x7f40980cca50 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f409d530700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4098155de0 con 0x7f409813fc20 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f409d530700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40981560c0 con 0x7f409813fff0 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f40977fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fff0 0x7f4098155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f40967fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f409813fc20 0x7f4098154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f40977fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fff0 0x7f4098155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52182/0 (socket says 172.21.15.134:52182) 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.502+0000 7f40977fe700 1 -- 172.21.15.134:0/4028526134 learned_addr learned my addr 172.21.15.134:0/4028526134 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f4096ffd700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40980cca50 0x7f40981637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.507 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f40967fc700 1 -- 172.21.15.134:0/4028526134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fff0 msgr2=0x7f4098155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f40967fc700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fff0 0x7f4098155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f40967fc700 1 -- 172.21.15.134:0/4028526134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40980cca50 msgr2=0x7f40981637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f40967fc700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40980cca50 0x7f40981637a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f40967fc700 1 -- 172.21.15.134:0/4028526134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c009420 con 0x7f409813fc20 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f40977fe700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fff0 0x7f4098155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f40967fc700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f409813fc20 0x7f4098154ee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f408800c4c0 tx=0x7f4088007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f407effd700 1 -- 172.21.15.134:0/4028526134 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800ce30 con 0x7f409813fc20 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f407effd700 1 -- 172.21.15.134:0/4028526134 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4088011590 con 0x7f409813fc20 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40981563a0 con 0x7f409813fc20 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f407effd700 1 -- 172.21.15.134:0/4028526134 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088011950 con 0x7f409813fc20 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4098155960 con 0x7f409813fc20 2023-10-06T03:15:34.508 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f407effd700 1 -- 172.21.15.134:0/4028526134 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f408801c440 con 0x7f409813fc20 2023-10-06T03:15:34.509 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.503+0000 7f407effd700 1 -- 172.21.15.134:0/4028526134 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f40880127e0 con 0x7f409813fc20 2023-10-06T03:15:34.509 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.504+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4098150610 con 0x7f409813fc20 2023-10-06T03:15:34.509 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.506+0000 7f407effd700 1 -- 172.21.15.134:0/4028526134 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4098150610 con 0x7f409813fc20 2023-10-06T03:15:34.591 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.589+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea", "id": 1} v 0) v1 -- 0x7f4098155b80 con 0x7f409813fc20 2023-10-06T03:15:34.596 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.594+0000 7f407effd700 1 -- 172.21.15.134:0/4028526134 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4088017070 con 0x7f409813fc20 2023-10-06T03:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-10-06T03:15:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f409813fc20 msgr2=0x7f4098154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f409813fc20 0x7f4098154ee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f408800c4c0 tx=0x7f4088007ec0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 shutdown_connections 2023-10-06T03:15:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f409813fff0 0x7f4098155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40980cca50 0x7f40981637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 --2- 172.21.15.134:0/4028526134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f409813fc20 0x7f4098154ee0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 >> 172.21.15.134:0/4028526134 conn(0x7f409806e600 msgr2=0x7f409806b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 shutdown_connections 2023-10-06T03:15:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.595+0000 7f409d530700 1 -- 172.21.15.134:0/4028526134 wait complete. 2023-10-06T03:15:34.608 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 86db79f5-08d0-49aa-b034-2af8a0cbff90 2 2023-10-06T03:15:34.725 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.723+0000 7f46a40fe700 1 Processor -- start 2023-10-06T03:15:34.725 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.723+0000 7f46a40fe700 1 -- start start 2023-10-06T03:15:34.727 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a40fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c159500 0x7f469c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a40fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f469c0b3fd0 0x7f469c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a40fe700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c15dd20 con 0x7f469c15d8e0 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a40fe700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0b1110 con 0x7f469c0b3fd0 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a40fe700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0b13b0 con 0x7f469c159500 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a1e9a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c159500 0x7f469c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a1e9a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c159500 0x7f469c1598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52186/0 (socket says 172.21.15.134:52186) 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a1e9a700 1 -- 172.21.15.134:0/2202389572 learned_addr learned my addr 172.21.15.134:0/2202389572 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.724+0000 7f46a1699700 1 --2- 172.21.15.134:0/2202389572 >> v2:172.21.15.82:3300/0 conn(0x7f469c0b3fd0 0x7f469c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a1e9a700 1 -- 172.21.15.134:0/2202389572 >> v2:172.21.15.82:3300/0 conn(0x7f469c0b3fd0 msgr2=0x7f469c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:34.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a1e9a700 1 --2- 172.21.15.134:0/2202389572 >> v2:172.21.15.82:3300/0 conn(0x7f469c0b3fd0 0x7f469c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a1e9a700 1 -- 172.21.15.134:0/2202389572 >> v1:172.21.15.82:6789/0 conn(0x7f469c15d8e0 legacy=0x7f469c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a1e9a700 1 -- 172.21.15.134:0/2202389572 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0b1690 con 0x7f469c159500 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a1e9a700 1 --2- 172.21.15.134:0/2202389572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c159500 0x7f469c1598d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f468c0099b0 tx=0x7f468c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50b9fa3800ce5597 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a0e98700 1 -- 172.21.15.134:0/2202389572 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c009ea0 con 0x7f469c159500 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a0e98700 1 -- 172.21.15.134:0/2202389572 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c00b860 con 0x7f469c159500 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a0e98700 1 -- 172.21.15.134:0/2202389572 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00bc00 con 0x7f469c159500 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a40fe700 1 -- 172.21.15.134:0/2202389572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c159500 msgr2=0x7f469c1598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.725+0000 7f46a40fe700 1 --2- 172.21.15.134:0/2202389572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c159500 0x7f469c1598d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f468c0099b0 tx=0x7f468c009250 comp rx=0 tx=0).stop 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.726+0000 7f46a40fe700 1 -- 172.21.15.134:0/2202389572 shutdown_connections 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.726+0000 7f46a40fe700 1 --2- 172.21.15.134:0/2202389572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c159500 0x7f469c1598d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.726+0000 7f46a40fe700 1 --2- 172.21.15.134:0/2202389572 >> v2:172.21.15.82:3300/0 conn(0x7f469c0b3fd0 0x7f469c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.726+0000 7f46a40fe700 1 -- 172.21.15.134:0/2202389572 >> 172.21.15.134:0/2202389572 conn(0x7f469c067630 msgr2=0x7f469c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:34.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.726+0000 7f46a40fe700 1 -- 172.21.15.134:0/2202389572 shutdown_connections 2023-10-06T03:15:34.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.726+0000 7f46a40fe700 1 -- 172.21.15.134:0/2202389572 wait complete. 2023-10-06T03:15:34.732 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.727+0000 7f46a40fe700 1 Processor -- start 2023-10-06T03:15:34.732 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.727+0000 7f46a40fe700 1 -- start start 2023-10-06T03:15:34.732 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.727+0000 7f46a40fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c0b3fd0 0x7f469c157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.732 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.727+0000 7f46a40fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c159500 0x7f469c14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.732 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a40fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c15d8e0 0x7f469c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.732 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a40fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c151a60 con 0x7f469c15d8e0 2023-10-06T03:15:34.732 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a40fe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c150920 con 0x7f469c159500 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a40fe700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c16b1f0 con 0x7f469c0b3fd0 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1e9a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c0b3fd0 0x7f469c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1699700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c159500 0x7f469c14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1e9a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c0b3fd0 0x7f469c157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52196/0 (socket says 172.21.15.134:52196) 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1e9a700 1 -- 172.21.15.134:0/1896712027 learned_addr learned my addr 172.21.15.134:0/1896712027 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a269b700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c15d8e0 0x7f469c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1699700 1 -- 172.21.15.134:0/1896712027 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c0b3fd0 msgr2=0x7f469c157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1699700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c0b3fd0 0x7f469c157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1699700 1 -- 172.21.15.134:0/1896712027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c15d8e0 msgr2=0x7f469c14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1699700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c15d8e0 0x7f469c14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1699700 1 -- 172.21.15.134:0/1896712027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0094f0 con 0x7f469c159500 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1e9a700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c0b3fd0 0x7f469c157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a1699700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c159500 0x7f469c14c8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f469800ea50 tx=0x7f46980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f4691ffb700 1 -- 172.21.15.134:0/1896712027 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800c5e0 con 0x7f469c159500 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f4691ffb700 1 -- 172.21.15.134:0/1896712027 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800c740 con 0x7f469c159500 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c15a050 con 0x7f469c159500 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.728+0000 7f4691ffb700 1 -- 172.21.15.134:0/1896712027 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800cae0 con 0x7f469c159500 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.729+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c159ce0 con 0x7f469c159500 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.729+0000 7f4691ffb700 1 -- 172.21.15.134:0/1896712027 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4698005c80 con 0x7f469c159500 2023-10-06T03:15:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.729+0000 7f4691ffb700 1 -- 172.21.15.134:0/1896712027 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f4698013470 con 0x7f469c159500 2023-10-06T03:15:34.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.730+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c15a1e0 con 0x7f469c159500 2023-10-06T03:15:34.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.732+0000 7f4691ffb700 1 -- 172.21.15.134:0/1896712027 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4698021060 con 0x7f469c159500 2023-10-06T03:15:34.774 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:34.772+0000 7ff52b0c8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:15:34.814 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.813+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86db79f5-08d0-49aa-b034-2af8a0cbff90", "id": 2} v 0) v1 -- 0x7f469c064050 con 0x7f469c159500 2023-10-06T03:15:34.818 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.817+0000 7f4691ffb700 1 -- 172.21.15.134:0/1896712027 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86db79f5-08d0-49aa-b034-2af8a0cbff90", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4698017070 con 0x7f469c159500 2023-10-06T03:15:34.818 INFO:teuthology.orchestra.run.smithi134.stdout:2 2023-10-06T03:15:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c159500 msgr2=0x7f469c14c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c159500 0x7f469c14c8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f469800ea50 tx=0x7f46980091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 shutdown_connections 2023-10-06T03:15:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c15d8e0 0x7f469c14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f469c0b3fd0 0x7f469c157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 --2- 172.21.15.134:0/1896712027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f469c159500 0x7f469c14c8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.821 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 >> 172.21.15.134:0/1896712027 conn(0x7f469c067630 msgr2=0x7f469c069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:34.821 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 shutdown_connections 2023-10-06T03:15:34.821 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.818+0000 7f46a40fe700 1 -- 172.21.15.134:0/1896712027 wait complete. 2023-10-06T03:15:34.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 0123a898-574f-45f0-af60-67ef0d7d26b3 3 2023-10-06T03:15:34.916 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:34.914+0000 7ff52b0c8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:15:34.951 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.949+0000 7f111a70b700 1 Processor -- start 2023-10-06T03:15:34.951 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.949+0000 7f111a70b700 1 -- start start 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f111a70b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406b470 0x7f111415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f111a70b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f111406f270 0x7f11140c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f111a70b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11140c7f00 0x7f11140aea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f111a70b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111415e290 con 0x7f111406f270 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f111a70b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11140c8870 con 0x7f11140c7f00 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f111a70b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11140ae340 con 0x7f111406b470 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f1118ca8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11140c7f00 0x7f11140aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f1113fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406b470 0x7f111415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f1118ca8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11140c7f00 0x7f11140aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57594/0 (socket says 172.21.15.134:57594) 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f1113fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406b470 0x7f111415d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52212/0 (socket says 172.21.15.134:52212) 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f1118ca8700 1 -- 172.21.15.134:0/2389766991 learned_addr learned my addr 172.21.15.134:0/2389766991 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.950+0000 7f11137fe700 1 --2- 172.21.15.134:0/2389766991 >> v2:172.21.15.82:3300/0 conn(0x7f111406f270 0x7f11140c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1113fff700 1 -- 172.21.15.134:0/2389766991 >> v2:172.21.15.134:3300/0 conn(0x7f11140c7f00 msgr2=0x7f11140aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1113fff700 1 --2- 172.21.15.134:0/2389766991 >> v2:172.21.15.134:3300/0 conn(0x7f11140c7f00 0x7f11140aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1113fff700 1 -- 172.21.15.134:0/2389766991 >> v2:172.21.15.82:3300/0 conn(0x7f111406f270 msgr2=0x7f11140c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1113fff700 1 --2- 172.21.15.134:0/2389766991 >> v2:172.21.15.82:3300/0 conn(0x7f111406f270 0x7f11140c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1113fff700 1 -- 172.21.15.134:0/2389766991 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140c8340 con 0x7f111406b470 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1118ca8700 1 --2- 172.21.15.134:0/2389766991 >> v2:172.21.15.134:3300/0 conn(0x7f11140c7f00 0x7f11140aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1113fff700 1 --2- 172.21.15.134:0/2389766991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406b470 0x7f111415d2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f11140c7950 tx=0x7f11080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5065b47748fb63a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1112ffd700 1 -- 172.21.15.134:0/2389766991 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011630 con 0x7f111406b470 2023-10-06T03:15:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1112ffd700 1 -- 172.21.15.134:0/2389766991 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11080117b0 con 0x7f111406b470 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f1112ffd700 1 -- 172.21.15.134:0/2389766991 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011b70 con 0x7f111406b470 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f111a70b700 1 -- 172.21.15.134:0/2389766991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406b470 msgr2=0x7f111415d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f111a70b700 1 --2- 172.21.15.134:0/2389766991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406b470 0x7f111415d2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f11140c7950 tx=0x7f11080091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f111a70b700 1 -- 172.21.15.134:0/2389766991 shutdown_connections 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f111a70b700 1 --2- 172.21.15.134:0/2389766991 >> v2:172.21.15.134:3300/0 conn(0x7f11140c7f00 0x7f11140aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f111a70b700 1 --2- 172.21.15.134:0/2389766991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406b470 0x7f111415d2f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f111a70b700 1 --2- 172.21.15.134:0/2389766991 >> v2:172.21.15.82:3300/0 conn(0x7f111406f270 0x7f11140c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f111a70b700 1 -- 172.21.15.134:0/2389766991 >> 172.21.15.134:0/2389766991 conn(0x7f111406e760 msgr2=0x7f111406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.951+0000 7f111a70b700 1 -- 172.21.15.134:0/2389766991 shutdown_connections 2023-10-06T03:15:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.952+0000 7f111a70b700 1 -- 172.21.15.134:0/2389766991 wait complete. 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.953+0000 7f111a70b700 1 Processor -- start 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.953+0000 7f111a70b700 1 -- start start 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.953+0000 7f111a70b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111406b470 0x7f11140c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.953+0000 7f111a70b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406f270 0x7f1114169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.953+0000 7f111a70b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140c7f00 0x7f1114158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.953+0000 7f111a70b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11140c6560 con 0x7f111406b470 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.953+0000 7f111a70b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11140c4430 con 0x7f11140c7f00 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.953+0000 7f111a70b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11140c4710 con 0x7f111406f270 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f11137fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406f270 0x7f1114169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1118ca8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140c7f00 0x7f1114158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1113fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111406b470 0x7f11140c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f11137fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406f270 0x7f1114169b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52224/0 (socket says 172.21.15.134:52224) 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1118ca8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140c7f00 0x7f1114158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57596/0 (socket says 172.21.15.134:57596) 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f11137fe700 1 -- 172.21.15.134:0/4163528648 learned_addr learned my addr 172.21.15.134:0/4163528648 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1118ca8700 1 -- 172.21.15.134:0/4163528648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406f270 msgr2=0x7f1114169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1118ca8700 1 --2- 172.21.15.134:0/4163528648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406f270 0x7f1114169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1118ca8700 1 -- 172.21.15.134:0/4163528648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111406b470 msgr2=0x7f11140c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1118ca8700 1 --2- 172.21.15.134:0/4163528648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111406b470 0x7f11140c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1118ca8700 1 -- 172.21.15.134:0/4163528648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c009ae0 con 0x7f11140c7f00 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1113fff700 1 --2- 172.21.15.134:0/4163528648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111406b470 0x7f11140c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f1118ca8700 1 --2- 172.21.15.134:0/4163528648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140c7f00 0x7f1114158b50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f110c009e70 tx=0x7f110c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f10fbfff700 1 -- 172.21.15.134:0/4163528648 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c018070 con 0x7f11140c7f00 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f10fbfff700 1 -- 172.21.15.134:0/4163528648 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c00f040 con 0x7f11140c7f00 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f10fbfff700 1 -- 172.21.15.134:0/4163528648 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c00cb00 con 0x7f11140c7f00 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1108009420 con 0x7f11140c7f00 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11140c4cd0 con 0x7f11140c7f00 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.954+0000 7f10fbfff700 1 -- 172.21.15.134:0/4163528648 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f110c003020 con 0x7f11140c7f00 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.955+0000 7f10fbfff700 1 -- 172.21.15.134:0/4163528648 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f110c01d410 con 0x7f11140c7f00 2023-10-06T03:15:34.961 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.955+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1114064050 con 0x7f11140c7f00 2023-10-06T03:15:34.962 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:34.957+0000 7f10fbfff700 1 -- 172.21.15.134:0/4163528648 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f110c014480 con 0x7f11140c7f00 2023-10-06T03:15:34.995 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:34.993+0000 7ff52b0c8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:15:35.041 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.040+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0123a898-574f-45f0-af60-67ef0d7d26b3", "id": 3} v 0) v1 -- 0x7f111406e370 con 0x7f11140c7f00 2023-10-06T03:15:35.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.044+0000 7f10fbfff700 1 -- 172.21.15.134:0/4163528648 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0123a898-574f-45f0-af60-67ef0d7d26b3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f110c02c0b0 con 0x7f11140c7f00 2023-10-06T03:15:35.045 INFO:teuthology.orchestra.run.smithi134.stdout:3 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140c7f00 msgr2=0x7f1114158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 --2- 172.21.15.134:0/4163528648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140c7f00 0x7f1114158b50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f110c009e70 tx=0x7f110c00b040 comp rx=0 tx=0).stop 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 shutdown_connections 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 --2- 172.21.15.134:0/4163528648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11140c7f00 0x7f1114158b50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 --2- 172.21.15.134:0/4163528648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111406b470 0x7f11140c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 --2- 172.21.15.134:0/4163528648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f111406f270 0x7f1114169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 >> 172.21.15.134:0/4163528648 conn(0x7f111406e760 msgr2=0x7f1114159830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 shutdown_connections 2023-10-06T03:15:35.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.045+0000 7f111a70b700 1 -- 172.21.15.134:0/4163528648 wait complete. 2023-10-06T03:15:35.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new ed0146a6-cf93-4abf-a810-072f3b3fae4e 4 2023-10-06T03:15:35.084 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:35.083+0000 7f02730e6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:15:35.174 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.173+0000 7fea19a79700 1 Processor -- start 2023-10-06T03:15:35.175 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.173+0000 7fea19a79700 1 -- start start 2023-10-06T03:15:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.173+0000 7fea19a79700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea14069120 0x7fea1415e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.173+0000 7fea19a79700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea140aa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.173+0000 7fea19a79700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea14159540 0x7fea141599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.173+0000 7fea19a79700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140aaeb0 con 0x7fea14159540 2023-10-06T03:15:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.173+0000 7fea19a79700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea14159f00 con 0x7fea14069120 2023-10-06T03:15:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.173+0000 7fea19a79700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140ab0c0 con 0x7fea140694f0 2023-10-06T03:15:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea137fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea14069120 0x7fea1415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.177 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea0bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea140aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea137fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea14069120 0x7fea1415e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57612/0 (socket says 172.21.15.134:57612) 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea137fe700 1 -- 172.21.15.134:0/3934820990 learned_addr learned my addr 172.21.15.134:0/3934820990 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea13fff700 1 --2- 172.21.15.134:0/3934820990 >> v2:172.21.15.82:3300/0 conn(0x7fea14159540 0x7fea141599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea0bfff700 1 -- 172.21.15.134:0/3934820990 >> v2:172.21.15.134:3300/0 conn(0x7fea14069120 msgr2=0x7fea1415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea0bfff700 1 --2- 172.21.15.134:0/3934820990 >> v2:172.21.15.134:3300/0 conn(0x7fea14069120 0x7fea1415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea0bfff700 1 -- 172.21.15.134:0/3934820990 >> v2:172.21.15.82:3300/0 conn(0x7fea14159540 msgr2=0x7fea141599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea0bfff700 1 --2- 172.21.15.134:0/3934820990 >> v2:172.21.15.82:3300/0 conn(0x7fea14159540 0x7fea141599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea0bfff700 1 -- 172.21.15.134:0/3934820990 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140ab3a0 con 0x7fea140694f0 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea137fe700 1 --2- 172.21.15.134:0/3934820990 >> v2:172.21.15.134:3300/0 conn(0x7fea14069120 0x7fea1415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea13fff700 1 --2- 172.21.15.134:0/3934820990 >> v2:172.21.15.82:3300/0 conn(0x7fea14159540 0x7fea141599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:35.178 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea0bfff700 1 --2- 172.21.15.134:0/3934820990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea140aa970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0098e0 tx=0x7fe9fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c461502e902ea1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea12ffd700 1 -- 172.21.15.134:0/3934820990 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc011630 con 0x7fea140694f0 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea12ffd700 1 -- 172.21.15.134:0/3934820990 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc011790 con 0x7fea140694f0 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.174+0000 7fea12ffd700 1 -- 172.21.15.134:0/3934820990 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc011b30 con 0x7fea140694f0 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 -- 172.21.15.134:0/3934820990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 msgr2=0x7fea140aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 --2- 172.21.15.134:0/3934820990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea140aa970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0098e0 tx=0x7fe9fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 -- 172.21.15.134:0/3934820990 shutdown_connections 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 --2- 172.21.15.134:0/3934820990 >> v2:172.21.15.82:3300/0 conn(0x7fea14159540 0x7fea141599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 --2- 172.21.15.134:0/3934820990 >> v2:172.21.15.134:3300/0 conn(0x7fea14069120 0x7fea1415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 --2- 172.21.15.134:0/3934820990 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea140aa970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 -- 172.21.15.134:0/3934820990 >> 172.21.15.134:0/3934820990 conn(0x7fea1406e910 msgr2=0x7fea1406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 -- 172.21.15.134:0/3934820990 shutdown_connections 2023-10-06T03:15:35.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.175+0000 7fea19a79700 1 -- 172.21.15.134:0/3934820990 wait complete. 2023-10-06T03:15:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.176+0000 7fea19a79700 1 Processor -- start 2023-10-06T03:15:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.176+0000 7fea19a79700 1 -- start start 2023-10-06T03:15:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea19a79700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea14069120 0x7fea141438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea19a79700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea1415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea19a79700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14159540 0x7fea140b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea19a79700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415bfe0 con 0x7fea14159540 2023-10-06T03:15:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea19a79700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415d1a0 con 0x7fea14069120 2023-10-06T03:15:35.182 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea19a79700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415b3d0 con 0x7fea140694f0 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea1415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea14069120 0x7fea141438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea1415c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52238/0 (socket says 172.21.15.134:52238) 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 -- 172.21.15.134:0/3044098814 learned_addr learned my addr 172.21.15.134:0/3044098814 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea14069120 0x7fea141438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57616/0 (socket says 172.21.15.134:57616) 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea13fff700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14159540 0x7fea140b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 -- 172.21.15.134:0/3044098814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea14069120 msgr2=0x7fea141438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea14069120 0x7fea141438e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 -- 172.21.15.134:0/3044098814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14159540 msgr2=0x7fea140b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14159540 0x7fea140b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.183 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 -- 172.21.15.134:0/3044098814 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040094f0 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea137fe700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea14069120 0x7fea141438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0bfff700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea1415c5f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0093f0 tx=0x7fe9fc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0b7fe700 1 -- 172.21.15.134:0/3044098814 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc01bc80 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0b7fe700 1 -- 172.21.15.134:0/3044098814 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc01be00 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc009420 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea0b7fe700 1 -- 172.21.15.134:0/3044098814 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc023640 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.177+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1415b990 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.178+0000 7fea0b7fe700 1 -- 172.21.15.134:0/3044098814 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe9fc023a30 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.178+0000 7fea0b7fe700 1 -- 172.21.15.134:0/3044098814 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fe9fc0198c0 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.178+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea14155230 con 0x7fea140694f0 2023-10-06T03:15:35.184 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.180+0000 7fea0b7fe700 1 -- 172.21.15.134:0/3044098814 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe9fc028070 con 0x7fea140694f0 2023-10-06T03:15:35.188 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:35.187+0000 7ff52b0c8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:15:35.214 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:35.213+0000 7f02730e6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:15:35.264 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.262+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ed0146a6-cf93-4abf-a810-072f3b3fae4e", "id": 4} v 0) v1 -- 0x7fea14064050 con 0x7fea140694f0 2023-10-06T03:15:35.268 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.266+0000 7fea0b7fe700 1 -- 172.21.15.134:0/3044098814 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed0146a6-cf93-4abf-a810-072f3b3fae4e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe9fc015020 con 0x7fea140694f0 2023-10-06T03:15:35.268 INFO:teuthology.orchestra.run.smithi134.stdout:4 2023-10-06T03:15:35.269 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 msgr2=0x7fea1415c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.269 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea1415c5f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0093f0 tx=0x7fe9fc017000 comp rx=0 tx=0).stop 2023-10-06T03:15:35.269 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 shutdown_connections 2023-10-06T03:15:35.269 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14159540 0x7fea140b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.269 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea14069120 0x7fea141438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.269 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 --2- 172.21.15.134:0/3044098814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea140694f0 0x7fea1415c5f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.269 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 >> 172.21.15.134:0/3044098814 conn(0x7fea1406e910 msgr2=0x7fea140aa260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.269 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 shutdown_connections 2023-10-06T03:15:35.270 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.267+0000 7fea19a79700 1 -- 172.21.15.134:0/3044098814 wait complete. 2023-10-06T03:15:35.280 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 7fe98f77-1037-48ba-88e9-f368d080546d 5 2023-10-06T03:15:35.288 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:35.287+0000 7f02730e6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:15:35.369 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:35.367+0000 7ff52b0c8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:15:35.395 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.393+0000 7f7cbb1a5700 1 Processor -- start 2023-10-06T03:15:35.395 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.393+0000 7f7cbb1a5700 1 -- start start 2023-10-06T03:15:35.397 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cbb1a5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7cb406b470 0x7f7cb415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cbb1a5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb40ae340 con 0x7f7cb40c80d0 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cbb1a5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb40afaa0 con 0x7f7cb406f270 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cbb1a5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb415e290 con 0x7f7cb406b470 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cb8f41700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7cb406b470 0x7f7cb415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cb3fff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7cb406f270 0x7f7cb40c79c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49672/0 (socket says 172.21.15.134:49672) 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cb3fff700 1 -- 172.21.15.134:0/2831842633 learned_addr learned my addr 172.21.15.134:0/2831842633 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cb8f41700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7cb406b470 0x7f7cb415d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57632/0 (socket says 172.21.15.134:57632) 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cb8f41700 1 -- 172.21.15.134:0/2831842633 >> v1:172.21.15.134:6789/0 conn(0x7f7cb406f270 legacy=0x7f7cb40c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cb8f41700 1 -- 172.21.15.134:0/2831842633 >> v1:172.21.15.82:6789/0 conn(0x7f7cb40c80d0 legacy=0x7f7cb4159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.394+0000 7f7cb37fe700 1 -- 172.21.15.134:0/2831842633 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374571669 0 0) 0x7f7cb40afaa0 con 0x7f7cb406f270 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cb8f41700 1 -- 172.21.15.134:0/2831842633 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb406b840 con 0x7f7cb406b470 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cb8f41700 1 --2- 172.21.15.134:0/2831842633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb406b470 0x7f7cb415d2f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80098e0 tx=0x7f7ca80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f27cfb460cccfe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cb37fe700 1 -- 172.21.15.134:0/2831842633 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8009e80 con 0x7f7cb406b470 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cb37fe700 1 -- 172.21.15.134:0/2831842633 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800b860 con 0x7f7cb406b470 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cb37fe700 1 -- 172.21.15.134:0/2831842633 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800bbe0 con 0x7f7cb406b470 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2831842633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb406b470 msgr2=0x7f7cb415d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cbb1a5700 1 --2- 172.21.15.134:0/2831842633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb406b470 0x7f7cb415d2f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80098e0 tx=0x7f7ca80091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2831842633 shutdown_connections 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cbb1a5700 1 --2- 172.21.15.134:0/2831842633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb406b470 0x7f7cb415d2f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2831842633 >> 172.21.15.134:0/2831842633 conn(0x7f7cb406e760 msgr2=0x7f7cb406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.395+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2831842633 shutdown_connections 2023-10-06T03:15:35.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.396+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2831842633 wait complete. 2023-10-06T03:15:35.402 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.397+0000 7f7cbb1a5700 1 Processor -- start 2023-10-06T03:15:35.402 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.397+0000 7f7cbb1a5700 1 -- start start 2023-10-06T03:15:35.402 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.397+0000 7f7cbb1a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb406b470 0x7f7cb4157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.402 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.397+0000 7f7cbb1a5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cb406f270 0x7f7cb40c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.402 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.397+0000 7f7cbb1a5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb40c80d0 0x7f7cb415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.397+0000 7f7cbb1a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40c5a10 con 0x7f7cb406b470 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.397+0000 7f7cbb1a5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40c5640 con 0x7f7cb40c80d0 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.397+0000 7f7cbb1a5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40c4da0 con 0x7f7cb406f270 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb9742700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb40c80d0 0x7f7cb415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb3fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cb406f270 0x7f7cb40c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb8f41700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb406b470 0x7f7cb4157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb3fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cb406f270 0x7f7cb40c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52240/0 (socket says 172.21.15.134:52240) 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb9742700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb40c80d0 0x7f7cb415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57648/0 (socket says 172.21.15.134:57648) 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb3fff700 1 -- 172.21.15.134:0/2800058654 learned_addr learned my addr 172.21.15.134:0/2800058654 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb9742700 1 -- 172.21.15.134:0/2800058654 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cb406f270 msgr2=0x7f7cb40c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb9742700 1 --2- 172.21.15.134:0/2800058654 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cb406f270 0x7f7cb40c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.403 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb9742700 1 -- 172.21.15.134:0/2800058654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb406b470 msgr2=0x7f7cb4157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb9742700 1 --2- 172.21.15.134:0/2800058654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb406b470 0x7f7cb4157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb9742700 1 -- 172.21.15.134:0/2800058654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8009420 con 0x7f7cb40c80d0 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb3fff700 1 --2- 172.21.15.134:0/2800058654 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cb406f270 0x7f7cb40c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb9742700 1 --2- 172.21.15.134:0/2800058654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb40c80d0 0x7f7cb415be70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40c84d0 tx=0x7f7cac0015f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb0ff9700 1 -- 172.21.15.134:0/2800058654 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011590 con 0x7f7cb40c80d0 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb0ff9700 1 -- 172.21.15.134:0/2800058654 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac011710 con 0x7f7cb40c80d0 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb40c5080 con 0x7f7cb40c80d0 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb0ff9700 1 -- 172.21.15.134:0/2800058654 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011ad0 con 0x7f7cb40c80d0 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb41584a0 con 0x7f7cb40c80d0 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb0ff9700 1 -- 172.21.15.134:0/2800058654 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7cac012420 con 0x7f7cb40c80d0 2023-10-06T03:15:35.404 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.398+0000 7f7cb0ff9700 1 -- 172.21.15.134:0/2800058654 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f7cac011e40 con 0x7f7cb40c80d0 2023-10-06T03:15:35.405 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.399+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb40c5b80 con 0x7f7cb40c80d0 2023-10-06T03:15:35.405 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.401+0000 7f7cb0ff9700 1 -- 172.21.15.134:0/2800058654 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7cb40c5b80 con 0x7f7cb40c80d0 2023-10-06T03:15:35.451 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:35.448+0000 7ff52b0c8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:15:35.471 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:35.470+0000 7f02730e6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:15:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.483+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7fe98f77-1037-48ba-88e9-f368d080546d", "id": 5} v 0) v1 -- 0x7f7cb4064050 con 0x7f7cb40c80d0 2023-10-06T03:15:35.488 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.486+0000 7f7cb0ff9700 1 -- 172.21.15.134:0/2800058654 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7fe98f77-1037-48ba-88e9-f368d080546d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7cac0128b0 con 0x7f7cb40c80d0 2023-10-06T03:15:35.488 INFO:teuthology.orchestra.run.smithi134.stdout:5 2023-10-06T03:15:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb40c80d0 msgr2=0x7f7cb415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 --2- 172.21.15.134:0/2800058654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb40c80d0 0x7f7cb415be70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40c84d0 tx=0x7f7cac0015f0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.489 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 shutdown_connections 2023-10-06T03:15:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 --2- 172.21.15.134:0/2800058654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cb40c80d0 0x7f7cb415be70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 --2- 172.21.15.134:0/2800058654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb406b470 0x7f7cb4157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 --2- 172.21.15.134:0/2800058654 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7cb406f270 0x7f7cb40c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 >> 172.21.15.134:0/2800058654 conn(0x7f7cb406e760 msgr2=0x7f7cb40af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 shutdown_connections 2023-10-06T03:15:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.487+0000 7f7cbb1a5700 1 -- 172.21.15.134:0/2800058654 wait complete. 2023-10-06T03:15:35.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 78df93db-ca61-4cf1-8f08-d453e7ae9b78 6 2023-10-06T03:15:35.594 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:35.592+0000 7ff52b0c8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:15:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.617+0000 7f92b46c4700 1 Processor -- start 2023-10-06T03:15:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.617+0000 7f92b46c4700 1 -- start start 2023-10-06T03:15:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.618+0000 7f92b46c4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fb10 0x7f92ac06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.618+0000 7f92b46c4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92ac13fee0 0x7f92ac0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.618+0000 7f92b46c4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac0c87a0 con 0x7f92ac06f270 2023-10-06T03:15:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.618+0000 7f92b46c4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac06aaf0 con 0x7f92ac13fee0 2023-10-06T03:15:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.618+0000 7f92b46c4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac06adb0 con 0x7f92ac13fb10 2023-10-06T03:15:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b2460700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fb10 0x7f92ac06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b2460700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fb10 0x7f92ac06a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:46040/0 (socket says 172.21.15.134:46040) 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b2460700 1 -- 172.21.15.134:0/3461858564 learned_addr learned my addr 172.21.15.134:0/3461858564 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b1c5f700 1 --2- 172.21.15.134:0/3461858564 >> v2:172.21.15.82:3300/0 conn(0x7f92ac13fee0 0x7f92ac0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b2460700 1 -- 172.21.15.134:0/3461858564 >> v2:172.21.15.82:3300/0 conn(0x7f92ac13fee0 msgr2=0x7f92ac0c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b2460700 1 --2- 172.21.15.134:0/3461858564 >> v2:172.21.15.82:3300/0 conn(0x7f92ac13fee0 0x7f92ac0c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b2460700 1 -- 172.21.15.134:0/3461858564 >> v1:172.21.15.82:6789/0 conn(0x7f92ac06f270 legacy=0x7f92ac15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b2460700 1 -- 172.21.15.134:0/3461858564 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac06b090 con 0x7f92ac13fb10 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b2460700 1 --2- 172.21.15.134:0/3461858564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fb10 0x7f92ac06a5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f929c0099b0 tx=0x7f929c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0be5a91bf795f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b145e700 1 -- 172.21.15.134:0/3461858564 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c009ea0 con 0x7f92ac13fb10 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b145e700 1 -- 172.21.15.134:0/3461858564 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c00b860 con 0x7f92ac13fb10 2023-10-06T03:15:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.619+0000 7f92b145e700 1 -- 172.21.15.134:0/3461858564 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c00bc00 con 0x7f92ac13fb10 2023-10-06T03:15:35.626 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.620+0000 7f92b46c4700 1 -- 172.21.15.134:0/3461858564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fb10 msgr2=0x7f92ac06a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.626 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.620+0000 7f92b46c4700 1 --2- 172.21.15.134:0/3461858564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fb10 0x7f92ac06a5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f929c0099b0 tx=0x7f929c009250 comp rx=0 tx=0).stop 2023-10-06T03:15:35.626 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.620+0000 7f92b46c4700 1 -- 172.21.15.134:0/3461858564 shutdown_connections 2023-10-06T03:15:35.626 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.620+0000 7f92b46c4700 1 --2- 172.21.15.134:0/3461858564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fb10 0x7f92ac06a5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.626 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.620+0000 7f92b46c4700 1 --2- 172.21.15.134:0/3461858564 >> v2:172.21.15.82:3300/0 conn(0x7f92ac13fee0 0x7f92ac0c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.626 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.620+0000 7f92b46c4700 1 -- 172.21.15.134:0/3461858564 >> 172.21.15.134:0/3461858564 conn(0x7f92ac06e760 msgr2=0x7f92ac06eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.626 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.620+0000 7f92b46c4700 1 -- 172.21.15.134:0/3461858564 shutdown_connections 2023-10-06T03:15:35.626 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.620+0000 7f92b46c4700 1 -- 172.21.15.134:0/3461858564 wait complete. 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.621+0000 7f92b46c4700 1 Processor -- start 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.621+0000 7f92b46c4700 1 -- start start 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b46c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac06f270 0x7f92ac0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b46c4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac13fb10 0x7f92ac158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b46c4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fee0 0x7f92ac067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b46c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0a54c0 con 0x7f92ac06f270 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b46c4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0a6040 con 0x7f92ac13fb10 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b46c4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0a5710 con 0x7f92ac13fee0 2023-10-06T03:15:35.627 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b1c5f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac13fb10 0x7f92ac158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2c61700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fee0 0x7f92ac067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b1c5f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac13fb10 0x7f92ac158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35350/0 (socket says 172.21.15.134:35350) 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2c61700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fee0 0x7f92ac067ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:46042/0 (socket says 172.21.15.134:46042) 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b1c5f700 1 -- 172.21.15.134:0/3703482776 learned_addr learned my addr 172.21.15.134:0/3703482776 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2460700 1 --2- 172.21.15.134:0/3703482776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac06f270 0x7f92ac0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2c61700 1 -- 172.21.15.134:0/3703482776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac13fb10 msgr2=0x7f92ac158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2c61700 1 --2- 172.21.15.134:0/3703482776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac13fb10 0x7f92ac158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2c61700 1 -- 172.21.15.134:0/3703482776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac06f270 msgr2=0x7f92ac0c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2c61700 1 --2- 172.21.15.134:0/3703482776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac06f270 0x7f92ac0c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2c61700 1 -- 172.21.15.134:0/3703482776 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0094f0 con 0x7f92ac13fee0 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b2c61700 1 --2- 172.21.15.134:0/3703482776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fee0 0x7f92ac067ec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f92a400c860 tx=0x7f92a4001690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:35.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92a27fc700 1 -- 172.21.15.134:0/3703482776 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4012630 con 0x7f92ac13fee0 2023-10-06T03:15:35.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92a27fc700 1 -- 172.21.15.134:0/3703482776 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a4012790 con 0x7f92ac13fee0 2023-10-06T03:15:35.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac0a59f0 con 0x7f92ac13fee0 2023-10-06T03:15:35.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.622+0000 7f92a27fc700 1 -- 172.21.15.134:0/3703482776 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4012b50 con 0x7f92ac13fee0 2023-10-06T03:15:35.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.623+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac0c74c0 con 0x7f92ac13fee0 2023-10-06T03:15:35.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.623+0000 7f92a27fc700 1 -- 172.21.15.134:0/3703482776 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f92a401b400 con 0x7f92ac13fee0 2023-10-06T03:15:35.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.623+0000 7f92a27fc700 1 -- 172.21.15.134:0/3703482776 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f92a4011980 con 0x7f92ac13fee0 2023-10-06T03:15:35.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.623+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac064050 con 0x7f92ac13fee0 2023-10-06T03:15:35.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.625+0000 7f92a27fc700 1 -- 172.21.15.134:0/3703482776 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f92a401b890 con 0x7f92ac13fee0 2023-10-06T03:15:35.643 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:35.642+0000 7f02730e6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:15:35.694 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:35.692+0000 7ff52b0c8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:15:35.710 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.708+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "78df93db-ca61-4cf1-8f08-d453e7ae9b78", "id": 6} v 0) v1 -- 0x7f92ac0a6180 con 0x7f92ac13fee0 2023-10-06T03:15:35.716 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.714+0000 7f92a27fc700 1 -- 172.21.15.134:0/3703482776 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "78df93db-ca61-4cf1-8f08-d453e7ae9b78", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f92a401ba30 con 0x7f92ac13fee0 2023-10-06T03:15:35.716 INFO:teuthology.orchestra.run.smithi134.stdout:6 2023-10-06T03:15:35.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fee0 msgr2=0x7f92ac067ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 --2- 172.21.15.134:0/3703482776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fee0 0x7f92ac067ec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f92a400c860 tx=0x7f92a4001690 comp rx=0 tx=0).stop 2023-10-06T03:15:35.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 shutdown_connections 2023-10-06T03:15:35.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 --2- 172.21.15.134:0/3703482776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92ac13fee0 0x7f92ac067ec0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 --2- 172.21.15.134:0/3703482776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac06f270 0x7f92ac0c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 --2- 172.21.15.134:0/3703482776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92ac13fb10 0x7f92ac158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 >> 172.21.15.134:0/3703482776 conn(0x7f92ac06e760 msgr2=0x7f92ac06eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 shutdown_connections 2023-10-06T03:15:35.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.715+0000 7f92b46c4700 1 -- 172.21.15.134:0/3703482776 wait complete. 2023-10-06T03:15:35.719 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:35.718+0000 7f02730e6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:15:35.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new a231fc25-6055-4b4b-945e-c4a0e32de914 7 2023-10-06T03:15:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.842+0000 7f8e5b716700 1 Processor -- start 2023-10-06T03:15:35.844 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.842+0000 7f8e5b716700 1 -- start start 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.843+0000 7f8e5b716700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e541553f0 0x7f8e5415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.843+0000 7f8e5b716700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e54068ed0 0x7f8e54069330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.843+0000 7f8e5b716700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e54069870 con 0x7f8e540cc090 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.843+0000 7f8e5b716700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e540af520 con 0x7f8e54068ed0 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.843+0000 7f8e5b716700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e541582c0 con 0x7f8e541553f0 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.843+0000 7f8e594b2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e541553f0 0x7f8e5415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.843+0000 7f8e58cb1700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8e540cc090 0x7f8e54158750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51032/0 (socket says 172.21.15.134:51032) 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.843+0000 7f8e58cb1700 1 -- 172.21.15.134:0/4240452565 learned_addr learned my addr 172.21.15.134:0/4240452565 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e59cb3700 1 --2- 172.21.15.134:0/4240452565 >> v2:172.21.15.82:3300/0 conn(0x7f8e54068ed0 0x7f8e54069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e594b2700 1 -- 172.21.15.134:0/4240452565 >> v2:172.21.15.82:3300/0 conn(0x7f8e54068ed0 msgr2=0x7f8e54069330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e594b2700 1 --2- 172.21.15.134:0/4240452565 >> v2:172.21.15.82:3300/0 conn(0x7f8e54068ed0 0x7f8e54069330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e594b2700 1 -- 172.21.15.134:0/4240452565 >> v1:172.21.15.134:6789/0 conn(0x7f8e540cc090 legacy=0x7f8e54158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e594b2700 1 -- 172.21.15.134:0/4240452565 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54158e60 con 0x7f8e541553f0 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e4bfff700 1 -- 172.21.15.134:0/4240452565 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809872154 0 0) 0x7f8e44001110 con 0x7f8e540cc090 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e594b2700 1 --2- 172.21.15.134:0/4240452565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e541553f0 0x7f8e5415b4b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e5406dc90 tx=0x7f8e500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=447ef0f341ff4c19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e4bfff700 1 -- 172.21.15.134:0/4240452565 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011630 con 0x7f8e541553f0 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e4bfff700 1 -- 172.21.15.134:0/4240452565 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e50011790 con 0x7f8e541553f0 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.844+0000 7f8e4bfff700 1 -- 172.21.15.134:0/4240452565 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011b30 con 0x7f8e541553f0 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.845+0000 7f8e5b716700 1 -- 172.21.15.134:0/4240452565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e541553f0 msgr2=0x7f8e5415b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.845+0000 7f8e5b716700 1 --2- 172.21.15.134:0/4240452565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e541553f0 0x7f8e5415b4b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e5406dc90 tx=0x7f8e500091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.845+0000 7f8e5b716700 1 -- 172.21.15.134:0/4240452565 shutdown_connections 2023-10-06T03:15:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.845+0000 7f8e5b716700 1 --2- 172.21.15.134:0/4240452565 >> v2:172.21.15.82:3300/0 conn(0x7f8e54068ed0 0x7f8e54069330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.845+0000 7f8e5b716700 1 --2- 172.21.15.134:0/4240452565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e541553f0 0x7f8e5415b4b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.845+0000 7f8e5b716700 1 -- 172.21.15.134:0/4240452565 >> 172.21.15.134:0/4240452565 conn(0x7f8e5406e910 msgr2=0x7f8e5406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.845+0000 7f8e5b716700 1 -- 172.21.15.134:0/4240452565 shutdown_connections 2023-10-06T03:15:35.849 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.845+0000 7f8e5b716700 1 -- 172.21.15.134:0/4240452565 wait complete. 2023-10-06T03:15:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.846+0000 7f8e5b716700 1 Processor -- start 2023-10-06T03:15:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.846+0000 7f8e5b716700 1 -- start start 2023-10-06T03:15:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e5b716700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e54068ed0 0x7f8e541575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e5b716700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e540cc090 0x7f8e54069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e5b716700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e541553f0 0x7f8e540a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e5b716700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5406ada0 con 0x7f8e54068ed0 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e5b716700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e541559f0 con 0x7f8e540cc090 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e5b716700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5406a260 con 0x7f8e541553f0 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e540cc090 0x7f8e54069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e59cb3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e541553f0 0x7f8e540a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e540cc090 0x7f8e54069d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35376/0 (socket says 172.21.15.134:35376) 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 -- 172.21.15.134:0/84160067 learned_addr learned my addr 172.21.15.134:0/84160067 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e594b2700 1 --2- 172.21.15.134:0/84160067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e54068ed0 0x7f8e541575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:35.852 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 -- 172.21.15.134:0/84160067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e541553f0 msgr2=0x7f8e540a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 --2- 172.21.15.134:0/84160067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e541553f0 0x7f8e540a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 -- 172.21.15.134:0/84160067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e54068ed0 msgr2=0x7f8e541575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 --2- 172.21.15.134:0/84160067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e54068ed0 0x7f8e541575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 -- 172.21.15.134:0/84160067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50009420 con 0x7f8e540cc090 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e58cb1700 1 --2- 172.21.15.134:0/84160067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e540cc090 0x7f8e54069d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c840 tx=0x7f8e44007c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e497fa700 1 -- 172.21.15.134:0/84160067 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44005b30 con 0x7f8e540cc090 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e497fa700 1 -- 172.21.15.134:0/84160067 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44005c90 con 0x7f8e540cc090 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e540a7940 con 0x7f8e540cc090 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e497fa700 1 -- 172.21.15.134:0/84160067 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44007300 con 0x7f8e540cc090 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.847+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5406a7e0 con 0x7f8e540cc090 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.848+0000 7f8e497fa700 1 -- 172.21.15.134:0/84160067 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8e4401c6c0 con 0x7f8e540cc090 2023-10-06T03:15:35.853 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.848+0000 7f8e497fa700 1 -- 172.21.15.134:0/84160067 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f8e44005e00 con 0x7f8e540cc090 2023-10-06T03:15:35.854 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.848+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e541557c0 con 0x7f8e540cc090 2023-10-06T03:15:35.854 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:35.850+0000 7f02730e6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:15:35.854 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.850+0000 7f8e497fa700 1 -- 172.21.15.134:0/84160067 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8e44017070 con 0x7f8e540cc090 2023-10-06T03:15:35.934 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.932+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a231fc25-6055-4b4b-945e-c4a0e32de914", "id": 7} v 0) v1 -- 0x7f8e54064050 con 0x7f8e540cc090 2023-10-06T03:15:35.941 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.940+0000 7f8e497fa700 1 -- 172.21.15.134:0/84160067 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a231fc25-6055-4b4b-945e-c4a0e32de914", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e54069870 con 0x7f8e540cc090 2023-10-06T03:15:35.942 INFO:teuthology.orchestra.run.smithi134.stdout:7 2023-10-06T03:15:35.942 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e540cc090 msgr2=0x7f8e54069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:35.943 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 --2- 172.21.15.134:0/84160067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e540cc090 0x7f8e54069d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c840 tx=0x7f8e44007c50 comp rx=0 tx=0).stop 2023-10-06T03:15:35.943 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 shutdown_connections 2023-10-06T03:15:35.943 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 --2- 172.21.15.134:0/84160067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e541553f0 0x7f8e540a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.943 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 --2- 172.21.15.134:0/84160067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e54068ed0 0x7f8e541575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.943 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 --2- 172.21.15.134:0/84160067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e540cc090 0x7f8e54069d20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:35.943 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 >> 172.21.15.134:0/84160067 conn(0x7f8e5406e910 msgr2=0x7f8e540ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:35.943 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 shutdown_connections 2023-10-06T03:15:35.943 INFO:teuthology.orchestra.run.smithi134.stderr:2023-10-06T03:15:35.941+0000 7f8e5b716700 1 -- 172.21.15.134:0/84160067 wait complete. 2023-10-06T03:15:35.946 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:35.945+0000 7f02730e6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:15:35.954 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T03:15:35.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T03:15:35.957 INFO:tasks.ceph.osd.0:Started 2023-10-06T03:15:35.957 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T03:15:35.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T03:15:35.959 INFO:tasks.ceph.osd.1:Started 2023-10-06T03:15:35.959 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T03:15:35.959 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T03:15:35.961 INFO:tasks.ceph.osd.2:Started 2023-10-06T03:15:35.961 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T03:15:35.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T03:15:35.963 INFO:tasks.ceph.osd.3:Started 2023-10-06T03:15:35.964 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T03:15:35.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T03:15:35.966 INFO:tasks.ceph.osd.4:Started 2023-10-06T03:15:35.966 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T03:15:35.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T03:15:35.968 INFO:tasks.ceph.osd.5:Started 2023-10-06T03:15:35.968 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T03:15:35.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T03:15:35.970 INFO:tasks.ceph.osd.6:Started 2023-10-06T03:15:35.971 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T03:15:35.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T03:15:35.974 INFO:tasks.ceph.osd.7:Started 2023-10-06T03:15:35.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:36.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.118+0000 7f029f9f8700 1 Processor -- start 2023-10-06T03:15:36.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.118+0000 7f029f9f8700 1 -- start start 2023-10-06T03:15:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029f9f8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0298157570 0x7f02980b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029f9f8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f02980add70 0x7f02980ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029f9f8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02981580d0 con 0x7f029815b210 2023-10-06T03:15:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029f9f8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0298158c70 con 0x7f0298157570 2023-10-06T03:15:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029f9f8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02980ae6d0 con 0x7f02980add70 2023-10-06T03:15:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029d794700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0298157570 0x7f02980b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029d794700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0298157570 0x7f02980b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38234/0 (socket says 172.21.15.82:38234) 2023-10-06T03:15:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029d794700 1 -- 172.21.15.82:0/2997962652 learned_addr learned my addr 172.21.15.82:0/2997962652 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029df95700 1 --2- 172.21.15.82:0/2997962652 >> v2:172.21.15.134:3300/0 conn(0x7f02980add70 0x7f02980ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029d794700 1 -- 172.21.15.82:0/2997962652 >> v2:172.21.15.134:3300/0 conn(0x7f02980add70 msgr2=0x7f02980ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029d794700 1 --2- 172.21.15.82:0/2997962652 >> v2:172.21.15.134:3300/0 conn(0x7f02980add70 0x7f02980ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029d794700 1 -- 172.21.15.82:0/2997962652 >> v1:172.21.15.134:6789/0 conn(0x7f029815b210 legacy=0x7f0298158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029d794700 1 -- 172.21.15.82:0/2997962652 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029815ba40 con 0x7f0298157570 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f029d794700 1 --2- 172.21.15.82:0/2997962652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980b4060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f02980c1ed0 tx=0x7f0294009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10f521ae5750426 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f028ffff700 1 -- 172.21.15.82:0/2997962652 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400b860 con 0x7f0298157570 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f028ffff700 1 -- 172.21.15.82:0/2997962652 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400b9c0 con 0x7f0298157570 2023-10-06T03:15:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.119+0000 7f028ffff700 1 -- 172.21.15.82:0/2997962652 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400bd60 con 0x7f0298157570 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.120+0000 7f029f9f8700 1 -- 172.21.15.82:0/2997962652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 msgr2=0x7f02980b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.120+0000 7f029f9f8700 1 --2- 172.21.15.82:0/2997962652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980b4060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f02980c1ed0 tx=0x7f0294009250 comp rx=0 tx=0).stop 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.120+0000 7f029f9f8700 1 -- 172.21.15.82:0/2997962652 shutdown_connections 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.120+0000 7f029f9f8700 1 --2- 172.21.15.82:0/2997962652 >> v2:172.21.15.134:3300/0 conn(0x7f02980add70 0x7f02980ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.120+0000 7f029f9f8700 1 --2- 172.21.15.82:0/2997962652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980b4060 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.120+0000 7f029f9f8700 1 -- 172.21.15.82:0/2997962652 >> 172.21.15.82:0/2997962652 conn(0x7f0298067630 msgr2=0x7f0298067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.120+0000 7f029f9f8700 1 -- 172.21.15.82:0/2997962652 shutdown_connections 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.120+0000 7f029f9f8700 1 -- 172.21.15.82:0/2997962652 wait complete. 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.121+0000 7f029f9f8700 1 Processor -- start 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.121+0000 7f029f9f8700 1 -- start start 2023-10-06T03:15:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029f9f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980add70 0x7f02980cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029f9f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029f9f8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f029815b210 0x7f0298167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029f9f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0298159e30 con 0x7f0298157570 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029f9f8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02980cb180 con 0x7f02980add70 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029f9f8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0298159220 con 0x7f029815b210 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029cf93700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029cf93700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38236/0 (socket says 172.21.15.82:38236) 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029cf93700 1 -- 172.21.15.82:0/604468834 learned_addr learned my addr 172.21.15.82:0/604468834 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029d794700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980add70 0x7f02980cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029df95700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f029815b210 0x7f0298167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029cf93700 1 -- 172.21.15.82:0/604468834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f029815b210 msgr2=0x7f0298167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029cf93700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f029815b210 0x7f0298167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029cf93700 1 -- 172.21.15.82:0/604468834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980add70 msgr2=0x7f02980cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.122+0000 7f029cf93700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980add70 0x7f02980cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f029cf93700 1 -- 172.21.15.82:0/604468834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02940094f0 con 0x7f0298157570 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f029cf93700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980c28e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f028800c4e0 tx=0x7f028800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f028d7fa700 1 -- 172.21.15.82:0/604468834 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288011590 con 0x7f0298157570 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f028d7fa700 1 -- 172.21.15.82:0/604468834 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0288011710 con 0x7f0298157570 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0298159500 con 0x7f0298157570 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f028d7fa700 1 -- 172.21.15.82:0/604468834 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288011ad0 con 0x7f0298157570 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0298159ac0 con 0x7f0298157570 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f028d7fa700 1 -- 172.21.15.82:0/604468834 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f028801c6c0 con 0x7f0298157570 2023-10-06T03:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.123+0000 7f028d7fa700 1 -- 172.21.15.82:0/604468834 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f0288012b00 con 0x7f0298157570 2023-10-06T03:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.124+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0298159fa0 con 0x7f0298157570 2023-10-06T03:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.126+0000 7f028d7fa700 1 -- 172.21.15.82:0/604468834 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0288017070 con 0x7f0298157570 2023-10-06T03:15:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.193+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0298064050 con 0x7f0298157570 2023-10-06T03:15:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.193+0000 7f028d7fa700 1 -- 172.21.15.82:0/604468834 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f028801cba0 con 0x7f0298157570 2023-10-06T03:15:36.196 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:36.196 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:35.934727+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 msgr2=0x7f02980c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980c28e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f028800c4e0 tx=0x7f028800c7f0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 shutdown_connections 2023-10-06T03:15:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f029815b210 0x7f0298167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980add70 0x7f02980cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 --2- 172.21.15.82:0/604468834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0298157570 0x7f02980c28e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 >> 172.21.15.82:0/604468834 conn(0x7f0298067630 msgr2=0x7f029806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 shutdown_connections 2023-10-06T03:15:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:36.194+0000 7f029f9f8700 1 -- 172.21.15.82:0/604468834 wait complete. 2023-10-06T03:15:36.208 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T03:15:36.208 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T03:15:36.239 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:36.237+0000 7ff52b0c8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:15:36.316 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:36.314+0000 7ff52b0c8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:15:36.394 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:36.393+0000 7ff52b0c8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:15:36.503 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:36.501+0000 7f02730e6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:15:36.561 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-10-06T03:15:36.559+0000 7f754ae3f540 -1 Falling back to public interface 2023-10-06T03:15:36.564 INFO:tasks.ceph.osd.4.smithi134.stderr:2023-10-06T03:15:36.563+0000 7fdb3fdf8540 -1 Falling back to public interface 2023-10-06T03:15:36.568 INFO:tasks.ceph.osd.6.smithi134.stderr:2023-10-06T03:15:36.566+0000 7fbfa84b1540 -1 Falling back to public interface 2023-10-06T03:15:36.574 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-10-06T03:15:36.572+0000 7f9dfbc0a540 -1 Falling back to public interface 2023-10-06T03:15:36.575 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-10-06T03:15:36.573+0000 7f62120b6540 -1 Falling back to public interface 2023-10-06T03:15:36.579 INFO:tasks.ceph.osd.5.smithi134.stderr:2023-10-06T03:15:36.578+0000 7f6290e19540 -1 Falling back to public interface 2023-10-06T03:15:36.581 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:36.580+0000 7f02730e6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:15:36.584 INFO:tasks.ceph.osd.7.smithi134.stderr:2023-10-06T03:15:36.582+0000 7f24b3a63540 -1 Falling back to public interface 2023-10-06T03:15:36.588 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-10-06T03:15:36.586+0000 7fe8871fc540 -1 Falling back to public interface 2023-10-06T03:15:36.660 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:36.659+0000 7f02730e6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:15:36.974 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:36.972+0000 7ff52b0c8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T03:15:37.012 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:37.111 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:37.109+0000 7ff52b0c8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:15:37.143 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.141+0000 7fc98638a700 1 Processor -- start 2023-10-06T03:15:37.143 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.141+0000 7fc98638a700 1 -- start start 2023-10-06T03:15:37.146 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc98638a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9801565e0 0x7fc9800c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc98638a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98015ae50 con 0x7fc98006a4d0 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc98638a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98015b080 con 0x7fc98015a9f0 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc98638a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800c8470 con 0x7fc9801565e0 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc98006a4d0 0x7fc98015a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55260/0 (socket says 172.21.15.82:55260) 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97f7fe700 1 -- 172.21.15.82:0/1407350528 learned_addr learned my addr 172.21.15.82:0/1407350528 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97ffff700 1 --2- 172.21.15.82:0/1407350528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9801565e0 0x7fc9800c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97effd700 1 -- 172.21.15.82:0/1407350528 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143976204 0 0) 0x7fc98015ae50 con 0x7fc98006a4d0 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97effd700 1 -- 172.21.15.82:0/1407350528 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc968003570 con 0x7fc98006a4d0 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97effd700 1 -- 172.21.15.82:0/1407350528 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488497845 0 0) 0x7fc98015b080 con 0x7fc98015a9f0 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97effd700 1 -- 172.21.15.82:0/1407350528 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc98015ae50 con 0x7fc98015a9f0 2023-10-06T03:15:37.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97ffff700 1 -- 172.21.15.82:0/1407350528 >> v1:172.21.15.134:6789/0 conn(0x7fc98015a9f0 legacy=0x7fc98006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97ffff700 1 -- 172.21.15.82:0/1407350528 >> v1:172.21.15.82:6789/0 conn(0x7fc98006a4d0 legacy=0x7fc98015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97ffff700 1 -- 172.21.15.82:0/1407350528 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9800c8750 con 0x7fc9801565e0 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.143+0000 7fc97ffff700 1 --2- 172.21.15.82:0/1407350528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9801565e0 0x7fc9800c8f50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc974009910 tx=0x7fc9740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b593e0242873fdd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc97effd700 1 -- 172.21.15.82:0/1407350528 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974011630 con 0x7fc9801565e0 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc97effd700 1 -- 172.21.15.82:0/1407350528 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc974011790 con 0x7fc9801565e0 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc97effd700 1 -- 172.21.15.82:0/1407350528 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974011b30 con 0x7fc9801565e0 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc98638a700 1 -- 172.21.15.82:0/1407350528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9801565e0 msgr2=0x7fc9800c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc98638a700 1 --2- 172.21.15.82:0/1407350528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9801565e0 0x7fc9800c8f50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc974009910 tx=0x7fc9740091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc98638a700 1 -- 172.21.15.82:0/1407350528 shutdown_connections 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc98638a700 1 --2- 172.21.15.82:0/1407350528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9801565e0 0x7fc9800c8f50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc98638a700 1 -- 172.21.15.82:0/1407350528 >> 172.21.15.82:0/1407350528 conn(0x7fc9800c95b0 msgr2=0x7fc9800c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:37.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc98638a700 1 -- 172.21.15.82:0/1407350528 shutdown_connections 2023-10-06T03:15:37.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.144+0000 7fc98638a700 1 -- 172.21.15.82:0/1407350528 wait complete. 2023-10-06T03:15:37.151 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.145+0000 7fc98638a700 1 Processor -- start 2023-10-06T03:15:37.151 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc98638a700 1 -- start start 2023-10-06T03:15:37.151 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc98638a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98006a4d0 0x7fc980157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:37.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc98638a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9801565e0 0x7fc980153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:37.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc98638a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98015a9f0 0x7fc9800b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:37.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc98638a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800afcb0 con 0x7fc98015a9f0 2023-10-06T03:15:37.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc98638a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800af960 con 0x7fc9801565e0 2023-10-06T03:15:37.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc98638a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800b2050 con 0x7fc98006a4d0 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc984927700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98015a9f0 0x7fc9800b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc984927700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98015a9f0 0x7fc9800b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38242/0 (socket says 172.21.15.82:38242) 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc984927700 1 -- 172.21.15.82:0/1452803359 learned_addr learned my addr 172.21.15.82:0/1452803359 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc97ffff700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98006a4d0 0x7fc980157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.146+0000 7fc97f7fe700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9801565e0 0x7fc980153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc984927700 1 -- 172.21.15.82:0/1452803359 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98006a4d0 msgr2=0x7fc980157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc984927700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98006a4d0 0x7fc980157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc984927700 1 -- 172.21.15.82:0/1452803359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9801565e0 msgr2=0x7fc980153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc984927700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9801565e0 0x7fc980153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc984927700 1 -- 172.21.15.82:0/1452803359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974009420 con 0x7fc98015a9f0 2023-10-06T03:15:37.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc984927700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98015a9f0 0x7fc9800b1720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c860 tx=0x7fc978002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc967fff700 1 -- 172.21.15.82:0/1452803359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978002030 con 0x7fc98015a9f0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc967fff700 1 -- 172.21.15.82:0/1452803359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9780021b0 con 0x7fc98015a9f0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9800b2330 con 0x7fc98015a9f0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc967fff700 1 -- 172.21.15.82:0/1452803359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978012630 con 0x7fc98015a9f0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc980158210 con 0x7fc98015a9f0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc967fff700 1 -- 172.21.15.82:0/1452803359 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc978012a20 con 0x7fc98015a9f0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.147+0000 7fc967fff700 1 -- 172.21.15.82:0/1452803359 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fc97801bae0 con 0x7fc98015a9f0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.148+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9800afe20 con 0x7fc98015a9f0 2023-10-06T03:15:37.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.150+0000 7fc967fff700 1 -- 172.21.15.82:0/1452803359 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc9780014d0 con 0x7fc98015a9f0 2023-10-06T03:15:37.209 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:37.207+0000 7ff52b0c8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:15:37.219 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.217+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9800b2990 con 0x7fc98015a9f0 2023-10-06T03:15:37.219 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.218+0000 7fc967fff700 1 -- 172.21.15.82:0/1452803359 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fc9780019a0 con 0x7fc98015a9f0 2023-10-06T03:15:37.219 INFO:teuthology.misc.health.smithi082.stdout: 2023-10-06T03:15:37.220 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":10,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:35.934727+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:37.220 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98015a9f0 msgr2=0x7fc9800b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:37.220 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98015a9f0 0x7fc9800b1720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c860 tx=0x7fc978002700 comp rx=0 tx=0).stop 2023-10-06T03:15:37.221 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 shutdown_connections 2023-10-06T03:15:37.221 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98015a9f0 0x7fc9800b1720 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:37.221 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98006a4d0 0x7fc980157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:37.221 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 --2- 172.21.15.82:0/1452803359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9801565e0 0x7fc980153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:37.221 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 >> 172.21.15.82:0/1452803359 conn(0x7fc9800c95b0 msgr2=0x7fc980155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:37.221 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 shutdown_connections 2023-10-06T03:15:37.221 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:37.219+0000 7fc98638a700 1 -- 172.21.15.82:0/1452803359 wait complete. 2023-10-06T03:15:37.231 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:15:37.239 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:37.238+0000 7f02730e6180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T03:15:37.377 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:37.375+0000 7f02730e6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:15:37.458 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:37.457+0000 7ff52b0c8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T03:15:37.469 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:37.467+0000 7f02730e6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:15:37.535 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:37.533+0000 7ff52b0c8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:15:37.715 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:37.714+0000 7f02730e6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T03:15:37.791 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:37.790+0000 7f02730e6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:15:38.372 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:38.370+0000 7ff52b0c8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T03:15:38.445 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:38.443+0000 7ff52b0c8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:15:38.520 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:38.519+0000 7ff52b0c8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:15:38.604 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:38.602+0000 7f02730e6180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T03:15:38.650 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:38.649+0000 7ff52b0c8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:15:38.677 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:38.675+0000 7f02730e6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:15:38.734 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:38.733+0000 7ff52b0c8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:15:38.750 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:38.749+0000 7f02730e6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:15:38.887 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:38.885+0000 7f02730e6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:15:38.888 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:38.886+0000 7ff52b0c8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:15:38.963 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:38.961+0000 7ff52b0c8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:15:38.970 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:38.969+0000 7f02730e6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:15:39.041 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:39.039+0000 7ff52b0c8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:15:39.126 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:39.125+0000 7ff52b0c8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:15:39.146 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:39.144+0000 7f02730e6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:15:39.227 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:39.226+0000 7f02730e6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:15:39.303 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:39.302+0000 7f02730e6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:15:39.400 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-10-06T03:15:39.398+0000 7f02730e6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:15:39.792 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-10-06T03:15:39.790+0000 7f754ae3f540 -1 osd.3 0 log_to_monitors true 2023-10-06T03:15:39.831 INFO:tasks.ceph.osd.5.smithi134.stderr:2023-10-06T03:15:39.829+0000 7f6290e19540 -1 osd.5 0 log_to_monitors true 2023-10-06T03:15:39.850 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-10-06T03:15:39.849+0000 7f62120b6540 -1 osd.0 0 log_to_monitors true 2023-10-06T03:15:40.042 INFO:tasks.ceph.osd.6.smithi134.stderr:2023-10-06T03:15:40.041+0000 7fbfa84b1540 -1 osd.6 0 log_to_monitors true 2023-10-06T03:15:40.077 INFO:tasks.ceph.osd.4.smithi134.stderr:2023-10-06T03:15:40.076+0000 7fdb3fdf8540 -1 osd.4 0 log_to_monitors true 2023-10-06T03:15:40.095 INFO:tasks.ceph.osd.7.smithi134.stderr:2023-10-06T03:15:40.094+0000 7f24b3a63540 -1 osd.7 0 log_to_monitors true 2023-10-06T03:15:40.097 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-10-06T03:15:40.096+0000 7fe8871fc540 -1 osd.2 0 log_to_monitors true 2023-10-06T03:15:40.106 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-10-06T03:15:40.105+0000 7f9dfbc0a540 -1 osd.1 0 log_to_monitors true 2023-10-06T03:15:40.152 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:40.150+0000 7ff4e44cc700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T03:15:40.152 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-10-06T03:15:40.150+0000 7ff4e44cc700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T03:15:43.299 INFO:tasks.ceph.osd.5.smithi134.stderr:2023-10-06T03:15:43.297+0000 7f6287a3b700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T03:15:43.304 INFO:tasks.ceph.osd.5.smithi134.stderr:2023-10-06T03:15:43.302+0000 7f6280832700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:15:43.333 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-10-06T03:15:43.331+0000 7f6208cd8700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T03:15:43.338 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-10-06T03:15:43.336+0000 7f6201acf700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:15:43.370 INFO:tasks.ceph.osd.4.smithi134.stderr:2023-10-06T03:15:43.368+0000 7fdb3821d700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T03:15:43.373 INFO:tasks.ceph.osd.6.smithi134.stderr:2023-10-06T03:15:43.371+0000 7fbf9f0d3700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T03:15:43.376 INFO:tasks.ceph.osd.4.smithi134.stderr:2023-10-06T03:15:43.374+0000 7fdb2f811700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:15:43.379 INFO:tasks.ceph.osd.6.smithi134.stderr:2023-10-06T03:15:43.378+0000 7fbf97eca700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:15:43.383 INFO:tasks.ceph.osd.7.smithi134.stderr:2023-10-06T03:15:43.382+0000 7f24aa685700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T03:15:43.387 INFO:tasks.ceph.osd.7.smithi134.stderr:2023-10-06T03:15:43.385+0000 7f24a347c700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:15:43.411 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-10-06T03:15:43.409+0000 7fe87de1e700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T03:15:43.412 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-10-06T03:15:43.410+0000 7f9df282c700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T03:15:43.415 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-10-06T03:15:43.414+0000 7fe876c15700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:15:43.416 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-10-06T03:15:43.415+0000 7f7543264700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T03:15:43.420 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-10-06T03:15:43.418+0000 7f9deb623700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:15:43.420 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-10-06T03:15:43.419+0000 7f753a858700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:15:44.038 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:44.143 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.141+0000 7f6167495700 1 Processor -- start 2023-10-06T03:15:44.143 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.142+0000 7f6167495700 1 -- start start 2023-10-06T03:15:44.146 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.142+0000 7f6167495700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6160159b60 0x7f61601645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.146 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.142+0000 7f6167495700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600cfeb0 con 0x7f61600caeb0 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.142+0000 7f6167495700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600cf2a0 con 0x7f61600cb280 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.142+0000 7f6167495700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61600cf580 con 0x7f6160159b60 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.142+0000 7f6165231700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f61600caeb0 0x7f61600d0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45718/0 (socket says 172.21.15.82:45718) 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.142+0000 7f6165231700 1 -- 172.21.15.82:0/3802355822 learned_addr learned my addr 172.21.15.82:0/3802355822 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449714933 0 0) 0x7f61600cfeb0 con 0x7f61600caeb0 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6165a32700 1 --2- 172.21.15.82:0/3802355822 >> v2:172.21.15.134:3300/0 conn(0x7f6160159b60 0x7f61601645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614c003570 con 0x7f61600caeb0 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2506091425 0 0) 0x7f614c003570 con 0x7f61600caeb0 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 >> v2:172.21.15.134:3300/0 conn(0x7f6160159b60 msgr2=0x7f61601645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 --2- 172.21.15.82:0/3802355822 >> v2:172.21.15.134:3300/0 conn(0x7f6160159b60 0x7f61601645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.147 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 >> v1:172.21.15.134:6789/0 conn(0x7f61600cb280 legacy=0x7f6160159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600cf860 con 0x7f61600caeb0 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f615c001470 con 0x7f61600caeb0 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 >> v1:172.21.15.82:6789/0 conn(0x7f61600caeb0 legacy=0x7f61600d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f614c003a60 0x7f614c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c004810 0x7f614c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c0051c0 0x7f614c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600cf580 con 0x7f614c004810 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c00c160 con 0x7f614c003a60 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c00c320 con 0x7f614c0051c0 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6164a30700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c004810 0x7f614c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.148 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6165231700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f614c003a60 0x7f614c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6165a32700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c0051c0 0x7f614c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6164a30700 1 -- 172.21.15.82:0/3802355822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c0051c0 msgr2=0x7f614c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6164a30700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c0051c0 0x7f614c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6164a30700 1 -- 172.21.15.82:0/3802355822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f614c003a60 msgr2=0x7f614c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6164a30700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f614c003a60 0x7f614c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6165a32700 1 -- 172.21.15.82:0/3802355822 reap_dead start 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.143+0000 7f6164a30700 1 -- 172.21.15.82:0/3802355822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c003570 con 0x7f614c004810 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6164a30700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c004810 0x7f614c004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f61500018b0 tx=0x7f6150007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac866f6b29e2b416 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150012420 con 0x7f614c004810 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61500125a0 con 0x7f614c004810 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6157fff700 1 -- 172.21.15.82:0/3802355822 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150012960 con 0x7f614c004810 2023-10-06T03:15:44.149 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6167495700 1 -- 172.21.15.82:0/3802355822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c004810 msgr2=0x7f614c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.150 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6167495700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c004810 0x7f614c004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f61500018b0 tx=0x7f6150007d30 comp rx=0 tx=0).stop 2023-10-06T03:15:44.150 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6167495700 1 -- 172.21.15.82:0/3802355822 shutdown_connections 2023-10-06T03:15:44.150 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6167495700 1 --2- 172.21.15.82:0/3802355822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c004810 0x7f614c004c80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.150 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6167495700 1 -- 172.21.15.82:0/3802355822 >> 172.21.15.82:0/3802355822 conn(0x7f616006ce10 msgr2=0x7f61600d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:44.150 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6167495700 1 -- 172.21.15.82:0/3802355822 shutdown_connections 2023-10-06T03:15:44.150 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.144+0000 7f6167495700 1 -- 172.21.15.82:0/3802355822 wait complete. 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.145+0000 7f6167495700 1 Processor -- start 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.145+0000 7f6167495700 1 -- start start 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6167495700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c004810 0x7f6160150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6167495700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6160150e80 0x7f61600c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6167495700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61600c8d50 0x7f61600c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6167495700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616014f990 con 0x7f61600c8d50 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6167495700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6160153090 con 0x7f6160150e80 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6167495700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6160153650 con 0x7f614c004810 2023-10-06T03:15:44.153 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6165a32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61600c8d50 0x7f61600c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6165a32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61600c8d50 0x7f61600c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43300/0 (socket says 172.21.15.82:43300) 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.146+0000 7f6165a32700 1 -- 172.21.15.82:0/1536856230 learned_addr learned my addr 172.21.15.82:0/1536856230 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6165231700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c004810 0x7f6160150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6164a30700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6160150e80 0x7f61600c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6165a32700 1 -- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c004810 msgr2=0x7f6160150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6165a32700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c004810 0x7f6160150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6165a32700 1 -- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6160150e80 msgr2=0x7f61600c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6165a32700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6160150e80 0x7f61600c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6165a32700 1 -- 172.21.15.82:0/1536856230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600caa50 con 0x7f61600c8d50 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6164a30700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6160150e80 0x7f61600c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:44.154 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6165a32700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61600c8d50 0x7f61600c91c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6158009d70 tx=0x7f615800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f61557fa700 1 -- 172.21.15.82:0/1536856230 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800e040 con 0x7f61600c8d50 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f61557fa700 1 -- 172.21.15.82:0/1536856230 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800f040 con 0x7f61600c8d50 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61601512f0 con 0x7f61600c8d50 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f61557fa700 1 -- 172.21.15.82:0/1536856230 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800fdf0 con 0x7f61600c8d50 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.147+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6160151570 con 0x7f61600c8d50 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.148+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6160153790 con 0x7f61600c8d50 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.148+0000 7f61557fa700 1 -- 172.21.15.82:0/1536856230 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f6158015640 con 0x7f61600c8d50 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.149+0000 7f61557fa700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6144066ea0 0x7f6144069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.149+0000 7f61557fa700 1 -- 172.21.15.82:0/1536856230 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f6158083f40 con 0x7f61600c8d50 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.149+0000 7f6165231700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6144066ea0 0x7f6144069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.155 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.149+0000 7f6165231700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6144066ea0 0x7f6144069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f615c001ce0 tx=0x7f615c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:44.156 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.153+0000 7f61557fa700 1 -- 172.21.15.82:0/1536856230 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6158052020 con 0x7f61600c8d50 2023-10-06T03:15:44.345 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.343+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6160064120 con 0x7f61600c8d50 2023-10-06T03:15:44.345 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.344+0000 7f61557fa700 1 -- 172.21.15.82:0/1536856230 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7f6158055640 con 0x7f61600c8d50 2023-10-06T03:15:44.346 INFO:teuthology.misc.health.smithi082.stdout: 2023-10-06T03:15:44.346 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":13,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:44.311119+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6144066ea0 msgr2=0x7f6144069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6144066ea0 0x7f6144069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f615c001ce0 tx=0x7f615c009040 comp rx=0 tx=0).stop 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61600c8d50 msgr2=0x7f61600c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61600c8d50 0x7f61600c91c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6158009d70 tx=0x7f615800b040 comp rx=0 tx=0).stop 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 shutdown_connections 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61600c8d50 0x7f61600c91c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6144066ea0 0x7f6144069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614c004810 0x7f6160150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 --2- 172.21.15.82:0/1536856230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6160150e80 0x7f61600c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.348 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 >> 172.21.15.82:0/1536856230 conn(0x7f616006ce10 msgr2=0x7f6160157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:44.349 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 shutdown_connections 2023-10-06T03:15:44.349 INFO:teuthology.misc.health.smithi082.stderr:2023-10-06T03:15:44.346+0000 7f6167495700 1 -- 172.21.15.82:0/1536856230 wait complete. 2023-10-06T03:15:44.358 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T03:15:44.358 INFO:tasks.ceph:Creating RBD pool 2023-10-06T03:15:44.359 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T03:15:44.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.472+0000 7f8a21f9e700 1 Processor -- start 2023-10-06T03:15:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.472+0000 7f8a21f9e700 1 -- start start 2023-10-06T03:15:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.472+0000 7f8a21f9e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c1598d0 0x7f8a1c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.472+0000 7f8a21f9e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a1c15d8e0 0x7f8a1c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.472+0000 7f8a21f9e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1c15dd20 con 0x7f8a1c159500 2023-10-06T03:15:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a21f9e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c0b1110 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a21f9e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0b13b0 con 0x7f8a1c1598d0 2023-10-06T03:15:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a1c15d8e0 0x7f8a1c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8a1c159500 0x7f8a1c0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45730/0 (socket says 172.21.15.82:45730) 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1b7fe700 1 -- 172.21.15.82:0/3912381447 learned_addr learned my addr 172.21.15.82:0/3912381447 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a1c15d8e0 0x7f8a1c0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43304/0 (socket says 172.21.15.82:43304) 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1affd700 1 --2- 172.21.15.82:0/3912381447 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c1598d0 0x7f8a1c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1bfff700 1 -- 172.21.15.82:0/3912381447 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c1598d0 msgr2=0x7f8a1c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1bfff700 1 --2- 172.21.15.82:0/3912381447 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c1598d0 0x7f8a1c15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1bfff700 1 -- 172.21.15.82:0/3912381447 >> v1:172.21.15.82:6789/0 conn(0x7f8a1c159500 legacy=0x7f8a1c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1bfff700 1 -- 172.21.15.82:0/3912381447 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0b1690 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1a7fc700 1 -- 172.21.15.82:0/3912381447 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285295563 0 0) 0x7f8a1c15dd20 con 0x7f8a1c159500 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1bfff700 1 --2- 172.21.15.82:0/3912381447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0cf6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009e60 tx=0x7f8a14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab5645ccace6d2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1a7fc700 1 -- 172.21.15.82:0/3912381447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400e070 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1a7fc700 1 -- 172.21.15.82:0/3912381447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1400bc30 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.473+0000 7f8a1a7fc700 1 -- 172.21.15.82:0/3912381447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14012430 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.474+0000 7f8a21f9e700 1 -- 172.21.15.82:0/3912381447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 msgr2=0x7f8a1c0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.474+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/3912381447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0cf6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009e60 tx=0x7f8a14009780 comp rx=0 tx=0).stop 2023-10-06T03:15:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.474+0000 7f8a21f9e700 1 -- 172.21.15.82:0/3912381447 shutdown_connections 2023-10-06T03:15:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.474+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/3912381447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0cf6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.474+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/3912381447 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c1598d0 0x7f8a1c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.474+0000 7f8a21f9e700 1 -- 172.21.15.82:0/3912381447 >> 172.21.15.82:0/3912381447 conn(0x7f8a1c067630 msgr2=0x7f8a1c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.474+0000 7f8a21f9e700 1 -- 172.21.15.82:0/3912381447 shutdown_connections 2023-10-06T03:15:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.474+0000 7f8a21f9e700 1 -- 172.21.15.82:0/3912381447 wait complete. 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.475+0000 7f8a21f9e700 1 Processor -- start 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.475+0000 7f8a21f9e700 1 -- start start 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a21f9e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c159500 0x7f8a1c14c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a21f9e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a1c1598d0 0x7f8a1c150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a21f9e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a21f9e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c151160 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a21f9e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c14d710 con 0x7f8a1c1598d0 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a21f9e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c1508c0 con 0x7f8a1c159500 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43308/0 (socket says 172.21.15.82:43308) 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 -- 172.21.15.82:0/2058743727 learned_addr learned my addr 172.21.15.82:0/2058743727 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1b7fe700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c159500 0x7f8a1c14c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1affd700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a1c1598d0 0x7f8a1c150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 -- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c159500 msgr2=0x7f8a1c14c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c159500 0x7f8a1c14c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 -- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a1c1598d0 msgr2=0x7f8a1c150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a1c1598d0 0x7f8a1c150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 -- 172.21.15.82:0/2058743727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009a20 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1affd700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a1c1598d0 0x7f8a1c150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a1bfff700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0b4fa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c15deb0 tx=0x7f8a14019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a037fe700 1 -- 172.21.15.82:0/2058743727 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14012e70 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a037fe700 1 -- 172.21.15.82:0/2058743727 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1401d630 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c150ba0 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a037fe700 1 -- 172.21.15.82:0/2058743727 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1401da10 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.476+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c14d9b0 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.477+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1c14dbd0 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.478+0000 7f8a037fe700 1 -- 172.21.15.82:0/2058743727 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f8a14024070 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.478+0000 7f8a037fe700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8a08066ea0 0x7f8a08069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.478+0000 7f8a037fe700 1 -- 172.21.15.82:0/2058743727 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f8a14086880 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.478+0000 7f8a1b7fe700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8a08066ea0 0x7f8a08069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.479+0000 7f8a1b7fe700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8a08066ea0 0x7f8a08069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c154150 tx=0x7f8a10007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.482+0000 7f8a037fe700 1 -- 172.21.15.82:0/2058743727 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a140540a0 con 0x7f8a1c15d8e0 2023-10-06T03:15:44.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:44.664+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f8a1c064050 con 0x7f8a1c15d8e0 2023-10-06T03:15:45.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.347+0000 7f8a037fe700 1 -- 172.21.15.82:0/2058743727 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f8a140576c0 con 0x7f8a1c15d8e0 2023-10-06T03:15:45.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8a08066ea0 msgr2=0x7f8a08069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:45.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8a08066ea0 0x7f8a08069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c154150 tx=0x7f8a10007d30 comp rx=0 tx=0).stop 2023-10-06T03:15:45.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 msgr2=0x7f8a1c0b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:45.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0b4fa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c15deb0 tx=0x7f8a14019000 comp rx=0 tx=0).stop 2023-10-06T03:15:45.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 shutdown_connections 2023-10-06T03:15:45.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a1c15d8e0 0x7f8a1c0b4fa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8a08066ea0 0x7f8a08069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a1c159500 0x7f8a1c14c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 --2- 172.21.15.82:0/2058743727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a1c1598d0 0x7f8a1c150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 >> 172.21.15.82:0/2058743727 conn(0x7f8a1c067630 msgr2=0x7f8a1c1587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:45.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 shutdown_connections 2023-10-06T03:15:45.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.350+0000 7f8a21f9e700 1 -- 172.21.15.82:0/2058743727 wait complete. 2023-10-06T03:15:45.353 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'rbd' created 2023-10-06T03:15:45.365 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T03:15:45.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.481+0000 7f4a523ee700 1 Processor -- start 2023-10-06T03:15:45.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.481+0000 7f4a523ee700 1 -- start start 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a523ee700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a4c0b55b0 0x7f4a4c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a523ee700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4a4c0cf800 0x7f4a4c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a523ee700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c0cbed0 con 0x7f4a4c0d0f00 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a523ee700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c159d40 con 0x7f4a4c0b55b0 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a523ee700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c0cc750 con 0x7f4a4c0cf800 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a4bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a4c0b55b0 0x7f4a4c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a5098b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4a4c0d0f00 0x7f4a4c0ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45734/0 (socket says 172.21.15.82:45734) 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a5098b700 1 -- 172.21.15.82:0/473807154 learned_addr learned my addr 172.21.15.82:0/473807154 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.482+0000 7f4a4bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a4c0b55b0 0x7f4a4c0ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43324/0 (socket says 172.21.15.82:43324) 2023-10-06T03:15:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4b7fe700 1 --2- 172.21.15.82:0/473807154 >> v2:172.21.15.134:3300/0 conn(0x7f4a4c0cf800 0x7f4a4c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4bfff700 1 -- 172.21.15.82:0/473807154 >> v2:172.21.15.134:3300/0 conn(0x7f4a4c0cf800 msgr2=0x7f4a4c0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4bfff700 1 --2- 172.21.15.82:0/473807154 >> v2:172.21.15.134:3300/0 conn(0x7f4a4c0cf800 0x7f4a4c0b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4bfff700 1 -- 172.21.15.82:0/473807154 >> v1:172.21.15.82:6789/0 conn(0x7f4a4c0d0f00 legacy=0x7f4a4c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4bfff700 1 -- 172.21.15.82:0/473807154 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0b5ec0 con 0x7f4a4c0b55b0 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4affd700 1 -- 172.21.15.82:0/473807154 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166051654 0 0) 0x7f4a4c0cbed0 con 0x7f4a4c0d0f00 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4bfff700 1 --2- 172.21.15.82:0/473807154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0b55b0 0x7f4a4c0ccbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0b66a0 tx=0x7f4a3c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abeae998e7738ec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4affd700 1 -- 172.21.15.82:0/473807154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c005c10 con 0x7f4a4c0b55b0 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4affd700 1 -- 172.21.15.82:0/473807154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c005d70 con 0x7f4a4c0b55b0 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a4affd700 1 -- 172.21.15.82:0/473807154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c006280 con 0x7f4a4c0b55b0 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a523ee700 1 -- 172.21.15.82:0/473807154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0b55b0 msgr2=0x7f4a4c0ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:45.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.483+0000 7f4a523ee700 1 --2- 172.21.15.82:0/473807154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0b55b0 0x7f4a4c0ccbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0b66a0 tx=0x7f4a3c009120 comp rx=0 tx=0).stop 2023-10-06T03:15:45.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.484+0000 7f4a523ee700 1 -- 172.21.15.82:0/473807154 shutdown_connections 2023-10-06T03:15:45.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.484+0000 7f4a523ee700 1 --2- 172.21.15.82:0/473807154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0b55b0 0x7f4a4c0ccbe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.484+0000 7f4a523ee700 1 --2- 172.21.15.82:0/473807154 >> v2:172.21.15.134:3300/0 conn(0x7f4a4c0cf800 0x7f4a4c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.484+0000 7f4a523ee700 1 -- 172.21.15.82:0/473807154 >> 172.21.15.82:0/473807154 conn(0x7f4a4c08a050 msgr2=0x7f4a4c099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:45.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.484+0000 7f4a523ee700 1 -- 172.21.15.82:0/473807154 shutdown_connections 2023-10-06T03:15:45.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.484+0000 7f4a523ee700 1 -- 172.21.15.82:0/473807154 wait complete. 2023-10-06T03:15:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.485+0000 7f4a523ee700 1 Processor -- start 2023-10-06T03:15:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.485+0000 7f4a523ee700 1 -- start start 2023-10-06T03:15:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a523ee700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a4c0b55b0 0x7f4a4c169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a523ee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0cf800 0x7f4a4c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:45.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a523ee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a4c0d0f00 0x7f4a4c0c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a523ee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c16a0e0 con 0x7f4a4c0cf800 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a523ee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c16a3c0 con 0x7f4a4c0d0f00 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a523ee700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c16a6a0 con 0x7f4a4c0b55b0 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0cf800 0x7f4a4c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0cf800 0x7f4a4c0c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43330/0 (socket says 172.21.15.82:43330) 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 -- 172.21.15.82:0/3699791765 learned_addr learned my addr 172.21.15.82:0/3699791765 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a5098b700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a4c0d0f00 0x7f4a4c0c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4bfff700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a4c0b55b0 0x7f4a4c169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:45.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 -- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a4c0b55b0 msgr2=0x7f4a4c169860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a4c0b55b0 0x7f4a4c169860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 -- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a4c0d0f00 msgr2=0x7f4a4c0c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a4c0d0f00 0x7f4a4c0c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 -- 172.21.15.82:0/3699791765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c0093c0 con 0x7f4a4c0cf800 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a5098b700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a4c0d0f00 0x7f4a4c0c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a4b7fe700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0cf800 0x7f4a4c0c62c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000c7d0 tx=0x7f4a40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a33fff700 1 -- 172.21.15.82:0/3699791765 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40011600 con 0x7f4a4c0cf800 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a33fff700 1 -- 172.21.15.82:0/3699791765 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40011760 con 0x7f4a4c0cf800 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c067630 con 0x7f4a4c0cf800 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a33fff700 1 -- 172.21.15.82:0/3699791765 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40011b20 con 0x7f4a4c0cf800 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.486+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c169da0 con 0x7f4a4c0cf800 2023-10-06T03:15:45.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.487+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c067b50 con 0x7f4a4c0cf800 2023-10-06T03:15:45.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.488+0000 7f4a33fff700 1 -- 172.21.15.82:0/3699791765 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f4a400193f0 con 0x7f4a4c0cf800 2023-10-06T03:15:45.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.488+0000 7f4a33fff700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a38066ea0 0x7f4a38069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:45.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.488+0000 7f4a33fff700 1 -- 172.21.15.82:0/3699791765 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f4a40084600 con 0x7f4a4c0cf800 2023-10-06T03:15:45.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.488+0000 7f4a4bfff700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a38066ea0 0x7f4a38069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:45.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.489+0000 7f4a4bfff700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a38066ea0 0x7f4a38069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009390 tx=0x7f4a3c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:45.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.492+0000 7f4a33fff700 1 -- 172.21.15.82:0/3699791765 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a4c067b50 con 0x7f4a4c0cf800 2023-10-06T03:15:45.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:45.677+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a4c067b50 con 0x7f4a4c0cf800 2023-10-06T03:15:46.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.350+0000 7f4a33fff700 1 -- 172.21.15.82:0/3699791765 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4a4c067b50 con 0x7f4a4c0cf800 2023-10-06T03:15:46.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a38066ea0 msgr2=0x7f4a38069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a38066ea0 0x7f4a38069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009390 tx=0x7f4a3c016000 comp rx=0 tx=0).stop 2023-10-06T03:15:46.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0cf800 msgr2=0x7f4a4c0c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0cf800 0x7f4a4c0c62c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000c7d0 tx=0x7f4a40008040 comp rx=0 tx=0).stop 2023-10-06T03:15:46.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 shutdown_connections 2023-10-06T03:15:46.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a4c0d0f00 0x7f4a4c0c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a38066ea0 0x7f4a38069350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a4c0b55b0 0x7f4a4c169860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 --2- 172.21.15.82:0/3699791765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0cf800 0x7f4a4c0c62c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 >> 172.21.15.82:0/3699791765 conn(0x7f4a4c08a050 msgr2=0x7f4a4c159160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:46.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 shutdown_connections 2023-10-06T03:15:46.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.353+0000 7f4a523ee700 1 -- 172.21.15.82:0/3699791765 wait complete. 2023-10-06T03:15:46.356 INFO:teuthology.orchestra.run.smithi082.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T03:15:46.370 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T03:15:46.371 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:15:46.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:15:46.373 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:15:46.373 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:15:46.373 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:15:46.375 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:15:46.375 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:15:46.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:15:46.377 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:15:46.377 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:15:46.377 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:15:46.379 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:15:46.380 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T03:15:46.380 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:46.457 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-10-06T03:15:46.458 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-10-06T03:15:46.465 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-10-06T03:15:46.466 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-10-06T03:15:46.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.515+0000 7f3fdc26a700 1 Processor -- start 2023-10-06T03:15:46.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.515+0000 7f3fdc26a700 1 -- start start 2023-10-06T03:15:46.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.516+0000 7f3fdc26a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd4159580 0x7f3fd40b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.516+0000 7f3fdc26a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3fd40ae860 0x7f3fd40b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.516+0000 7f3fdc26a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd40ad3c0 con 0x7f3fd4159950 2023-10-06T03:15:46.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.516+0000 7f3fdc26a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd40b0ec0 con 0x7f3fd40ae860 2023-10-06T03:15:46.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.516+0000 7f3fdc26a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40b11a0 con 0x7f3fd4159580 2023-10-06T03:15:46.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fda807700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3fd40ae860 0x7f3fd40b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fd9805700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3fd4159950 0x7f3fd40b0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45762/0 (socket says 172.21.15.82:45762) 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fd9805700 1 -- 172.21.15.82:0/760296192 learned_addr learned my addr 172.21.15.82:0/760296192 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fda006700 1 --2- 172.21.15.82:0/760296192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd4159580 0x7f3fd40b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fda807700 1 -- 172.21.15.82:0/760296192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd4159580 msgr2=0x7f3fd40b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fda807700 1 --2- 172.21.15.82:0/760296192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd4159580 0x7f3fd40b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fda807700 1 -- 172.21.15.82:0/760296192 >> v1:172.21.15.82:6789/0 conn(0x7f3fd4159950 legacy=0x7f3fd40b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fd9004700 1 -- 172.21.15.82:0/760296192 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431579881 0 0) 0x7f3fd40ad3c0 con 0x7f3fd4159950 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fda807700 1 -- 172.21.15.82:0/760296192 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd40acd70 con 0x7f3fd40ae860 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fda807700 1 --2- 172.21.15.82:0/760296192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd40ae860 0x7f3fd40b08a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40098e0 tx=0x7f3fc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2303ce811200d36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fd9004700 1 -- 172.21.15.82:0/760296192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400b640 con 0x7f3fd40ae860 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fd9004700 1 -- 172.21.15.82:0/760296192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400b7a0 con 0x7f3fd40ae860 2023-10-06T03:15:46.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.517+0000 7f3fd9004700 1 -- 172.21.15.82:0/760296192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400bb40 con 0x7f3fd40ae860 2023-10-06T03:15:46.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.518+0000 7f3fdc26a700 1 -- 172.21.15.82:0/760296192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd40ae860 msgr2=0x7f3fd40b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.518+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/760296192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd40ae860 0x7f3fd40b08a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40098e0 tx=0x7f3fc40091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.518+0000 7f3fdc26a700 1 -- 172.21.15.82:0/760296192 shutdown_connections 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.518+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/760296192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd40ae860 0x7f3fd40b08a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.518+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/760296192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd4159580 0x7f3fd40b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.518+0000 7f3fdc26a700 1 -- 172.21.15.82:0/760296192 >> 172.21.15.82:0/760296192 conn(0x7f3fd406e6f0 msgr2=0x7f3fd406afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.518+0000 7f3fdc26a700 1 -- 172.21.15.82:0/760296192 shutdown_connections 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.518+0000 7f3fdc26a700 1 -- 172.21.15.82:0/760296192 wait complete. 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.519+0000 7f3fdc26a700 1 Processor -- start 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.519+0000 7f3fdc26a700 1 -- start start 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fdc26a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd40ae860 0x7f3fd4153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fdc26a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd4159580 0x7f3fd415d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fdc26a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4159950 0x7f3fd415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fdc26a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd415dfe0 con 0x7f3fd4159580 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fdc26a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40ac240 con 0x7f3fd4159950 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fdc26a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd41574b0 con 0x7f3fd40ae860 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd4159580 0x7f3fd415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd4159580 0x7f3fd415d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43352/0 (socket says 172.21.15.82:43352) 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 -- 172.21.15.82:0/4222795928 learned_addr learned my addr 172.21.15.82:0/4222795928 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fda006700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd40ae860 0x7f3fd4153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fda807700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4159950 0x7f3fd415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 -- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd40ae860 msgr2=0x7f3fd4153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd40ae860 0x7f3fd4153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 -- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4159950 msgr2=0x7f3fd415f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4159950 0x7f3fd415f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 -- 172.21.15.82:0/4222795928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4009420 con 0x7f3fd4159580 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fda006700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd40ae860 0x7f3fd4153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.520+0000 7f3fd9805700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd4159580 0x7f3fd415d010 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c5e0 tx=0x7f3fc8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.521+0000 7f3fd27fc700 1 -- 172.21.15.82:0/4222795928 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8005b30 con 0x7f3fd4159580 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.521+0000 7f3fd27fc700 1 -- 172.21.15.82:0/4222795928 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc8005c90 con 0x7f3fd4159580 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.521+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd40ac700 con 0x7f3fd4159580 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.521+0000 7f3fd27fc700 1 -- 172.21.15.82:0/4222795928 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8007300 con 0x7f3fd4159580 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.521+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd4157cf0 con 0x7f3fd4159580 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.522+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd4157e80 con 0x7f3fd4159580 2023-10-06T03:15:46.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.522+0000 7f3fd27fc700 1 -- 172.21.15.82:0/4222795928 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f3fc8007670 con 0x7f3fd4159580 2023-10-06T03:15:46.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.522+0000 7f3fd27fc700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3fc0066ea0 0x7f3fc0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.522+0000 7f3fd27fc700 1 -- 172.21.15.82:0/4222795928 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3fc8083770 con 0x7f3fd4159580 2023-10-06T03:15:46.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.522+0000 7f3fda006700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3fc0066ea0 0x7f3fc0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.523+0000 7f3fda006700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3fc0066ea0 0x7f3fc0069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc007780 tx=0x7f3fcc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:46.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.526+0000 7f3fd27fc700 1 -- 172.21.15.82:0/4222795928 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fc8050cb0 con 0x7f3fd4159580 2023-10-06T03:15:46.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.730+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fd40ad050 con 0x7f3fd4159580 2023-10-06T03:15:46.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.730+0000 7f3fd27fc700 1 -- 172.21.15.82:0/4222795928 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13674 (secure 0 0 0) 0x7f3fc8017090 con 0x7f3fd4159580 2023-10-06T03:15:46.732 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:46.732 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:46.344921+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3fc0066ea0 msgr2=0x7f3fc0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3fc0066ea0 0x7f3fc0069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc007780 tx=0x7f3fcc00b040 comp rx=0 tx=0).stop 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd4159580 msgr2=0x7f3fd415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd4159580 0x7f3fd415d010 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c5e0 tx=0x7f3fc8000fe0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 shutdown_connections 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4159950 0x7f3fd415f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3fc0066ea0 0x7f3fc0069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fd40ae860 0x7f3fd4153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 --2- 172.21.15.82:0/4222795928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fd4159580 0x7f3fd415d010 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 >> 172.21.15.82:0/4222795928 conn(0x7f3fd406e6f0 msgr2=0x7f3fd406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:46.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 shutdown_connections 2023-10-06T03:15:46.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.733+0000 7f3fdc26a700 1 -- 172.21.15.82:0/4222795928 wait complete. 2023-10-06T03:15:46.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:15:46.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:15:46.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.866+0000 7fbe7ea56700 1 Processor -- start 2023-10-06T03:15:46.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.866+0000 7fbe7ea56700 1 -- start start 2023-10-06T03:15:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.867+0000 7fbe7ea56700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe78159500 0x7fbe781598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.867+0000 7fbe7ea56700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe780b1110 con 0x7fbe7815dab0 2023-10-06T03:15:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.867+0000 7fbe7ea56700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe780b13b0 con 0x7fbe780b3fd0 2023-10-06T03:15:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.867+0000 7fbe7ea56700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780b1690 con 0x7fbe78159500 2023-10-06T03:15:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.867+0000 7fbe7cff3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbe7815dab0 0x7fbe780cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45766/0 (socket says 172.21.15.82:45766) 2023-10-06T03:15:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.867+0000 7fbe7cff3700 1 -- 172.21.15.82:0/1776297014 learned_addr learned my addr 172.21.15.82:0/1776297014 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.867+0000 7fbe77fff700 1 --2- 172.21.15.82:0/1776297014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe78159500 0x7fbe781598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe76ffd700 1 -- 172.21.15.82:0/1776297014 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222703934 0 0) 0x7fbe780b1110 con 0x7fbe7815dab0 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe76ffd700 1 -- 172.21.15.82:0/1776297014 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe60003570 con 0x7fbe7815dab0 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe76ffd700 1 -- 172.21.15.82:0/1776297014 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933288207 0 0) 0x7fbe780b13b0 con 0x7fbe780b3fd0 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe76ffd700 1 -- 172.21.15.82:0/1776297014 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe780b1110 con 0x7fbe780b3fd0 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe77fff700 1 -- 172.21.15.82:0/1776297014 >> v1:172.21.15.134:6789/0 conn(0x7fbe780b3fd0 legacy=0x7fbe7815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe77fff700 1 -- 172.21.15.82:0/1776297014 >> v1:172.21.15.82:6789/0 conn(0x7fbe7815dab0 legacy=0x7fbe780cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe77fff700 1 -- 172.21.15.82:0/1776297014 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780b1970 con 0x7fbe78159500 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe77fff700 1 --2- 172.21.15.82:0/1776297014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe78159500 0x7fbe781598d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbe7815e3c0 tx=0x7fbe680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdb9c79f08dd7479 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe76ffd700 1 -- 172.21.15.82:0/1776297014 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68011630 con 0x7fbe78159500 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe76ffd700 1 -- 172.21.15.82:0/1776297014 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe68011790 con 0x7fbe78159500 2023-10-06T03:15:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.868+0000 7fbe76ffd700 1 -- 172.21.15.82:0/1776297014 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68011b50 con 0x7fbe78159500 2023-10-06T03:15:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.869+0000 7fbe7ea56700 1 -- 172.21.15.82:0/1776297014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe78159500 msgr2=0x7fbe781598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.869+0000 7fbe7ea56700 1 --2- 172.21.15.82:0/1776297014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe78159500 0x7fbe781598d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbe7815e3c0 tx=0x7fbe680091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.869+0000 7fbe7ea56700 1 -- 172.21.15.82:0/1776297014 shutdown_connections 2023-10-06T03:15:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.869+0000 7fbe7ea56700 1 --2- 172.21.15.82:0/1776297014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe78159500 0x7fbe781598d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.869+0000 7fbe7ea56700 1 -- 172.21.15.82:0/1776297014 >> 172.21.15.82:0/1776297014 conn(0x7fbe78067630 msgr2=0x7fbe78069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.869+0000 7fbe7ea56700 1 -- 172.21.15.82:0/1776297014 shutdown_connections 2023-10-06T03:15:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.869+0000 7fbe7ea56700 1 -- 172.21.15.82:0/1776297014 wait complete. 2023-10-06T03:15:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.870+0000 7fbe7ea56700 1 Processor -- start 2023-10-06T03:15:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.870+0000 7fbe7ea56700 1 -- start start 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe7ea56700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe780b3fd0 0x7fbe78167bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe7ea56700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78159500 0x7fbe781548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe7ea56700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe7815dab0 0x7fbe7816b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe7ea56700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78169050 con 0x7fbe780b3fd0 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe7ea56700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78168440 con 0x7fbe78159500 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe7ea56700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78168720 con 0x7fbe7815dab0 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe780b3fd0 0x7fbe78167bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe780b3fd0 0x7fbe78167bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43356/0 (socket says 172.21.15.82:43356) 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 -- 172.21.15.82:0/2193637856 learned_addr learned my addr 172.21.15.82:0/2193637856 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe777fe700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78159500 0x7fbe781548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe7cff3700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe7815dab0 0x7fbe7816b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 -- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe7815dab0 msgr2=0x7fbe7816b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe7815dab0 0x7fbe7816b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 -- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78159500 msgr2=0x7fbe781548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78159500 0x7fbe781548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 -- 172.21.15.82:0/2193637856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68009420 con 0x7fbe780b3fd0 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe77fff700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe780b3fd0 0x7fbe78167bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbe68013000 tx=0x7fbe68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe5ffff700 1 -- 172.21.15.82:0/2193637856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68011b10 con 0x7fbe780b3fd0 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe5ffff700 1 -- 172.21.15.82:0/2193637856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6801f070 con 0x7fbe780b3fd0 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe5ffff700 1 -- 172.21.15.82:0/2193637856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe680266d0 con 0x7fbe780b3fd0 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.871+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe78168a00 con 0x7fbe780b3fd0 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.872+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe78168130 con 0x7fbe780b3fd0 2023-10-06T03:15:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.872+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe78064050 con 0x7fbe780b3fd0 2023-10-06T03:15:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.873+0000 7fbe5ffff700 1 -- 172.21.15.82:0/2193637856 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fbe6801b450 con 0x7fbe780b3fd0 2023-10-06T03:15:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.873+0000 7fbe5ffff700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe64066ea0 0x7fbe64069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.873+0000 7fbe5ffff700 1 -- 172.21.15.82:0/2193637856 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbe68021070 con 0x7fbe780b3fd0 2023-10-06T03:15:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.877+0000 7fbe5ffff700 1 -- 172.21.15.82:0/2193637856 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe68053110 con 0x7fbe780b3fd0 2023-10-06T03:15:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.880+0000 7fbe777fe700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe64066ea0 0x7fbe64069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:46.880+0000 7fbe777fe700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe64066ea0 0x7fbe64069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe78150000 tx=0x7fbe6c007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.065+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbe780d0420 con 0x7fbe780b3fd0 2023-10-06T03:15:47.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.066+0000 7fbe5ffff700 1 -- 172.21.15.82:0/2193637856 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe6802e350 con 0x7fbe780b3fd0 2023-10-06T03:15:47.068 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:15:47.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe64066ea0 msgr2=0x7fbe64069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe64066ea0 0x7fbe64069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe78150000 tx=0x7fbe6c007d50 comp rx=0 tx=0).stop 2023-10-06T03:15:47.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe780b3fd0 msgr2=0x7fbe78167bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe780b3fd0 0x7fbe78167bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbe68013000 tx=0x7fbe68016000 comp rx=0 tx=0).stop 2023-10-06T03:15:47.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 shutdown_connections 2023-10-06T03:15:47.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe64066ea0 0x7fbe64069350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe7815dab0 0x7fbe7816b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe780b3fd0 0x7fbe78167bf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 --2- 172.21.15.82:0/2193637856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78159500 0x7fbe781548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 >> 172.21.15.82:0/2193637856 conn(0x7fbe78067630 msgr2=0x7fbe78069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:47.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 shutdown_connections 2023-10-06T03:15:47.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.068+0000 7fbe7ea56700 1 -- 172.21.15.82:0/2193637856 wait complete. 2023-10-06T03:15:47.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:15:47.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.199+0000 7f3376af2700 1 Processor -- start 2023-10-06T03:15:47.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.199+0000 7f3376af2700 1 -- start start 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f3376af2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3370069120 0x7f33700ade90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f3376af2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3370156550 0x7f33700afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f3376af2700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33700ac3e0 con 0x7f33700694f0 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f3376af2700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3370156ac0 con 0x7f3370069120 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f3376af2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3370156da0 con 0x7f3370156550 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f337488e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3370069120 0x7f33700ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f336ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3370156550 0x7f33700afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f337508f700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f33700694f0 0x7f3370153600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:50780/0 (socket says 172.21.15.82:50780) 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.200+0000 7f337508f700 1 -- 172.21.15.82:0/2583902056 learned_addr learned my addr 172.21.15.82:0/2583902056 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:47.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f337488e700 1 -- 172.21.15.82:0/2583902056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3370156550 msgr2=0x7f33700afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f337488e700 1 --2- 172.21.15.82:0/2583902056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3370156550 0x7f33700afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f337488e700 1 -- 172.21.15.82:0/2583902056 >> v1:172.21.15.134:6789/0 conn(0x7f33700694f0 legacy=0x7f3370153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f337488e700 1 -- 172.21.15.82:0/2583902056 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370157080 con 0x7f3370069120 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f336f7fe700 1 -- 172.21.15.82:0/2583902056 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506987986 0 0) 0x7f33700ac3e0 con 0x7f33700694f0 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f336ffff700 1 --2- 172.21.15.82:0/2583902056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3370156550 0x7f33700afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f337488e700 1 --2- 172.21.15.82:0/2583902056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370069120 0x7f33700ade90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f33640098e0 tx=0x7f33640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3312316f128ecec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f336f7fe700 1 -- 172.21.15.82:0/2583902056 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400b640 con 0x7f3370069120 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f336f7fe700 1 -- 172.21.15.82:0/2583902056 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336400b7a0 con 0x7f3370069120 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.201+0000 7f336f7fe700 1 -- 172.21.15.82:0/2583902056 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400bb40 con 0x7f3370069120 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.202+0000 7f3376af2700 1 -- 172.21.15.82:0/2583902056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370069120 msgr2=0x7f33700ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.202+0000 7f3376af2700 1 --2- 172.21.15.82:0/2583902056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370069120 0x7f33700ade90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f33640098e0 tx=0x7f33640091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.202+0000 7f3376af2700 1 -- 172.21.15.82:0/2583902056 shutdown_connections 2023-10-06T03:15:47.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.202+0000 7f3376af2700 1 --2- 172.21.15.82:0/2583902056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370069120 0x7f33700ade90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.202+0000 7f3376af2700 1 --2- 172.21.15.82:0/2583902056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3370156550 0x7f33700afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.202+0000 7f3376af2700 1 -- 172.21.15.82:0/2583902056 >> 172.21.15.82:0/2583902056 conn(0x7f337006e910 msgr2=0x7f337006be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:47.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.202+0000 7f3376af2700 1 -- 172.21.15.82:0/2583902056 shutdown_connections 2023-10-06T03:15:47.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.202+0000 7f3376af2700 1 -- 172.21.15.82:0/2583902056 wait complete. 2023-10-06T03:15:47.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.203+0000 7f3376af2700 1 Processor -- start 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.203+0000 7f3376af2700 1 -- start start 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f3376af2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3370069120 0x7f33700c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f3376af2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33700694f0 0x7f3370147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f3376af2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370156550 0x7f33700cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f3376af2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700c9f50 con 0x7f3370069120 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f3376af2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370158fd0 con 0x7f3370156550 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f3376af2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33701592b0 con 0x7f33700694f0 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f337508f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370156550 0x7f33700cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33700694f0 0x7f3370147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33700694f0 0x7f3370147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:36432/0 (socket says 172.21.15.82:36432) 2023-10-06T03:15:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f337508f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370156550 0x7f33700cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39776/0 (socket says 172.21.15.82:39776) 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 -- 172.21.15.82:0/2598903957 learned_addr learned my addr 172.21.15.82:0/2598903957 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f337488e700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3370069120 0x7f33700c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 -- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370156550 msgr2=0x7f33700cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370156550 0x7f33700cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 -- 172.21.15.82:0/2598903957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3370069120 msgr2=0x7f33700c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3370069120 0x7f33700c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 -- 172.21.15.82:0/2598903957 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c009420 con 0x7f33700694f0 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f337508f700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370156550 0x7f33700cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.204+0000 7f336ffff700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33700694f0 0x7f3370147530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f335c00ec80 tx=0x7f335c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.205+0000 7f336cff9700 1 -- 172.21.15.82:0/2598903957 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00c920 con 0x7f33700694f0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.205+0000 7f336cff9700 1 -- 172.21.15.82:0/2598903957 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c00ca80 con 0x7f33700694f0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.205+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3364009420 con 0x7f33700694f0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.205+0000 7f336cff9700 1 -- 172.21.15.82:0/2598903957 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00ce00 con 0x7f33700694f0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.205+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337014a8b0 con 0x7f33700694f0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.206+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3370064050 con 0x7f33700694f0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.206+0000 7f336cff9700 1 -- 172.21.15.82:0/2598903957 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f335c013680 con 0x7f33700694f0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.206+0000 7f336cff9700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3354066ea0 0x7f3354069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.206+0000 7f336cff9700 1 -- 172.21.15.82:0/2598903957 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f335c084600 con 0x7f33700694f0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.206+0000 7f337488e700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3354066ea0 0x7f3354069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.207+0000 7f337488e700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3354066ea0 0x7f3354069350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f33640093f0 tx=0x7f3364017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.211+0000 7f336cff9700 1 -- 172.21.15.82:0/2598903957 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f335c051b40 con 0x7f33700694f0 2023-10-06T03:15:47.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.394+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33700ada40 con 0x7f33700694f0 2023-10-06T03:15:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.395+0000 7f336cff9700 1 -- 172.21.15.82:0/2598903957 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f335c055160 con 0x7f33700694f0 2023-10-06T03:15:47.397 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:15:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3354066ea0 msgr2=0x7f3354069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3354066ea0 0x7f3354069350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f33640093f0 tx=0x7f3364017000 comp rx=0 tx=0).stop 2023-10-06T03:15:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33700694f0 msgr2=0x7f3370147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33700694f0 0x7f3370147530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f335c00ec80 tx=0x7f335c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 shutdown_connections 2023-10-06T03:15:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3370156550 0x7f33700cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3370069120 0x7f33700c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3354066ea0 0x7f3354069350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 --2- 172.21.15.82:0/2598903957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33700694f0 0x7f3370147530 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 >> 172.21.15.82:0/2598903957 conn(0x7f337006e910 msgr2=0x7f3370068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 shutdown_connections 2023-10-06T03:15:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.397+0000 7f3376af2700 1 -- 172.21.15.82:0/2598903957 wait complete. 2023-10-06T03:15:47.411 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:15:47.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.524+0000 7fd7eb59e700 1 Processor -- start 2023-10-06T03:15:47.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.524+0000 7fd7eb59e700 1 -- start start 2023-10-06T03:15:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7eb59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd7ec15d480 0x7fd7ec069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7eb59e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7ec0b0a20 0x7fd7ec0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7eb59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec0687c0 con 0x7fd7ec069da0 2023-10-06T03:15:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7eb59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec068aa0 con 0x7fd7ec15d480 2023-10-06T03:15:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7eb59e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec068d80 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7ea59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd7ec15d480 0x7fd7ec069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7e9d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd7ec069da0 0x7fd7ec0b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52792/0 (socket says 172.21.15.82:52792) 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7e9d9b700 1 -- 172.21.15.82:0/2964986458 learned_addr learned my addr 172.21.15.82:0/2964986458 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7ea59c700 1 -- 172.21.15.82:0/2964986458 >> v2:172.21.15.134:3300/0 conn(0x7fd7ec0b0a20 msgr2=0x7fd7ec0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7ead9d700 1 --2- 172.21.15.82:0/2964986458 >> v2:172.21.15.134:3300/0 conn(0x7fd7ec0b0a20 0x7fd7ec0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7e959a700 1 -- 172.21.15.82:0/2964986458 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422255437 0 0) 0x7fd7ec0687c0 con 0x7fd7ec069da0 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7ea59c700 1 --2- 172.21.15.82:0/2964986458 >> v2:172.21.15.134:3300/0 conn(0x7fd7ec0b0a20 0x7fd7ec0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7ea59c700 1 -- 172.21.15.82:0/2964986458 >> v1:172.21.15.82:6789/0 conn(0x7fd7ec069da0 legacy=0x7fd7ec0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7ea59c700 1 -- 172.21.15.82:0/2964986458 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec069060 con 0x7fd7ec15d480 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.525+0000 7fd7ea59c700 1 --2- 172.21.15.82:0/2964986458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec15d480 0x7fd7ec069860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0b3c10 tx=0x7fd7dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3451e3e8074c5207 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7e959a700 1 -- 172.21.15.82:0/2964986458 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00b6b0 con 0x7fd7ec15d480 2023-10-06T03:15:47.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7e959a700 1 -- 172.21.15.82:0/2964986458 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc00b810 con 0x7fd7ec15d480 2023-10-06T03:15:47.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7e959a700 1 -- 172.21.15.82:0/2964986458 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00bbb0 con 0x7fd7ec15d480 2023-10-06T03:15:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7eb59e700 1 -- 172.21.15.82:0/2964986458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec15d480 msgr2=0x7fd7ec069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/2964986458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec15d480 0x7fd7ec069860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0b3c10 tx=0x7fd7dc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7eb59e700 1 -- 172.21.15.82:0/2964986458 shutdown_connections 2023-10-06T03:15:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/2964986458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec15d480 0x7fd7ec069860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/2964986458 >> v2:172.21.15.134:3300/0 conn(0x7fd7ec0b0a20 0x7fd7ec0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7eb59e700 1 -- 172.21.15.82:0/2964986458 >> 172.21.15.82:0/2964986458 conn(0x7fd7ec0ccf80 msgr2=0x7fd7ec0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7eb59e700 1 -- 172.21.15.82:0/2964986458 shutdown_connections 2023-10-06T03:15:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.526+0000 7fd7eb59e700 1 -- 172.21.15.82:0/2964986458 wait complete. 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.527+0000 7fd7eb59e700 1 Processor -- start 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.527+0000 7fd7eb59e700 1 -- start start 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7eb59e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7ec069da0 0x7fd7ec15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7eb59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec0b0a20 0x7fd7ec141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7eb59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7ec15d480 0x7fd7ec1420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7eb59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0c82d0 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7eb59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0c7400 con 0x7fd7ec15d480 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7eb59e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0c7650 con 0x7fd7ec069da0 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7e9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec0b0a20 0x7fd7ec141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7e9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec0b0a20 0x7fd7ec141b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47436/0 (socket says 172.21.15.82:47436) 2023-10-06T03:15:47.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7e9d9b700 1 -- 172.21.15.82:0/692618975 learned_addr learned my addr 172.21.15.82:0/692618975 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7ea59c700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7ec069da0 0x7fd7ec15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7e9d9b700 1 -- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7ec069da0 msgr2=0x7fd7ec15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7e9d9b700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7ec069da0 0x7fd7ec15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7e9d9b700 1 -- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7ec15d480 msgr2=0x7fd7ec1420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7ead9d700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7ec15d480 0x7fd7ec1420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7e9d9b700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7ec15d480 0x7fd7ec1420a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7e9d9b700 1 -- 172.21.15.82:0/692618975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc009420 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.528+0000 7fd7ea59c700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7ec069da0 0x7fd7ec15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.529+0000 7fd7e9d9b700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec0b0a20 0x7fd7ec141b60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000c7e0 tx=0x7fd7e0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.529+0000 7fd7da7fc700 1 -- 172.21.15.82:0/692618975 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0005b30 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.529+0000 7fd7da7fc700 1 -- 172.21.15.82:0/692618975 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0005c90 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.529+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec0c7930 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.529+0000 7fd7da7fc700 1 -- 172.21.15.82:0/692618975 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0007300 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.529+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec0c7ef0 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.530+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec04c3c0 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.530+0000 7fd7da7fc700 1 -- 172.21.15.82:0/692618975 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fd7e001b400 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.530+0000 7fd7da7fc700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd7cc066ea0 0x7fd7cc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.530+0000 7fd7da7fc700 1 -- 172.21.15.82:0/692618975 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd7e0083d30 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.531+0000 7fd7ea59c700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd7cc066ea0 0x7fd7cc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.531+0000 7fd7ea59c700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd7cc066ea0 0x7fd7cc069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0cca50 tx=0x7fd7dc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.535+0000 7fd7da7fc700 1 -- 172.21.15.82:0/692618975 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7e0088070 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.757+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7ec069340 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.757+0000 7fd7da7fc700 1 -- 172.21.15.82:0/692618975 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7fd7e00512f0 con 0x7fd7ec0b0a20 2023-10-06T03:15:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:47.759 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-06T03:15:47.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd7cc066ea0 msgr2=0x7fd7cc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd7cc066ea0 0x7fd7cc069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0cca50 tx=0x7fd7dc017000 comp rx=0 tx=0).stop 2023-10-06T03:15:47.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec0b0a20 msgr2=0x7fd7ec141b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec0b0a20 0x7fd7ec141b60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000c7e0 tx=0x7fd7e0007df0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 shutdown_connections 2023-10-06T03:15:47.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7ec15d480 0x7fd7ec1420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd7cc066ea0 0x7fd7cc069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7ec069da0 0x7fd7ec15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 --2- 172.21.15.82:0/692618975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7ec0b0a20 0x7fd7ec141b60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 >> 172.21.15.82:0/692618975 conn(0x7fd7ec0ccf80 msgr2=0x7fd7ec0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:47.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 shutdown_connections 2023-10-06T03:15:47.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.759+0000 7fd7eb59e700 1 -- 172.21.15.82:0/692618975 wait complete. 2023-10-06T03:15:47.762 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2023-10-06T03:15:47.773 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:47.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.886+0000 7f252a80e700 1 Processor -- start 2023-10-06T03:15:47.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.886+0000 7f252a80e700 1 -- start start 2023-10-06T03:15:47.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f252a80e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f252415d560 0x7f25240d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f252a80e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f252415d930 0x7f25240b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f252a80e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25241591b0 0x7f2524159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f252a80e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25240b2ad0 con 0x7f252415d560 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f252a80e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25240b4160 con 0x7f252415d930 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f252a80e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25240b1f80 con 0x7f25241591b0 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f252415d560 0x7f25240d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f252415d560 0x7f25240d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47448/0 (socket says 172.21.15.82:47448) 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 -- 172.21.15.82:0/3237066231 learned_addr learned my addr 172.21.15.82:0/3237066231 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2528dab700 1 --2- 172.21.15.82:0/3237066231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25241591b0 0x7f2524159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 -- 172.21.15.82:0/3237066231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25241591b0 msgr2=0x7f2524159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 --2- 172.21.15.82:0/3237066231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25241591b0 0x7f2524159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f25237fe700 1 --2- 172.21.15.82:0/3237066231 >> v2:172.21.15.134:3300/0 conn(0x7f252415d930 0x7f25240b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 -- 172.21.15.82:0/3237066231 >> v2:172.21.15.134:3300/0 conn(0x7f252415d930 msgr2=0x7f25240b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 --2- 172.21.15.82:0/3237066231 >> v2:172.21.15.134:3300/0 conn(0x7f252415d930 0x7f25240b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 -- 172.21.15.82:0/3237066231 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524159b70 con 0x7f252415d560 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2528dab700 1 --2- 172.21.15.82:0/3237066231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25241591b0 0x7f2524159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f25237fe700 1 --2- 172.21.15.82:0/3237066231 >> v2:172.21.15.134:3300/0 conn(0x7f252415d930 0x7f25240b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2523fff700 1 --2- 172.21.15.82:0/3237066231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252415d560 0x7f25240d0030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f252415e440 tx=0x7f2514009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e1d0b6ef155376 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2522ffd700 1 -- 172.21.15.82:0/3237066231 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400b860 con 0x7f252415d560 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2522ffd700 1 -- 172.21.15.82:0/3237066231 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400b9c0 con 0x7f252415d560 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.887+0000 7f2522ffd700 1 -- 172.21.15.82:0/3237066231 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400bd60 con 0x7f252415d560 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 -- 172.21.15.82:0/3237066231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252415d560 msgr2=0x7f25240d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 --2- 172.21.15.82:0/3237066231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252415d560 0x7f25240d0030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f252415e440 tx=0x7f2514009250 comp rx=0 tx=0).stop 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 -- 172.21.15.82:0/3237066231 shutdown_connections 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 --2- 172.21.15.82:0/3237066231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f252415d560 0x7f25240d0030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 --2- 172.21.15.82:0/3237066231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25241591b0 0x7f2524159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 --2- 172.21.15.82:0/3237066231 >> v2:172.21.15.134:3300/0 conn(0x7f252415d930 0x7f25240b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 -- 172.21.15.82:0/3237066231 >> 172.21.15.82:0/3237066231 conn(0x7f25240d1180 msgr2=0x7f2524069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 -- 172.21.15.82:0/3237066231 shutdown_connections 2023-10-06T03:15:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.888+0000 7f252a80e700 1 -- 172.21.15.82:0/3237066231 wait complete. 2023-10-06T03:15:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.889+0000 7f252a80e700 1 Processor -- start 2023-10-06T03:15:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.889+0000 7f252a80e700 1 -- start start 2023-10-06T03:15:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f252a80e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25241591b0 0x7f2524154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f252a80e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f252415d560 0x7f25240c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f252a80e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f252415d930 0x7f252415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f252a80e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252415c5a0 con 0x7f25241591b0 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f252a80e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252415b990 con 0x7f252415d560 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f252a80e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252415bc70 con 0x7f252415d930 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f2523fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25241591b0 0x7f2524154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f2523fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25241591b0 0x7f2524154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47452/0 (socket says 172.21.15.82:47452) 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f2523fff700 1 -- 172.21.15.82:0/4183201329 learned_addr learned my addr 172.21.15.82:0/4183201329 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f2523fff700 1 -- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f252415d930 msgr2=0x7f252415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f2523fff700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f252415d930 0x7f252415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f25237fe700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f252415d560 0x7f25240c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f2523fff700 1 -- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f252415d560 msgr2=0x7f25240c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:47.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f2523fff700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f252415d560 0x7f25240c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:47.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f2523fff700 1 -- 172.21.15.82:0/4183201329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140094f0 con 0x7f25241591b0 2023-10-06T03:15:47.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.890+0000 7f25237fe700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f252415d560 0x7f25240c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:47.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.891+0000 7f2523fff700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25241591b0 0x7f2524154c40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2524064a20 tx=0x7f2514017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.891+0000 7f250bfff700 1 -- 172.21.15.82:0/4183201329 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514024440 con 0x7f25241591b0 2023-10-06T03:15:47.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.891+0000 7f250bfff700 1 -- 172.21.15.82:0/4183201329 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25140245a0 con 0x7f25241591b0 2023-10-06T03:15:47.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.891+0000 7f250bfff700 1 -- 172.21.15.82:0/4183201329 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514024960 con 0x7f25241591b0 2023-10-06T03:15:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.891+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252415bf50 con 0x7f25241591b0 2023-10-06T03:15:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.891+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2524155180 con 0x7f25241591b0 2023-10-06T03:15:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.892+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252415c880 con 0x7f25241591b0 2023-10-06T03:15:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.892+0000 7f250bfff700 1 -- 172.21.15.82:0/4183201329 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f251401a420 con 0x7f25241591b0 2023-10-06T03:15:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.892+0000 7f250bfff700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2510066ea0 0x7f2510069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.892+0000 7f250bfff700 1 -- 172.21.15.82:0/4183201329 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2514086000 con 0x7f25241591b0 2023-10-06T03:15:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.893+0000 7f25237fe700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2510066ea0 0x7f2510069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.893+0000 7f25237fe700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2510066ea0 0x7f2510069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25240c7eb0 tx=0x7f2518008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.897+0000 7f250bfff700 1 -- 172.21.15.82:0/4183201329 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25140b75a0 con 0x7f25241591b0 2023-10-06T03:15:47.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:47.941+0000 7f250bfff700 1 -- 172.21.15.82:0/4183201329 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2514053990 con 0x7f25241591b0 2023-10-06T03:15:48.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.085+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2524064050 con 0x7f25241591b0 2023-10-06T03:15:48.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.086+0000 7f250bfff700 1 -- 172.21.15.82:0/4183201329 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13648 (secure 0 0 0) 0x7f2514056be0 con 0x7f25241591b0 2023-10-06T03:15:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:48.088 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:47.346411+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:48.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2510066ea0 msgr2=0x7f2510069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2510066ea0 0x7f2510069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25240c7eb0 tx=0x7f2518008040 comp rx=0 tx=0).stop 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25241591b0 msgr2=0x7f2524154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25241591b0 0x7f2524154c40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2524064a20 tx=0x7f2514017000 comp rx=0 tx=0).stop 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 shutdown_connections 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2510066ea0 0x7f2510069350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f252415d930 0x7f252415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25241591b0 0x7f2524154c40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 --2- 172.21.15.82:0/4183201329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f252415d560 0x7f25240c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 >> 172.21.15.82:0/4183201329 conn(0x7f25240d1180 msgr2=0x7f25240afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 shutdown_connections 2023-10-06T03:15:48.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.088+0000 7f252a80e700 1 -- 172.21.15.82:0/4183201329 wait complete. 2023-10-06T03:15:48.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:15:48.102 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:15:48.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.217+0000 7fcbb1b64700 1 Processor -- start 2023-10-06T03:15:48.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.217+0000 7fcbb1b64700 1 -- start start 2023-10-06T03:15:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbb1b64700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac1598d0 0x7fcbac15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbb1b64700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcbac15d8e0 0x7fcbac0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbb1b64700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac15dd20 con 0x7fcbac159500 2023-10-06T03:15:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbb1b64700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0b1110 con 0x7fcbac15d8e0 2023-10-06T03:15:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbb1b64700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0b13b0 con 0x7fcbac1598d0 2023-10-06T03:15:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbab7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcbac159500 0x7fcbac0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52804/0 (socket says 172.21.15.82:52804) 2023-10-06T03:15:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbab7fe700 1 -- 172.21.15.82:0/816855336 learned_addr learned my addr 172.21.15.82:0/816855336 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbabfff700 1 --2- 172.21.15.82:0/816855336 >> v2:172.21.15.82:3300/0 conn(0x7fcbac15d8e0 0x7fcbac0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbaaffd700 1 --2- 172.21.15.82:0/816855336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac1598d0 0x7fcbac15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbaa7fc700 1 -- 172.21.15.82:0/816855336 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255771684 0 0) 0x7fcbac15dd20 con 0x7fcbac159500 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbaa7fc700 1 -- 172.21.15.82:0/816855336 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb94003570 con 0x7fcbac159500 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbabfff700 1 -- 172.21.15.82:0/816855336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac1598d0 msgr2=0x7fcbac15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbabfff700 1 --2- 172.21.15.82:0/816855336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac1598d0 0x7fcbac15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbabfff700 1 -- 172.21.15.82:0/816855336 >> v1:172.21.15.82:6789/0 conn(0x7fcbac159500 legacy=0x7fcbac0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbabfff700 1 -- 172.21.15.82:0/816855336 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0b1690 con 0x7fcbac15d8e0 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbabfff700 1 --2- 172.21.15.82:0/816855336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac15d8e0 0x7fcbac0cf6c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009e60 tx=0x7fcba4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3429fde0110dbb8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbaa7fc700 1 -- 172.21.15.82:0/816855336 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400e070 con 0x7fcbac15d8e0 2023-10-06T03:15:48.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbaa7fc700 1 -- 172.21.15.82:0/816855336 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba400bab0 con 0x7fcbac15d8e0 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.218+0000 7fcbaa7fc700 1 -- 172.21.15.82:0/816855336 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400be70 con 0x7fcbac15d8e0 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.219+0000 7fcbb1b64700 1 -- 172.21.15.82:0/816855336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac15d8e0 msgr2=0x7fcbac0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.219+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/816855336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac15d8e0 0x7fcbac0cf6c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009e60 tx=0x7fcba4009780 comp rx=0 tx=0).stop 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.219+0000 7fcbb1b64700 1 -- 172.21.15.82:0/816855336 shutdown_connections 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.219+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/816855336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac15d8e0 0x7fcbac0cf6c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.219+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/816855336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac1598d0 0x7fcbac15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.219+0000 7fcbb1b64700 1 -- 172.21.15.82:0/816855336 >> 172.21.15.82:0/816855336 conn(0x7fcbac067630 msgr2=0x7fcbac069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.219+0000 7fcbb1b64700 1 -- 172.21.15.82:0/816855336 shutdown_connections 2023-10-06T03:15:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.219+0000 7fcbb1b64700 1 -- 172.21.15.82:0/816855336 wait complete. 2023-10-06T03:15:48.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.220+0000 7fcbb1b64700 1 Processor -- start 2023-10-06T03:15:48.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.220+0000 7fcbb1b64700 1 -- start start 2023-10-06T03:15:48.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbb1b64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac159500 0x7fcbac139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbb1b64700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbac1598d0 0x7fcbac0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbb1b64700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac15d8e0 0x7fcbac0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbb1b64700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac15bc30 con 0x7fcbac159500 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbb1b64700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac15bf10 con 0x7fcbac1598d0 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbb1b64700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac15c1f0 con 0x7fcbac15d8e0 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac159500 0x7fcbac139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac159500 0x7fcbac139b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47472/0 (socket says 172.21.15.82:47472) 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 -- 172.21.15.82:0/1790575049 learned_addr learned my addr 172.21.15.82:0/1790575049 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbaaffd700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbac1598d0 0x7fcbac0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbabfff700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac15d8e0 0x7fcbac0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 -- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac15d8e0 msgr2=0x7fcbac0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac15d8e0 0x7fcbac0ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 -- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbac1598d0 msgr2=0x7fcbac0b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbac1598d0 0x7fcbac0b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 -- 172.21.15.82:0/1790575049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4009a20 con 0x7fcbac159500 2023-10-06T03:15:48.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbaaffd700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbac1598d0 0x7fcbac0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:48.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.221+0000 7fcbab7fe700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac159500 0x7fcbac139b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c7c0 tx=0x7fcb9c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.222+0000 7fcb937fe700 1 -- 172.21.15.82:0/1790575049 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c005b30 con 0x7fcbac159500 2023-10-06T03:15:48.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.222+0000 7fcb937fe700 1 -- 172.21.15.82:0/1790575049 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c005c90 con 0x7fcbac159500 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.222+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac15c4d0 con 0x7fcbac159500 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.222+0000 7fcb937fe700 1 -- 172.21.15.82:0/1790575049 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c007340 con 0x7fcbac159500 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.222+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac15ccd0 con 0x7fcbac159500 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.223+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac064050 con 0x7fcbac159500 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.223+0000 7fcb937fe700 1 -- 172.21.15.82:0/1790575049 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb9c01b400 con 0x7fcbac159500 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.223+0000 7fcb937fe700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcb98066f30 0x7fcb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.223+0000 7fcb937fe700 1 -- 172.21.15.82:0/1790575049 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcb9c083e50 con 0x7fcbac159500 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.224+0000 7fcbaaffd700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcb98066f30 0x7fcb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.224+0000 7fcbaaffd700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcb98066f30 0x7fcb980693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcba0006f00 tx=0x7fcba0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.228+0000 7fcb937fe700 1 -- 172.21.15.82:0/1790575049 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb9c051330 con 0x7fcbac159500 2023-10-06T03:15:48.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.410+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcbac0b1970 con 0x7fcbac159500 2023-10-06T03:15:48.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.410+0000 7fcb937fe700 1 -- 172.21.15.82:0/1790575049 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb9c054950 con 0x7fcbac159500 2023-10-06T03:15:48.412 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:15:48.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcb98066f30 msgr2=0x7fcb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcb98066f30 0x7fcb980693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcba0006f00 tx=0x7fcba0008040 comp rx=0 tx=0).stop 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac159500 msgr2=0x7fcbac139b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac159500 0x7fcbac139b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c7c0 tx=0x7fcb9c007e00 comp rx=0 tx=0).stop 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 shutdown_connections 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcb98066f30 0x7fcb980693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcbac15d8e0 0x7fcbac0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbac159500 0x7fcbac139b70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 --2- 172.21.15.82:0/1790575049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbac1598d0 0x7fcbac0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.412+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 >> 172.21.15.82:0/1790575049 conn(0x7fcbac067630 msgr2=0x7fcbac069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.413+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 shutdown_connections 2023-10-06T03:15:48.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.413+0000 7fcbb1b64700 1 -- 172.21.15.82:0/1790575049 wait complete. 2023-10-06T03:15:48.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:15:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.541+0000 7f73cca66700 1 Processor -- start 2023-10-06T03:15:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.541+0000 7f73cca66700 1 -- start start 2023-10-06T03:15:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73cca66700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73c8142e90 0x7f73c8069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73cca66700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73c8069d50 0x7f73c815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73cca66700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c8069380 con 0x7f73c815de80 2023-10-06T03:15:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73cca66700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c8068770 con 0x7f73c8069d50 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73cca66700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c8068a50 con 0x7f73c8142e90 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c6ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73c8069d50 0x7f73c815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c7fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f73c815de80 0x7f73c80b0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52818/0 (socket says 172.21.15.82:52818) 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c7fff700 1 -- 172.21.15.82:0/2916612855 learned_addr learned my addr 172.21.15.82:0/2916612855 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c77fe700 1 --2- 172.21.15.82:0/2916612855 >> v2:172.21.15.134:3300/0 conn(0x7f73c8142e90 0x7f73c8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c6ffd700 1 -- 172.21.15.82:0/2916612855 >> v2:172.21.15.134:3300/0 conn(0x7f73c8142e90 msgr2=0x7f73c8069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c6ffd700 1 --2- 172.21.15.82:0/2916612855 >> v2:172.21.15.134:3300/0 conn(0x7f73c8142e90 0x7f73c8069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c6ffd700 1 -- 172.21.15.82:0/2916612855 >> v1:172.21.15.82:6789/0 conn(0x7f73c815de80 legacy=0x7f73c80b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c6ffd700 1 -- 172.21.15.82:0/2916612855 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8068d30 con 0x7f73c8069d50 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.542+0000 7f73c67fc700 1 -- 172.21.15.82:0/2916612855 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049086642 0 0) 0x7f73c8069380 con 0x7f73c815de80 2023-10-06T03:15:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73c6ffd700 1 --2- 172.21.15.82:0/2916612855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c815d290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f73c8089390 tx=0x7f73bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6aab15ee61e4f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73c67fc700 1 -- 172.21.15.82:0/2916612855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00b6b0 con 0x7f73c8069d50 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73c67fc700 1 -- 172.21.15.82:0/2916612855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc00b810 con 0x7f73c8069d50 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73c67fc700 1 -- 172.21.15.82:0/2916612855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00bbb0 con 0x7f73c8069d50 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73cca66700 1 -- 172.21.15.82:0/2916612855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 msgr2=0x7f73c815d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73cca66700 1 --2- 172.21.15.82:0/2916612855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c815d290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f73c8089390 tx=0x7f73bc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73cca66700 1 -- 172.21.15.82:0/2916612855 shutdown_connections 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73cca66700 1 --2- 172.21.15.82:0/2916612855 >> v2:172.21.15.134:3300/0 conn(0x7f73c8142e90 0x7f73c8069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73cca66700 1 --2- 172.21.15.82:0/2916612855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c815d290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73cca66700 1 -- 172.21.15.82:0/2916612855 >> 172.21.15.82:0/2916612855 conn(0x7f73c80ccfe0 msgr2=0x7f73c80cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73cca66700 1 -- 172.21.15.82:0/2916612855 shutdown_connections 2023-10-06T03:15:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.543+0000 7f73cca66700 1 -- 172.21.15.82:0/2916612855 wait complete. 2023-10-06T03:15:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.544+0000 7f73cca66700 1 Processor -- start 2023-10-06T03:15:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.544+0000 7f73cca66700 1 -- start start 2023-10-06T03:15:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73cca66700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c80c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73cca66700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c8142e90 0x7f73c813eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73cca66700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c815de80 0x7f73c80c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73cca66700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80c7080 con 0x7f73c8069d50 2023-10-06T03:15:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73cca66700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c813f530 con 0x7f73c815de80 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73cca66700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80c6470 con 0x7f73c8142e90 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73c77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c80c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73c77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c80c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47488/0 (socket says 172.21.15.82:47488) 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73c77fe700 1 -- 172.21.15.82:0/3096620352 learned_addr learned my addr 172.21.15.82:0/3096620352 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73c7fff700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c815de80 0x7f73c80c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.545+0000 7f73c6ffd700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c8142e90 0x7f73c813eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73c77fe700 1 -- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c8142e90 msgr2=0x7f73c813eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73c77fe700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c8142e90 0x7f73c813eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73c77fe700 1 -- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c815de80 msgr2=0x7f73c80c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73c77fe700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c815de80 0x7f73c80c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73c77fe700 1 -- 172.21.15.82:0/3096620352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc009420 con 0x7f73c8069d50 2023-10-06T03:15:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73c77fe700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c80c7510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f73b800d8c0 tx=0x7f73b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73af7fe700 1 -- 172.21.15.82:0/3096620352 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b80125f0 con 0x7f73c8069d50 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73af7fe700 1 -- 172.21.15.82:0/3096620352 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b8012750 con 0x7f73c8069d50 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c80c6750 con 0x7f73c8069d50 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73af7fe700 1 -- 172.21.15.82:0/3096620352 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8012af0 con 0x7f73c8069d50 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.546+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c80c6d10 con 0x7f73c8069d50 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.547+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c804c3c0 con 0x7f73c8069d50 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.547+0000 7f73af7fe700 1 -- 172.21.15.82:0/3096620352 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73b801e460 con 0x7f73c8069d50 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.548+0000 7f73af7fe700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73b4066f30 0x7f73b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.548+0000 7f73af7fe700 1 -- 172.21.15.82:0/3096620352 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f73b80848c0 con 0x7f73c8069d50 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.548+0000 7f73c6ffd700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73b4066f30 0x7f73b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.548+0000 7f73c6ffd700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73b4066f30 0x7f73b40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f73c8089390 tx=0x7f73bc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.552+0000 7f73af7fe700 1 -- 172.21.15.82:0/3096620352 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73b8051d20 con 0x7f73c8069d50 2023-10-06T03:15:48.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.734+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73c8069010 con 0x7f73c8069d50 2023-10-06T03:15:48.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.734+0000 7f73af7fe700 1 -- 172.21.15.82:0/3096620352 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73b8055340 con 0x7f73c8069d50 2023-10-06T03:15:48.736 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:15:48.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73b4066f30 msgr2=0x7f73b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73b4066f30 0x7f73b40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f73c8089390 tx=0x7f73bc017000 comp rx=0 tx=0).stop 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 msgr2=0x7f73c80c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c80c7510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f73b800d8c0 tx=0x7f73b8008040 comp rx=0 tx=0).stop 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 shutdown_connections 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c815de80 0x7f73c80c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c8069d50 0x7f73c80c7510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73b4066f30 0x7f73b40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 --2- 172.21.15.82:0/3096620352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73c8142e90 0x7f73c813eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 >> 172.21.15.82:0/3096620352 conn(0x7f73c80ccfe0 msgr2=0x7f73c8158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 shutdown_connections 2023-10-06T03:15:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.736+0000 7f73cca66700 1 -- 172.21.15.82:0/3096620352 wait complete. 2023-10-06T03:15:48.750 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:15:48.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.862+0000 7fb5d68bc700 1 Processor -- start 2023-10-06T03:15:48.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.862+0000 7fb5d68bc700 1 -- start start 2023-10-06T03:15:48.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d68bc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb5d01595c0 0x7fb5d00cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d68bc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d00b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d68bc700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d00cfa30 con 0x7fb5d00cf5c0 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d68bc700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d00cc7f0 con 0x7fb5d01595c0 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d68bc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00cbc20 con 0x7fb5d0068ad0 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d58ba700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb5d01595c0 0x7fb5d00cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d60bb700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d00b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d58ba700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb5d01595c0 0x7fb5d00cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:48702/0 (socket says 172.21.15.82:48702) 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.863+0000 7fb5d58ba700 1 -- 172.21.15.82:0/594786540 learned_addr learned my addr 172.21.15.82:0/594786540 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.864+0000 7fb5d60bb700 1 -- 172.21.15.82:0/594786540 >> v2:172.21.15.134:3300/0 conn(0x7fb5d01595c0 msgr2=0x7fb5d00cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.864+0000 7fb5d60bb700 1 --2- 172.21.15.82:0/594786540 >> v2:172.21.15.134:3300/0 conn(0x7fb5d01595c0 0x7fb5d00cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.864+0000 7fb5d60bb700 1 -- 172.21.15.82:0/594786540 >> v1:172.21.15.134:6789/0 conn(0x7fb5d00cf5c0 legacy=0x7fb5d00683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.864+0000 7fb5d60bb700 1 -- 172.21.15.82:0/594786540 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d0068f30 con 0x7fb5d0068ad0 2023-10-06T03:15:48.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.864+0000 7fb5d60bb700 1 --2- 172.21.15.82:0/594786540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d00b00f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80098e0 tx=0x7fb5c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9c8d510b918b9cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.864+0000 7fb5d48b8700 1 -- 172.21.15.82:0/594786540 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800b640 con 0x7fb5d0068ad0 2023-10-06T03:15:48.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.864+0000 7fb5d48b8700 1 -- 172.21.15.82:0/594786540 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c800b7a0 con 0x7fb5d0068ad0 2023-10-06T03:15:48.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.864+0000 7fb5d48b8700 1 -- 172.21.15.82:0/594786540 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800bb40 con 0x7fb5d0068ad0 2023-10-06T03:15:48.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.865+0000 7fb5d68bc700 1 -- 172.21.15.82:0/594786540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 msgr2=0x7fb5d00b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.865+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/594786540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d00b00f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80098e0 tx=0x7fb5c80091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.865+0000 7fb5d68bc700 1 -- 172.21.15.82:0/594786540 shutdown_connections 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.865+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/594786540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d00b00f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.865+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/594786540 >> v2:172.21.15.134:3300/0 conn(0x7fb5d01595c0 0x7fb5d00cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.865+0000 7fb5d68bc700 1 -- 172.21.15.82:0/594786540 >> 172.21.15.82:0/594786540 conn(0x7fb5d00d0f70 msgr2=0x7fb5d00ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.865+0000 7fb5d68bc700 1 -- 172.21.15.82:0/594786540 shutdown_connections 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.865+0000 7fb5d68bc700 1 -- 172.21.15.82:0/594786540 wait complete. 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.866+0000 7fb5d68bc700 1 Processor -- start 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.866+0000 7fb5d68bc700 1 -- start start 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.866+0000 7fb5d68bc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d0158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.866+0000 7fb5d68bc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d00cf5c0 0x7fb5d00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.866+0000 7fb5d68bc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5d01595c0 0x7fb5d015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.866+0000 7fb5d68bc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00c8c30 con 0x7fb5d01595c0 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.866+0000 7fb5d68bc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d016d1a0 con 0x7fb5d00cf5c0 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.866+0000 7fb5d68bc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d016d480 con 0x7fb5d0068ad0 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5d01595c0 0x7fb5d015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5d01595c0 0x7fb5d015cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47498/0 (socket says 172.21.15.82:47498) 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 -- 172.21.15.82:0/3040713167 learned_addr learned my addr 172.21.15.82:0/3040713167 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d58ba700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d0158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d50b9700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d00cf5c0 0x7fb5d00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 -- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 msgr2=0x7fb5d0158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d0158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 -- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d00cf5c0 msgr2=0x7fb5d00b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d00cf5c0 0x7fb5d00b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 -- 172.21.15.82:0/3040713167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8009420 con 0x7fb5d01595c0 2023-10-06T03:15:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d60bb700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5d01595c0 0x7fb5d015cd00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00cbd60 tx=0x7fb5c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5c5ffb700 1 -- 172.21.15.82:0/3040713167 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011420 con 0x7fb5d01595c0 2023-10-06T03:15:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5c5ffb700 1 -- 172.21.15.82:0/3040713167 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c8011580 con 0x7fb5d01595c0 2023-10-06T03:15:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5c5ffb700 1 -- 172.21.15.82:0/3040713167 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011940 con 0x7fb5d01595c0 2023-10-06T03:15:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d016d760 con 0x7fb5d01595c0 2023-10-06T03:15:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.867+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d0158cc0 con 0x7fb5d01595c0 2023-10-06T03:15:48.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.868+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d004c3c0 con 0x7fb5d01595c0 2023-10-06T03:15:48.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.869+0000 7fb5c5ffb700 1 -- 172.21.15.82:0/3040713167 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5c8011cb0 con 0x7fb5d01595c0 2023-10-06T03:15:48.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.869+0000 7fb5c5ffb700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb5b4066f30 0x7fb5b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:48.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.869+0000 7fb5c5ffb700 1 -- 172.21.15.82:0/3040713167 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb5c8085ed0 con 0x7fb5d01595c0 2023-10-06T03:15:48.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.869+0000 7fb5d58ba700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb5b4066f30 0x7fb5b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:48.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.870+0000 7fb5d58ba700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb5b4066f30 0x7fb5b40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009fd0 tx=0x7fb5cc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:48.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:48.873+0000 7fb5c5ffb700 1 -- 172.21.15.82:0/3040713167 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5c8053330 con 0x7fb5d01595c0 2023-10-06T03:15:49.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.058+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb5d00c8d70 con 0x7fb5d01595c0 2023-10-06T03:15:49.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.059+0000 7fb5c5ffb700 1 -- 172.21.15.82:0/3040713167 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb5c8056950 con 0x7fb5d01595c0 2023-10-06T03:15:49.060 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:15:49.061 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-10-06T03:15:49.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb5b4066f30 msgr2=0x7fb5b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:49.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb5b4066f30 0x7fb5b40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009fd0 tx=0x7fb5cc00b040 comp rx=0 tx=0).stop 2023-10-06T03:15:49.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5d01595c0 msgr2=0x7fb5d015cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:49.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5d01595c0 0x7fb5d015cd00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00cbd60 tx=0x7fb5c8017000 comp rx=0 tx=0).stop 2023-10-06T03:15:49.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 shutdown_connections 2023-10-06T03:15:49.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5d01595c0 0x7fb5d015cd00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb5b4066f30 0x7fb5b40693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5d0068ad0 0x7fb5d0158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 --2- 172.21.15.82:0/3040713167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5d00cf5c0 0x7fb5d00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 >> 172.21.15.82:0/3040713167 conn(0x7fb5d00d0f70 msgr2=0x7fb5d00b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:49.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 shutdown_connections 2023-10-06T03:15:49.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.061+0000 7fb5d68bc700 1 -- 172.21.15.82:0/3040713167 wait complete. 2023-10-06T03:15:49.075 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:15:49.075 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:15:49.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.191+0000 7fa22b357700 1 Processor -- start 2023-10-06T03:15:49.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.191+0000 7fa22b357700 1 -- start start 2023-10-06T03:15:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa22b357700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2240ccbe0 0x7fa2240b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa22b357700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240d0f00 0x7fa2240ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa22b357700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2240cbed0 con 0x7fa2240b55b0 2023-10-06T03:15:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa22b357700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa224159d40 con 0x7fa2240ccbe0 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa22b357700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240cc750 con 0x7fa2240d0f00 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa2288f2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2240ccbe0 0x7fa2240b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa2288f2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2240ccbe0 0x7fa2240b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47500/0 (socket says 172.21.15.82:47500) 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa2288f2700 1 -- 172.21.15.82:0/2522518861 learned_addr learned my addr 172.21.15.82:0/2522518861 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa2288f2700 1 -- 172.21.15.82:0/2522518861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240d0f00 msgr2=0x7fa2240ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.192+0000 7fa2288f2700 1 --2- 172.21.15.82:0/2522518861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240d0f00 0x7fa2240ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa2288f2700 1 -- 172.21.15.82:0/2522518861 >> v1:172.21.15.134:6789/0 conn(0x7fa2240b55b0 legacy=0x7fa2240cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa2288f2700 1 -- 172.21.15.82:0/2522518861 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2240cd050 con 0x7fa2240ccbe0 2023-10-06T03:15:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa2288f2700 1 --2- 172.21.15.82:0/2522518861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240ccbe0 0x7fa2240b5980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa2140099b0 tx=0x7fa214009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85eb3be295a68be2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa21bfff700 1 -- 172.21.15.82:0/2522518861 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400b820 con 0x7fa2240ccbe0 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa21bfff700 1 -- 172.21.15.82:0/2522518861 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21400b980 con 0x7fa2240ccbe0 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa21bfff700 1 -- 172.21.15.82:0/2522518861 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400bd40 con 0x7fa2240ccbe0 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa22b357700 1 -- 172.21.15.82:0/2522518861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240ccbe0 msgr2=0x7fa2240b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa22b357700 1 --2- 172.21.15.82:0/2522518861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240ccbe0 0x7fa2240b5980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa2140099b0 tx=0x7fa214009250 comp rx=0 tx=0).stop 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa22b357700 1 -- 172.21.15.82:0/2522518861 shutdown_connections 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa22b357700 1 --2- 172.21.15.82:0/2522518861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240d0f00 0x7fa2240ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa22b357700 1 --2- 172.21.15.82:0/2522518861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240ccbe0 0x7fa2240b5980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa22b357700 1 -- 172.21.15.82:0/2522518861 >> 172.21.15.82:0/2522518861 conn(0x7fa22408a050 msgr2=0x7fa224099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:49.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa22b357700 1 -- 172.21.15.82:0/2522518861 shutdown_connections 2023-10-06T03:15:49.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.193+0000 7fa22b357700 1 -- 172.21.15.82:0/2522518861 wait complete. 2023-10-06T03:15:49.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.194+0000 7fa22b357700 1 Processor -- start 2023-10-06T03:15:49.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa22b357700 1 -- start start 2023-10-06T03:15:49.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa22b357700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240b55b0 0x7fa224157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:49.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa22b357700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240ccbe0 0x7fa22416d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:49.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa22b357700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240d0f00 0x7fa22416d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:49.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa22b357700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240ca610 con 0x7fa2240d0f00 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa22b357700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240c8110 con 0x7fa2240b55b0 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa22b357700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22416def0 con 0x7fa2240ccbe0 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa2298f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240d0f00 0x7fa22416d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa2298f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240d0f00 0x7fa22416d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47508/0 (socket says 172.21.15.82:47508) 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.195+0000 7fa2298f4700 1 -- 172.21.15.82:0/3096966206 learned_addr learned my addr 172.21.15.82:0/3096966206 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2288f2700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240ccbe0 0x7fa22416d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2290f3700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240b55b0 0x7fa224157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2298f4700 1 -- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240ccbe0 msgr2=0x7fa22416d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2298f4700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240ccbe0 0x7fa22416d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2298f4700 1 -- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240b55b0 msgr2=0x7fa224157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:49.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2298f4700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240b55b0 0x7fa224157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:49.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2298f4700 1 -- 172.21.15.82:0/3096966206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140094f0 con 0x7fa2240d0f00 2023-10-06T03:15:49.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2298f4700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240d0f00 0x7fa22416d5c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00bc30 tx=0x7fa21c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:49.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2197fa700 1 -- 172.21.15.82:0/3096966206 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0092e0 con 0x7fa2240d0f00 2023-10-06T03:15:49.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2197fa700 1 -- 172.21.15.82:0/3096966206 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c00c630 con 0x7fa2240d0f00 2023-10-06T03:15:49.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2240c8950 con 0x7fa2240d0f00 2023-10-06T03:15:49.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa2197fa700 1 -- 172.21.15.82:0/3096966206 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00ca10 con 0x7fa2240d0f00 2023-10-06T03:15:49.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.196+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2240c8300 con 0x7fa2240d0f00 2023-10-06T03:15:49.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.197+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2240c8ae0 con 0x7fa2240d0f00 2023-10-06T03:15:49.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.197+0000 7fa2197fa700 1 -- 172.21.15.82:0/3096966206 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa21c012070 con 0x7fa2240d0f00 2023-10-06T03:15:49.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.198+0000 7fa2197fa700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa208066f30 0x7fa2080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:49.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.198+0000 7fa2197fa700 1 -- 172.21.15.82:0/3096966206 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa21c083e80 con 0x7fa2240d0f00 2023-10-06T03:15:49.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.198+0000 7fa2290f3700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa208066f30 0x7fa2080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:49.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.198+0000 7fa2290f3700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa208066f30 0x7fa2080693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa220006fd0 tx=0x7fa220009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:49.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.202+0000 7fa2197fa700 1 -- 172.21.15.82:0/3096966206 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa21c0512e0 con 0x7fa2240d0f00 2023-10-06T03:15:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:49.386+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa2240717c0 con 0x7fa2240d0f00 2023-10-06T03:15:50.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.375+0000 7fa2197fa700 1 -- 172.21.15.82:0/3096966206 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa21c054900 con 0x7fa2240d0f00 2023-10-06T03:15:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa208066f30 msgr2=0x7fa2080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa208066f30 0x7fa2080693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa220006fd0 tx=0x7fa220009060 comp rx=0 tx=0).stop 2023-10-06T03:15:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240d0f00 msgr2=0x7fa22416d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240d0f00 0x7fa22416d5c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00bc30 tx=0x7fa21c009840 comp rx=0 tx=0).stop 2023-10-06T03:15:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 shutdown_connections 2023-10-06T03:15:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2240d0f00 0x7fa22416d5c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240b55b0 0x7fa224157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:50.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa208066f30 0x7fa2080693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:50.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 --2- 172.21.15.82:0/3096966206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240ccbe0 0x7fa22416d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:50.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.379+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 >> 172.21.15.82:0/3096966206 conn(0x7fa22408a050 msgr2=0x7fa2240ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:50.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.380+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 shutdown_connections 2023-10-06T03:15:50.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.383+0000 7fa22b357700 1 -- 172.21.15.82:0/3096966206 wait complete. 2023-10-06T03:15:50.385 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-10-06T03:15:50.399 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:15:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.524+0000 7fd60c5e5700 1 Processor -- start 2023-10-06T03:15:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.524+0000 7fd60c5e5700 1 -- start start 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60c5e5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6040b1be0 0x7fd6040b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60c5e5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040cd860 con 0x7fd6040cdcf0 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60c5e5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040ce0f0 con 0x7fd604159890 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60c5e5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6040ccc50 con 0x7fd6040b1be0 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd609b80700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6040b1be0 0x7fd6040b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60ab82700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd6040cdcf0 0x7fd604159c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52822/0 (socket says 172.21.15.82:52822) 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60ab82700 1 -- 172.21.15.82:0/416025861 learned_addr learned my addr 172.21.15.82:0/416025861 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd609b80700 1 -- 172.21.15.82:0/416025861 >> v1:172.21.15.134:6789/0 conn(0x7fd604159890 legacy=0x7fd6040b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd609b80700 1 -- 172.21.15.82:0/416025861 >> v1:172.21.15.82:6789/0 conn(0x7fd6040cdcf0 legacy=0x7fd604159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60937f700 1 -- 172.21.15.82:0/416025861 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230878990 0 0) 0x7fd6040cd860 con 0x7fd6040cdcf0 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd609b80700 1 -- 172.21.15.82:0/416025861 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6040ccf30 con 0x7fd6040b1be0 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd609b80700 1 --2- 172.21.15.82:0/416025861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040b1be0 0x7fd6040b0eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80098e0 tx=0x7fd5f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9084d0453cf9e2ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60937f700 1 -- 172.21.15.82:0/416025861 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8009e80 con 0x7fd6040b1be0 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60937f700 1 -- 172.21.15.82:0/416025861 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f800b860 con 0x7fd6040b1be0 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.525+0000 7fd60937f700 1 -- 172.21.15.82:0/416025861 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800bbe0 con 0x7fd6040b1be0 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.526+0000 7fd60c5e5700 1 -- 172.21.15.82:0/416025861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040b1be0 msgr2=0x7fd6040b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.526+0000 7fd60c5e5700 1 --2- 172.21.15.82:0/416025861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040b1be0 0x7fd6040b0eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80098e0 tx=0x7fd5f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.526+0000 7fd60c5e5700 1 -- 172.21.15.82:0/416025861 shutdown_connections 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.526+0000 7fd60c5e5700 1 --2- 172.21.15.82:0/416025861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040b1be0 0x7fd6040b0eb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.526+0000 7fd60c5e5700 1 -- 172.21.15.82:0/416025861 >> 172.21.15.82:0/416025861 conn(0x7fd604099990 msgr2=0x7fd6040b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.526+0000 7fd60c5e5700 1 -- 172.21.15.82:0/416025861 shutdown_connections 2023-10-06T03:15:50.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.526+0000 7fd60c5e5700 1 -- 172.21.15.82:0/416025861 wait complete. 2023-10-06T03:15:50.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.527+0000 7fd60c5e5700 1 Processor -- start 2023-10-06T03:15:50.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.527+0000 7fd60c5e5700 1 -- start start 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60c5e5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6040b1be0 0x7fd604156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60c5e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040cdcf0 0x7fd60409d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60c5e5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd604159890 0x7fd604069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60c5e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60409e2d0 con 0x7fd6040cdcf0 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60c5e5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60409adb0 con 0x7fd604159890 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60c5e5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd604169ea0 con 0x7fd6040b1be0 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040cdcf0 0x7fd60409d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040cdcf0 0x7fd60409d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47524/0 (socket says 172.21.15.82:47524) 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 -- 172.21.15.82:0/351965268 learned_addr learned my addr 172.21.15.82:0/351965268 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60a381700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6040b1be0 0x7fd604156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60ab82700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd604159890 0x7fd604069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 -- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6040b1be0 msgr2=0x7fd604156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6040b1be0 0x7fd604156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 -- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd604159890 msgr2=0x7fd604069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd604159890 0x7fd604069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 -- 172.21.15.82:0/351965268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8009420 con 0x7fd6040cdcf0 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd60a381700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6040b1be0 0x7fd604156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd609b80700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040cdcf0 0x7fd60409d8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8013000 tx=0x7fd5f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.528+0000 7fd6027fc700 1 -- 172.21.15.82:0/351965268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f801f070 con 0x7fd6040cdcf0 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.529+0000 7fd6027fc700 1 -- 172.21.15.82:0/351965268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8011420 con 0x7fd6040cdcf0 2023-10-06T03:15:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.529+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60409a480 con 0x7fd6040cdcf0 2023-10-06T03:15:50.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.529+0000 7fd6027fc700 1 -- 172.21.15.82:0/351965268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800bbe0 con 0x7fd6040cdcf0 2023-10-06T03:15:50.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.529+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60409aa40 con 0x7fd6040cdcf0 2023-10-06T03:15:50.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.530+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd604064050 con 0x7fd6040cdcf0 2023-10-06T03:15:50.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.530+0000 7fd6027fc700 1 -- 172.21.15.82:0/351965268 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5f8011a50 con 0x7fd6040cdcf0 2023-10-06T03:15:50.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.530+0000 7fd6027fc700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd5f0066f60 0x7fd5f0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:50.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.530+0000 7fd6027fc700 1 -- 172.21.15.82:0/351965268 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fd5f8085740 con 0x7fd6040cdcf0 2023-10-06T03:15:50.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.530+0000 7fd60a381700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd5f0066f60 0x7fd5f0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:50.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.531+0000 7fd60a381700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd5f0066f60 0x7fd5f0069410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0018f0 tx=0x7fd5fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:50.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.535+0000 7fd6027fc700 1 -- 172.21.15.82:0/351965268 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5f8052a30 con 0x7fd6040cdcf0 2023-10-06T03:15:50.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:50.718+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd60409aef0 con 0x7fd6040cdcf0 2023-10-06T03:15:51.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.383+0000 7fd6027fc700 1 -- 172.21.15.82:0/351965268 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd5f8056050 con 0x7fd6040cdcf0 2023-10-06T03:15:51.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.388+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd5f0066f60 msgr2=0x7fd5f0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:51.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.388+0000 7fd60c5e5700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd5f0066f60 0x7fd5f0069410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0018f0 tx=0x7fd5fc009040 comp rx=0 tx=0).stop 2023-10-06T03:15:51.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.388+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040cdcf0 msgr2=0x7fd60409d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:51.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.388+0000 7fd60c5e5700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040cdcf0 0x7fd60409d8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8013000 tx=0x7fd5f8017000 comp rx=0 tx=0).stop 2023-10-06T03:15:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.389+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 shutdown_connections 2023-10-06T03:15:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.389+0000 7fd60c5e5700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd604159890 0x7fd604069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.389+0000 7fd60c5e5700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd5f0066f60 0x7fd5f0069410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.389+0000 7fd60c5e5700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6040b1be0 0x7fd604156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.389+0000 7fd60c5e5700 1 --2- 172.21.15.82:0/351965268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6040cdcf0 0x7fd60409d8f0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8013000 tx=0x7fd5f8017000 comp rx=0 tx=0).stop 2023-10-06T03:15:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.389+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 >> 172.21.15.82:0/351965268 conn(0x7fd604099990 msgr2=0x7fd6040affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.390+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 shutdown_connections 2023-10-06T03:15:51.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.390+0000 7fd60c5e5700 1 -- 172.21.15.82:0/351965268 wait complete. 2023-10-06T03:15:51.401 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-10-06T03:15:51.410 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:15:51.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.526+0000 7fba9718d700 1 Processor -- start 2023-10-06T03:15:51.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.526+0000 7fba9718d700 1 -- start start 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.526+0000 7fba9718d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba90159500 0x7fba901598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.526+0000 7fba9718d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9015dab0 0x7fba900cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba9718d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900b1110 con 0x7fba900b3fd0 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba9718d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900b13b0 con 0x7fba90159500 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba9718d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900b1690 con 0x7fba9015dab0 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba94f29700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba90159500 0x7fba901598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba94f29700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba90159500 0x7fba901598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47532/0 (socket says 172.21.15.82:47532) 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba94f29700 1 -- 172.21.15.82:0/1588692889 learned_addr learned my addr 172.21.15.82:0/1588692889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba9572a700 1 --2- 172.21.15.82:0/1588692889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9015dab0 0x7fba900cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba94f29700 1 -- 172.21.15.82:0/1588692889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9015dab0 msgr2=0x7fba900cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba94f29700 1 --2- 172.21.15.82:0/1588692889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9015dab0 0x7fba900cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba94f29700 1 -- 172.21.15.82:0/1588692889 >> v1:172.21.15.134:6789/0 conn(0x7fba900b3fd0 legacy=0x7fba9015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba94f29700 1 -- 172.21.15.82:0/1588692889 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900b1970 con 0x7fba90159500 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba9572a700 1 --2- 172.21.15.82:0/1588692889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9015dab0 0x7fba900cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba94f29700 1 --2- 172.21.15.82:0/1588692889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba90159500 0x7fba901598d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009f20 tx=0x7fba8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655a7bd59987bc6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba877fe700 1 -- 172.21.15.82:0/1588692889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00e070 con 0x7fba90159500 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba877fe700 1 -- 172.21.15.82:0/1588692889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c00ba80 con 0x7fba90159500 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.527+0000 7fba877fe700 1 -- 172.21.15.82:0/1588692889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0092e0 con 0x7fba90159500 2023-10-06T03:15:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.528+0000 7fba9718d700 1 -- 172.21.15.82:0/1588692889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba90159500 msgr2=0x7fba901598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:51.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.528+0000 7fba9718d700 1 --2- 172.21.15.82:0/1588692889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba90159500 0x7fba901598d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009f20 tx=0x7fba8c009840 comp rx=0 tx=0).stop 2023-10-06T03:15:51.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.528+0000 7fba9718d700 1 -- 172.21.15.82:0/1588692889 shutdown_connections 2023-10-06T03:15:51.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.528+0000 7fba9718d700 1 --2- 172.21.15.82:0/1588692889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9015dab0 0x7fba900cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:51.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.528+0000 7fba9718d700 1 --2- 172.21.15.82:0/1588692889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba90159500 0x7fba901598d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:51.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.528+0000 7fba9718d700 1 -- 172.21.15.82:0/1588692889 >> 172.21.15.82:0/1588692889 conn(0x7fba90067630 msgr2=0x7fba90069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:51.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.528+0000 7fba9718d700 1 -- 172.21.15.82:0/1588692889 shutdown_connections 2023-10-06T03:15:51.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.528+0000 7fba9718d700 1 -- 172.21.15.82:0/1588692889 wait complete. 2023-10-06T03:15:51.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.529+0000 7fba9718d700 1 Processor -- start 2023-10-06T03:15:51.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.529+0000 7fba9718d700 1 -- start start 2023-10-06T03:15:51.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9718d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba900b3fd0 0x7fba9013e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:51.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9718d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba90159500 0x7fba90150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:51.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9718d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9015dab0 0x7fba9014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9718d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9013e6e0 con 0x7fba900b3fd0 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9718d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba901598d0 con 0x7fba9015dab0 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9718d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9015a730 con 0x7fba90159500 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba900b3fd0 0x7fba9013e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba900b3fd0 0x7fba9013e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47536/0 (socket says 172.21.15.82:47536) 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 -- 172.21.15.82:0/3663070104 learned_addr learned my addr 172.21.15.82:0/3663070104 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba87fff700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba90159500 0x7fba90150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9572a700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9015dab0 0x7fba9014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 -- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba90159500 msgr2=0x7fba90150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba90159500 0x7fba90150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 -- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9015dab0 msgr2=0x7fba9014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9015dab0 0x7fba9014f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 -- 172.21.15.82:0/3663070104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c009ae0 con 0x7fba900b3fd0 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba94f29700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba900b3fd0 0x7fba9013e1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00b6c0 tx=0x7fba8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba84ff9700 1 -- 172.21.15.82:0/3663070104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c008980 con 0x7fba900b3fd0 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba84ff9700 1 -- 172.21.15.82:0/3663070104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c008ae0 con 0x7fba900b3fd0 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba90159b20 con 0x7fba900b3fd0 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba84ff9700 1 -- 172.21.15.82:0/3663070104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c008ea0 con 0x7fba900b3fd0 2023-10-06T03:15:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.530+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9015a0e0 con 0x7fba900b3fd0 2023-10-06T03:15:51.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.531+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba90064050 con 0x7fba900b3fd0 2023-10-06T03:15:51.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.532+0000 7fba84ff9700 1 -- 172.21.15.82:0/3663070104 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba8c003040 con 0x7fba900b3fd0 2023-10-06T03:15:51.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.532+0000 7fba84ff9700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba7c066f30 0x7fba7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:51.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.532+0000 7fba84ff9700 1 -- 172.21.15.82:0/3663070104 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fba8c086350 con 0x7fba900b3fd0 2023-10-06T03:15:51.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.532+0000 7fba87fff700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba7c066f30 0x7fba7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:51.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.533+0000 7fba87fff700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba7c066f30 0x7fba7c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fba9014ce50 tx=0x7fba80007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:51.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.536+0000 7fba84ff9700 1 -- 172.21.15.82:0/3663070104 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba8c0534c0 con 0x7fba900b3fd0 2023-10-06T03:15:51.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:51.761+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fba900b4470 con 0x7fba900b3fd0 2023-10-06T03:15:52.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.398+0000 7fba84ff9700 1 -- 172.21.15.82:0/3663070104 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fba8c056ae0 con 0x7fba900b3fd0 2023-10-06T03:15:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba7c066f30 msgr2=0x7fba7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba7c066f30 0x7fba7c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fba9014ce50 tx=0x7fba80007ec0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba900b3fd0 msgr2=0x7fba9013e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba900b3fd0 0x7fba9013e1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00b6c0 tx=0x7fba8c018000 comp rx=0 tx=0).stop 2023-10-06T03:15:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 shutdown_connections 2023-10-06T03:15:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9015dab0 0x7fba9014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba900b3fd0 0x7fba9013e1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba7c066f30 0x7fba7c0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 --2- 172.21.15.82:0/3663070104 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba90159500 0x7fba90150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 >> 172.21.15.82:0/3663070104 conn(0x7fba90067630 msgr2=0x7fba9014d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 shutdown_connections 2023-10-06T03:15:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.403+0000 7fba9718d700 1 -- 172.21.15.82:0/3663070104 wait complete. 2023-10-06T03:15:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T03:15:52.422 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.535+0000 7fc01bdc7700 1 Processor -- start 2023-10-06T03:15:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.535+0000 7fc01bdc7700 1 -- start start 2023-10-06T03:15:52.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01bdc7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140cdc00 0x7fc0140cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01bdc7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0140c6dc0 0x7fc0140ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01bdc7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0140ae140 con 0x7fc0140d1030 2023-10-06T03:15:52.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01bdc7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140cc390 con 0x7fc0140c6dc0 2023-10-06T03:15:52.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01bdc7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140ad530 con 0x7fc0140cdc00 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01a364700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0140c6dc0 0x7fc0140ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01a364700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0140c6dc0 0x7fc0140ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47542/0 (socket says 172.21.15.82:47542) 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01a364700 1 -- 172.21.15.82:0/3951305064 learned_addr learned my addr 172.21.15.82:0/3951305064 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc019b63700 1 --2- 172.21.15.82:0/3951305064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140cdc00 0x7fc0140cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01a364700 1 -- 172.21.15.82:0/3951305064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140cdc00 msgr2=0x7fc0140cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01a364700 1 --2- 172.21.15.82:0/3951305064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140cdc00 0x7fc0140cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01a364700 1 -- 172.21.15.82:0/3951305064 >> v1:172.21.15.134:6789/0 conn(0x7fc0140d1030 legacy=0x7fc0140c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01a364700 1 -- 172.21.15.82:0/3951305064 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140ad810 con 0x7fc0140c6dc0 2023-10-06T03:15:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc01a364700 1 --2- 172.21.15.82:0/3951305064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140c6dc0 0x7fc0140ae5d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009f50 tx=0x7fc00c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30e4a8cb24acaae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc018b61700 1 -- 172.21.15.82:0/3951305064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00e070 con 0x7fc0140c6dc0 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc018b61700 1 -- 172.21.15.82:0/3951305064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00ba70 con 0x7fc0140c6dc0 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.536+0000 7fc018b61700 1 -- 172.21.15.82:0/3951305064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0092e0 con 0x7fc0140c6dc0 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.537+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3951305064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140c6dc0 msgr2=0x7fc0140ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.537+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3951305064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140c6dc0 0x7fc0140ae5d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009f50 tx=0x7fc00c009840 comp rx=0 tx=0).stop 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.537+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3951305064 shutdown_connections 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.537+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3951305064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140c6dc0 0x7fc0140ae5d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.537+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3951305064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140cdc00 0x7fc0140cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.537+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3951305064 >> 172.21.15.82:0/3951305064 conn(0x7fc014099990 msgr2=0x7fc0140b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.537+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3951305064 shutdown_connections 2023-10-06T03:15:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.537+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3951305064 wait complete. 2023-10-06T03:15:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.538+0000 7fc01bdc7700 1 Processor -- start 2023-10-06T03:15:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.538+0000 7fc01bdc7700 1 -- start start 2023-10-06T03:15:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc01bdc7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0140c6dc0 0x7fc014068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc01bdc7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140cdc00 0x7fc014068f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc01bdc7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140d1030 0x7fc014069490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc01bdc7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c99c0 con 0x7fc0140cdc00 2023-10-06T03:15:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc01bdc7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c9ca0 con 0x7fc0140c6dc0 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc01bdc7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c9f80 con 0x7fc0140d1030 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140cdc00 0x7fc014068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140cdc00 0x7fc014068f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47550/0 (socket says 172.21.15.82:47550) 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 -- 172.21.15.82:0/3619259706 learned_addr learned my addr 172.21.15.82:0/3619259706 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019b63700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0140c6dc0 0x7fc014068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc01a364700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140d1030 0x7fc014069490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 -- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140d1030 msgr2=0x7fc014069490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140d1030 0x7fc014069490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 -- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0140c6dc0 msgr2=0x7fc014068a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0140c6dc0 0x7fc014068a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 -- 172.21.15.82:0/3619259706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c009ae0 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.539+0000 7fc019362700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140cdc00 0x7fc014068f50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc00400c4e0 tx=0x7fc00400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.540+0000 7fc009ffb700 1 -- 172.21.15.82:0/3619259706 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004011590 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.540+0000 7fc009ffb700 1 -- 172.21.15.82:0/3619259706 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004011710 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.540+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140ca260 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.540+0000 7fc009ffb700 1 -- 172.21.15.82:0/3619259706 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004011ad0 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.540+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0140c9640 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.541+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc014068730 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.541+0000 7fc009ffb700 1 -- 172.21.15.82:0/3619259706 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc00401b3b0 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.541+0000 7fc009ffb700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbff8066f30 0x7fbff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.541+0000 7fc009ffb700 1 -- 172.21.15.82:0/3619259706 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc004083bd0 con 0x7fc0140cdc00 2023-10-06T03:15:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.542+0000 7fc019b63700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbff8066f30 0x7fbff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.542+0000 7fc019b63700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbff8066f30 0x7fbff80693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc010006aa0 tx=0x7fc010008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:52.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.546+0000 7fc009ffb700 1 -- 172.21.15.82:0/3619259706 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc014068730 con 0x7fc0140cdc00 2023-10-06T03:15:52.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.729+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc014068730 con 0x7fc0140cdc00 2023-10-06T03:15:52.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.730+0000 7fc009ffb700 1 -- 172.21.15.82:0/3619259706 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fc014068730 con 0x7fc0140cdc00 2023-10-06T03:15:52.732 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:52.732 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:51.763123+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:52.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbff8066f30 msgr2=0x7fbff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbff8066f30 0x7fbff80693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc010006aa0 tx=0x7fc010008040 comp rx=0 tx=0).stop 2023-10-06T03:15:52.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140cdc00 msgr2=0x7fc014068f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140cdc00 0x7fc014068f50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc00400c4e0 tx=0x7fc00400c8a0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 shutdown_connections 2023-10-06T03:15:52.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbff8066f30 0x7fbff80693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0140d1030 0x7fc014069490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0140c6dc0 0x7fc014068a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 --2- 172.21.15.82:0/3619259706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0140cdc00 0x7fc014068f50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 >> 172.21.15.82:0/3619259706 conn(0x7fc014099990 msgr2=0x7fc0140cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:52.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 shutdown_connections 2023-10-06T03:15:52.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.732+0000 7fc01bdc7700 1 -- 172.21.15.82:0/3619259706 wait complete. 2023-10-06T03:15:52.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.858+0000 7f1428811700 1 Processor -- start 2023-10-06T03:15:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.858+0000 7f1428811700 1 -- start start 2023-10-06T03:15:52.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1428811700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 0x7f14240d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1428811700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14241591b0 0x7f1424159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1428811700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14240b2ad0 con 0x7f142415d560 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1428811700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14240b4160 con 0x7f14241591b0 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1428811700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1424159b70 con 0x7f142415d930 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1422d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14241591b0 0x7f1424159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1422d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14241591b0 0x7f1424159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47554/0 (socket says 172.21.15.82:47554) 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1422d9d700 1 -- 172.21.15.82:0/2776641415 learned_addr learned my addr 172.21.15.82:0/2776641415 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1419d9b700 1 --2- 172.21.15.82:0/2776641415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 0x7f14240d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1422d9d700 1 -- 172.21.15.82:0/2776641415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 msgr2=0x7f14240d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1422d9d700 1 --2- 172.21.15.82:0/2776641415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 0x7f14240d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1422d9d700 1 -- 172.21.15.82:0/2776641415 >> v1:172.21.15.134:6789/0 conn(0x7f142415d560 legacy=0x7f14240b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.859+0000 7f1422d9d700 1 -- 172.21.15.82:0/2776641415 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14240b2230 con 0x7f14241591b0 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1422d9d700 1 --2- 172.21.15.82:0/2776641415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f1424159630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f141c009f20 tx=0x7f141c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4722313f8f170a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1421d9b700 1 -- 172.21.15.82:0/2776641415 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c00e070 con 0x7f14241591b0 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1421d9b700 1 -- 172.21.15.82:0/2776641415 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c00ba80 con 0x7f14241591b0 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1421d9b700 1 -- 172.21.15.82:0/2776641415 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0092e0 con 0x7f14241591b0 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1428811700 1 -- 172.21.15.82:0/2776641415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 msgr2=0x7f1424159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1428811700 1 --2- 172.21.15.82:0/2776641415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f1424159630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f141c009f20 tx=0x7f141c009840 comp rx=0 tx=0).stop 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1428811700 1 -- 172.21.15.82:0/2776641415 shutdown_connections 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1428811700 1 --2- 172.21.15.82:0/2776641415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f1424159630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1428811700 1 --2- 172.21.15.82:0/2776641415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 0x7f14240d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1428811700 1 -- 172.21.15.82:0/2776641415 >> 172.21.15.82:0/2776641415 conn(0x7f14240d1180 msgr2=0x7f1424069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1428811700 1 -- 172.21.15.82:0/2776641415 shutdown_connections 2023-10-06T03:15:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.860+0000 7f1428811700 1 -- 172.21.15.82:0/2776641415 wait complete. 2023-10-06T03:15:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f1428811700 1 Processor -- start 2023-10-06T03:15:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f1428811700 1 -- start start 2023-10-06T03:15:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f1428811700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f142416c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f1428811700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142415d560 0x7f142416a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f1428811700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 0x7f142416a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f1428811700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14240c6210 con 0x7f14241591b0 2023-10-06T03:15:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f1428811700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142415c0e0 con 0x7f142415d560 2023-10-06T03:15:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f1428811700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142416ca30 con 0x7f142415d930 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f142259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f142416c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f142259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f142416c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47560/0 (socket says 172.21.15.82:47560) 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.862+0000 7f142259c700 1 -- 172.21.15.82:0/3724449619 learned_addr learned my addr 172.21.15.82:0/3724449619 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f142259c700 1 -- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 msgr2=0x7f142416a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f142259c700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 0x7f142416a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f142259c700 1 -- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142415d560 msgr2=0x7f142416a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f142259c700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142415d560 0x7f142416a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f142259c700 1 -- 172.21.15.82:0/3724449619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c009ae0 con 0x7f14241591b0 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f142259c700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f142416c4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f141400c5c0 tx=0x7f141400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f141affd700 1 -- 172.21.15.82:0/3724449619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414011590 con 0x7f14241591b0 2023-10-06T03:15:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f141affd700 1 -- 172.21.15.82:0/3724449619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1414011710 con 0x7f14241591b0 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142415b4d0 con 0x7f14241591b0 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f141affd700 1 -- 172.21.15.82:0/3724449619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414011ad0 con 0x7f14241591b0 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.863+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142415ba90 con 0x7f14241591b0 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.864+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1424064050 con 0x7f14241591b0 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.864+0000 7f141affd700 1 -- 172.21.15.82:0/3724449619 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f141401b3b0 con 0x7f14241591b0 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.865+0000 7f141affd700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1404066f30 0x7f14040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.865+0000 7f141affd700 1 -- 172.21.15.82:0/3724449619 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1414083c30 con 0x7f14241591b0 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.865+0000 7f1419d9b700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1404066f30 0x7f14040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.865+0000 7f1419d9b700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1404066f30 0x7f14040693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1424158810 tx=0x7f140c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:52.869+0000 7f141affd700 1 -- 172.21.15.82:0/3724449619 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1414050d40 con 0x7f14241591b0 2023-10-06T03:15:53.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.054+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14240b2510 con 0x7f14241591b0 2023-10-06T03:15:53.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.055+0000 7f141affd700 1 -- 172.21.15.82:0/3724449619 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f1414017070 con 0x7f14241591b0 2023-10-06T03:15:53.057 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:53.057 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:51.763123+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1404066f30 msgr2=0x7f14040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1404066f30 0x7f14040693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1424158810 tx=0x7f140c008040 comp rx=0 tx=0).stop 2023-10-06T03:15:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 msgr2=0x7f142416c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f142416c4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f141400c5c0 tx=0x7f141400c980 comp rx=0 tx=0).stop 2023-10-06T03:15:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 shutdown_connections 2023-10-06T03:15:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1404066f30 0x7f14040693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142415d930 0x7f142416a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14241591b0 0x7f142416c4f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 --2- 172.21.15.82:0/3724449619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142415d560 0x7f142416a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 >> 172.21.15.82:0/3724449619 conn(0x7f14240d1180 msgr2=0x7f1424067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:53.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 shutdown_connections 2023-10-06T03:15:53.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.057+0000 7f1428811700 1 -- 172.21.15.82:0/3724449619 wait complete. 2023-10-06T03:15:53.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:15:53.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.185+0000 7f90da79f700 1 Processor -- start 2023-10-06T03:15:53.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.185+0000 7f90da79f700 1 -- start start 2023-10-06T03:15:53.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90da79f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90d406b470 0x7f90d415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90da79f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90da79f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40ae340 con 0x7f90d40c7f00 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90da79f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d415e290 con 0x7f90d406b470 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90da79f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40c8870 con 0x7f90d406f270 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90d3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90d406b470 0x7f90d415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90d3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90d406b470 0x7f90d415d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47562/0 (socket says 172.21.15.82:47562) 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90d3fff700 1 -- 172.21.15.82:0/4015190782 learned_addr learned my addr 172.21.15.82:0/4015190782 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.186+0000 7f90d37fe700 1 --2- 172.21.15.82:0/4015190782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90d3fff700 1 -- 172.21.15.82:0/4015190782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 msgr2=0x7f90d40c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90d3fff700 1 --2- 172.21.15.82:0/4015190782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90d3fff700 1 -- 172.21.15.82:0/4015190782 >> v1:172.21.15.134:6789/0 conn(0x7f90d40c7f00 legacy=0x7f90d40aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90d3fff700 1 -- 172.21.15.82:0/4015190782 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40c8340 con 0x7f90d406b470 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90d3fff700 1 --2- 172.21.15.82:0/4015190782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d406b470 0x7f90d415d2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90c40099b0 tx=0x7f90c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f2b50e96d07075 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90d2ffd700 1 -- 172.21.15.82:0/4015190782 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400b860 con 0x7f90d406b470 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90d2ffd700 1 -- 172.21.15.82:0/4015190782 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c400b9c0 con 0x7f90d406b470 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90d2ffd700 1 -- 172.21.15.82:0/4015190782 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400bd60 con 0x7f90d406b470 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90da79f700 1 -- 172.21.15.82:0/4015190782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d406b470 msgr2=0x7f90d415d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90da79f700 1 --2- 172.21.15.82:0/4015190782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d406b470 0x7f90d415d2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90c40099b0 tx=0x7f90c4009250 comp rx=0 tx=0).stop 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90da79f700 1 -- 172.21.15.82:0/4015190782 shutdown_connections 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90da79f700 1 --2- 172.21.15.82:0/4015190782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d406b470 0x7f90d415d2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90da79f700 1 --2- 172.21.15.82:0/4015190782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90da79f700 1 -- 172.21.15.82:0/4015190782 >> 172.21.15.82:0/4015190782 conn(0x7f90d406e760 msgr2=0x7f90d406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:53.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90da79f700 1 -- 172.21.15.82:0/4015190782 shutdown_connections 2023-10-06T03:15:53.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.187+0000 7f90da79f700 1 -- 172.21.15.82:0/4015190782 wait complete. 2023-10-06T03:15:53.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.188+0000 7f90da79f700 1 Processor -- start 2023-10-06T03:15:53.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.189+0000 7f90da79f700 1 -- start start 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.189+0000 7f90da79f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d406b470 0x7f90d4069780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.189+0000 7f90da79f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.189+0000 7f90da79f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d40c7f00 0x7f90d40c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.189+0000 7f90da79f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4069cc0 con 0x7f90d40c7f00 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.189+0000 7f90da79f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d41588c0 con 0x7f90d406b470 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.189+0000 7f90da79f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40c6630 con 0x7f90d406f270 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.189+0000 7f90d8d3c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d40c7f00 0x7f90d40c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d8d3c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d40c7f00 0x7f90d40c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47570/0 (socket says 172.21.15.82:47570) 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d8d3c700 1 -- 172.21.15.82:0/2664643790 learned_addr learned my addr 172.21.15.82:0/2664643790 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d3fff700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d406b470 0x7f90d4069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d37fe700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d8d3c700 1 -- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 msgr2=0x7f90d40c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d8d3c700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d8d3c700 1 -- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d406b470 msgr2=0x7f90d4069780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d8d3c700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d406b470 0x7f90d4069780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d8d3c700 1 -- 172.21.15.82:0/2664643790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c40094f0 con 0x7f90d40c7f00 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d37fe700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90d8d3c700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d40c7f00 0x7f90d40c6a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00c840 tx=0x7f90cc001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90bbfff700 1 -- 172.21.15.82:0/2664643790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc012630 con 0x7f90d40c7f00 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90bbfff700 1 -- 172.21.15.82:0/2664643790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc0127b0 con 0x7f90d40c7f00 2023-10-06T03:15:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d40c57f0 con 0x7f90d40c7f00 2023-10-06T03:15:53.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90bbfff700 1 -- 172.21.15.82:0/2664643790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc012b70 con 0x7f90d40c7f00 2023-10-06T03:15:53.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.190+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d40c5d90 con 0x7f90d40c7f00 2023-10-06T03:15:53.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.191+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d40b0140 con 0x7f90d40c7f00 2023-10-06T03:15:53.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.191+0000 7f90bbfff700 1 -- 172.21.15.82:0/2664643790 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90cc003030 con 0x7f90d40c7f00 2023-10-06T03:15:53.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.192+0000 7f90bbfff700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f90c0066f30 0x7f90c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:53.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.192+0000 7f90bbfff700 1 -- 172.21.15.82:0/2664643790 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f90cc084570 con 0x7f90d40c7f00 2023-10-06T03:15:53.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.192+0000 7f90d3fff700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f90c0066f30 0x7f90c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:53.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.193+0000 7f90d3fff700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f90c0066f30 0x7f90c00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90c40099b0 tx=0x7f90c4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:53.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.196+0000 7f90bbfff700 1 -- 172.21.15.82:0/2664643790 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90d40b0140 con 0x7f90d40c7f00 2023-10-06T03:15:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:53.426+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f90d40b0140 con 0x7f90d40c7f00 2023-10-06T03:15:54.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.399+0000 7f90bbfff700 1 -- 172.21.15.82:0/2664643790 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f90d40b0140 con 0x7f90d40c7f00 2023-10-06T03:15:54.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.401+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f90c0066f30 msgr2=0x7f90c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.401+0000 7f90da79f700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f90c0066f30 0x7f90c00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90c40099b0 tx=0x7f90c4017000 comp rx=0 tx=0).stop 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.401+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d40c7f00 msgr2=0x7f90d40c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.401+0000 7f90da79f700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d40c7f00 0x7f90d40c6a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00c840 tx=0x7f90cc001670 comp rx=0 tx=0).stop 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.402+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 shutdown_connections 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.402+0000 7f90da79f700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d40c7f00 0x7f90d40c6a90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.402+0000 7f90da79f700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90d406b470 0x7f90d4069780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.402+0000 7f90da79f700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f90c0066f30 0x7f90c00693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.402+0000 7f90da79f700 1 --2- 172.21.15.82:0/2664643790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90d406f270 0x7f90d40c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.402+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 >> 172.21.15.82:0/2664643790 conn(0x7f90d406e760 msgr2=0x7f90d415a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.402+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 shutdown_connections 2023-10-06T03:15:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.402+0000 7f90da79f700 1 -- 172.21.15.82:0/2664643790 wait complete. 2023-10-06T03:15:54.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:15:54.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.537+0000 7f4eb7c35700 1 Processor -- start 2023-10-06T03:15:54.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.537+0000 7f4eb7c35700 1 -- start start 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb7c35700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 0x7f4eb015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb7c35700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb015dd20 con 0x7f4eb015d8e0 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb7c35700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb00b1110 con 0x7f4eb0159500 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb7c35700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00b13b0 con 0x7f4eb01598d0 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb61d2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4eb015d8e0 0x7f4eb00cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52826/0 (socket says 172.21.15.82:52826) 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb61d2700 1 -- 172.21.15.82:0/955893190 learned_addr learned my addr 172.21.15.82:0/955893190 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb51d0700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 0x7f4eb015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549635293 0 0) 0x7f4eb015dd20 con 0x7f4eb015d8e0 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.538+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e9c003570 con 0x7f4eb015d8e0 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3194586445 0 0) 0x7f4e9c003570 con 0x7f4eb015d8e0 2023-10-06T03:15:54.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 msgr2=0x7f4eb015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 0x7f4eb015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 >> v1:172.21.15.134:6789/0 conn(0x7f4eb0159500 legacy=0x7f4eb00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb00b1690 con 0x7f4eb015d8e0 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f4ea80017f0 con 0x7f4eb015d8e0 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 >> v1:172.21.15.82:6789/0 conn(0x7f4eb015d8e0 legacy=0x7f4eb00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 0x7f4e9c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c003fd0 0x7f4e9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c004d50 0x7f4e9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00b13b0 con 0x7f4e9c003fd0 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c00bba0 con 0x7f4e9c004d50 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c00bd60 con 0x7f4eb01598d0 2023-10-06T03:15:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb51d0700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c003fd0 0x7f4e9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb59d1700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 0x7f4e9c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb61d2700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c004d50 0x7f4e9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb51d0700 1 -- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 msgr2=0x7f4e9c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb51d0700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 0x7f4e9c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb51d0700 1 -- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c004d50 msgr2=0x7f4e9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb51d0700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c004d50 0x7f4e9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb51d0700 1 -- 172.21.15.82:0/955893190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c003570 con 0x7f4e9c003fd0 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb59d1700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb01598d0 0x7f4e9c003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb51d0700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c003fd0 0x7f4e9c004810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009c00 tx=0x7f4ea00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df27695a2c51390d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000e710 con 0x7f4e9c003fd0 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000e870 con 0x7f4e9c003fd0 2023-10-06T03:15:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.539+0000 7f4eb49cf700 1 -- 172.21.15.82:0/955893190 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000ec30 con 0x7f4e9c003fd0 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.540+0000 7f4eb7c35700 1 -- 172.21.15.82:0/955893190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c003fd0 msgr2=0x7f4e9c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.540+0000 7f4eb7c35700 1 --2- 172.21.15.82:0/955893190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c003fd0 0x7f4e9c004810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009c00 tx=0x7f4ea00091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.540+0000 7f4eb61d2700 1 -- 172.21.15.82:0/955893190 reap_dead start 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.540+0000 7f4eb7c35700 1 -- 172.21.15.82:0/955893190 shutdown_connections 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.540+0000 7f4eb7c35700 1 -- 172.21.15.82:0/955893190 >> 172.21.15.82:0/955893190 conn(0x7f4eb0067630 msgr2=0x7f4eb0069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.540+0000 7f4eb7c35700 1 -- 172.21.15.82:0/955893190 shutdown_connections 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.540+0000 7f4eb7c35700 1 -- 172.21.15.82:0/955893190 wait complete. 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.541+0000 7f4eb7c35700 1 Processor -- start 2023-10-06T03:15:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.541+0000 7f4eb7c35700 1 -- start start 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb7c35700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c003fd0 0x7f4eb015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb7c35700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb014dcb0 0x7f4eb0169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb7c35700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb0069370 0x7f4eb015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb7c35700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb0069810 con 0x7f4eb014dcb0 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb7c35700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb015ebf0 con 0x7f4e9c003fd0 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb7c35700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb014e470 con 0x7f4eb0069370 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb014dcb0 0x7f4eb0169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb014dcb0 0x7f4eb0169910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47584/0 (socket says 172.21.15.82:47584) 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 -- 172.21.15.82:0/1652989918 learned_addr learned my addr 172.21.15.82:0/1652989918 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb59d1700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c003fd0 0x7f4eb015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:54.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb61d2700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb0069370 0x7f4eb015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 -- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb0069370 msgr2=0x7f4eb015bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb0069370 0x7f4eb015bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 -- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c003fd0 msgr2=0x7f4eb015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c003fd0 0x7f4eb015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 -- 172.21.15.82:0/1652989918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb015ada0 con 0x7f4eb014dcb0 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.542+0000 7f4eb51d0700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb014dcb0 0x7f4eb0169910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e4b0 tx=0x7f4ea001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.543+0000 7f4ea5ffb700 1 -- 172.21.15.82:0/1652989918 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0022070 con 0x7f4eb014dcb0 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.543+0000 7f4ea5ffb700 1 -- 172.21.15.82:0/1652989918 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000ebf0 con 0x7f4eb014dcb0 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.543+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb015b080 con 0x7f4eb014dcb0 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.543+0000 7f4ea5ffb700 1 -- 172.21.15.82:0/1652989918 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea001c680 con 0x7f4eb014dcb0 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.543+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb015e880 con 0x7f4eb014dcb0 2023-10-06T03:15:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.544+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb015ed80 con 0x7f4eb014dcb0 2023-10-06T03:15:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.544+0000 7f4ea5ffb700 1 -- 172.21.15.82:0/1652989918 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ea001ca30 con 0x7f4eb014dcb0 2023-10-06T03:15:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.545+0000 7f4ea5ffb700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4e94066f30 0x7f4e940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.545+0000 7f4ea5ffb700 1 -- 172.21.15.82:0/1652989918 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ea0085e70 con 0x7f4eb014dcb0 2023-10-06T03:15:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.545+0000 7f4eb59d1700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4e94066f30 0x7f4e940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.545+0000 7f4eb59d1700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4e94066f30 0x7f4e940693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4eac007fd0 tx=0x7f4eac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.549+0000 7f4ea5ffb700 1 -- 172.21.15.82:0/1652989918 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ea0053030 con 0x7f4eb014dcb0 2023-10-06T03:15:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:54.775+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4eb0069770 con 0x7f4eb014dcb0 2023-10-06T03:15:55.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.404+0000 7f4ea5ffb700 1 -- 172.21.15.82:0/1652989918 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4ea002b0c0 con 0x7f4eb014dcb0 2023-10-06T03:15:55.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4e94066f30 msgr2=0x7f4e940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4e94066f30 0x7f4e940693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4eac007fd0 tx=0x7f4eac009040 comp rx=0 tx=0).stop 2023-10-06T03:15:55.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb014dcb0 msgr2=0x7f4eb0169910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb014dcb0 0x7f4eb0169910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e4b0 tx=0x7f4ea001a000 comp rx=0 tx=0).stop 2023-10-06T03:15:55.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 shutdown_connections 2023-10-06T03:15:55.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4e94066f30 0x7f4e940693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eb0069370 0x7f4eb015bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c003fd0 0x7f4eb015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 --2- 172.21.15.82:0/1652989918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb014dcb0 0x7f4eb0169910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.406+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 >> 172.21.15.82:0/1652989918 conn(0x7f4eb0067630 msgr2=0x7f4eb0156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:55.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.407+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 shutdown_connections 2023-10-06T03:15:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.407+0000 7f4eb7c35700 1 -- 172.21.15.82:0/1652989918 wait complete. 2023-10-06T03:15:55.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:15:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.533+0000 7fd32e525700 1 Processor -- start 2023-10-06T03:15:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.533+0000 7fd32e525700 1 -- start start 2023-10-06T03:15:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32e525700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd32815d850 0x7fd3280b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32e525700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3280b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32e525700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd328069f70 con 0x7fd32815d480 2023-10-06T03:15:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32e525700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3280687c0 con 0x7fd32815d850 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32e525700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd328068aa0 con 0x7fd3280b6170 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32cd22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd32815d850 0x7fd3280b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32d523700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd32815d480 0x7fd328069860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52834/0 (socket says 172.21.15.82:52834) 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32d523700 1 -- 172.21.15.82:0/1078470325 learned_addr learned my addr 172.21.15.82:0/1078470325 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32dd24700 1 --2- 172.21.15.82:0/1078470325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3280b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32cd22700 1 -- 172.21.15.82:0/1078470325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 msgr2=0x7fd3280b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32cd22700 1 --2- 172.21.15.82:0/1078470325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3280b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32cd22700 1 -- 172.21.15.82:0/1078470325 >> v1:172.21.15.82:6789/0 conn(0x7fd32815d480 legacy=0x7fd328069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32cd22700 1 -- 172.21.15.82:0/1078470325 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328068d80 con 0x7fd32815d850 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd31ffff700 1 -- 172.21.15.82:0/1078470325 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325652466 0 0) 0x7fd328069f70 con 0x7fd32815d480 2023-10-06T03:15:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.534+0000 7fd32dd24700 1 --2- 172.21.15.82:0/1078470325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3280b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32cd22700 1 --2- 172.21.15.82:0/1078470325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280b5c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd3180098e0 tx=0x7fd3180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6525bbd18c3a7f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd31ffff700 1 -- 172.21.15.82:0/1078470325 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318009e80 con 0x7fd32815d850 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd31ffff700 1 -- 172.21.15.82:0/1078470325 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31800b860 con 0x7fd32815d850 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd31ffff700 1 -- 172.21.15.82:0/1078470325 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800bbe0 con 0x7fd32815d850 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32e525700 1 -- 172.21.15.82:0/1078470325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 msgr2=0x7fd3280b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32e525700 1 --2- 172.21.15.82:0/1078470325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280b5c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd3180098e0 tx=0x7fd3180091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32e525700 1 -- 172.21.15.82:0/1078470325 shutdown_connections 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32e525700 1 --2- 172.21.15.82:0/1078470325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3280b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32e525700 1 --2- 172.21.15.82:0/1078470325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280b5c30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32e525700 1 -- 172.21.15.82:0/1078470325 >> 172.21.15.82:0/1078470325 conn(0x7fd3280ccf80 msgr2=0x7fd3280cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32e525700 1 -- 172.21.15.82:0/1078470325 shutdown_connections 2023-10-06T03:15:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.535+0000 7fd32e525700 1 -- 172.21.15.82:0/1078470325 wait complete. 2023-10-06T03:15:55.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.536+0000 7fd32e525700 1 Processor -- start 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32e525700 1 -- start start 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32e525700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3281408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32e525700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32815d480 0x7fd3280c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32e525700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32e525700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280c6280 con 0x7fd32815d850 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32e525700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd328140df0 con 0x7fd32815d480 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32e525700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280c64d0 con 0x7fd3280b6170 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32dd24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32dd24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47606/0 (socket says 172.21.15.82:47606) 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.537+0000 7fd32dd24700 1 -- 172.21.15.82:0/1811088883 learned_addr learned my addr 172.21.15.82:0/1811088883 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32d523700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3281408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32cd22700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32815d480 0x7fd3280c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32dd24700 1 -- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 msgr2=0x7fd3281408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32dd24700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3281408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32dd24700 1 -- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32815d480 msgr2=0x7fd3280c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32dd24700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32815d480 0x7fd3280c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32dd24700 1 -- 172.21.15.82:0/1811088883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009420 con 0x7fd32815d850 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32cd22700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32815d480 0x7fd3280c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32d523700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3281408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32dd24700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280c7570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd32000d180 tx=0x7fd320009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd31d7fa700 1 -- 172.21.15.82:0/1811088883 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32000de20 con 0x7fd32815d850 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd31d7fa700 1 -- 172.21.15.82:0/1811088883 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32000f040 con 0x7fd32815d850 2023-10-06T03:15:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280c67b0 con 0x7fd32815d850 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd31d7fa700 1 -- 172.21.15.82:0/1811088883 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320015690 con 0x7fd32815d850 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.538+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3280c6df0 con 0x7fd32815d850 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.539+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32804c3c0 con 0x7fd32815d850 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.539+0000 7fd31d7fa700 1 -- 172.21.15.82:0/1811088883 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd32001e3b0 con 0x7fd32815d850 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.540+0000 7fd31d7fa700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd30c066f30 0x7fd30c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.540+0000 7fd31d7fa700 1 -- 172.21.15.82:0/1811088883 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd320084ca0 con 0x7fd32815d850 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.540+0000 7fd32d523700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd30c066f30 0x7fd30c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.540+0000 7fd32d523700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd30c066f30 0x7fd30c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd324001840 tx=0x7fd324009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:55.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.544+0000 7fd31d7fa700 1 -- 172.21.15.82:0/1811088883 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd320051db0 con 0x7fd32815d850 2023-10-06T03:15:55.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.772+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd328069060 con 0x7fd32815d850 2023-10-06T03:15:55.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.773+0000 7fd31d7fa700 1 -- 172.21.15.82:0/1811088883 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fd32001a090 con 0x7fd32815d850 2023-10-06T03:15:55.775 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:55.775 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:15:51.763473+0000","modified":"2023-10-06T03:15:55.399812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:15:55.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd30c066f30 msgr2=0x7fd30c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd30c066f30 0x7fd30c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd324001840 tx=0x7fd324009040 comp rx=0 tx=0).stop 2023-10-06T03:15:55.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 msgr2=0x7fd3280c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280c7570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd32000d180 tx=0x7fd320009a50 comp rx=0 tx=0).stop 2023-10-06T03:15:55.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 shutdown_connections 2023-10-06T03:15:55.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32815d850 0x7fd3280c7570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd30c066f30 0x7fd30c0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3280b6170 0x7fd3281408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 --2- 172.21.15.82:0/1811088883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd32815d480 0x7fd3280c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 >> 172.21.15.82:0/1811088883 conn(0x7fd3280ccf80 msgr2=0x7fd32815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 shutdown_connections 2023-10-06T03:15:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.775+0000 7fd32e525700 1 -- 172.21.15.82:0/1811088883 wait complete. 2023-10-06T03:15:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-10-06T03:15:55.789 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:55.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.900+0000 7f7d6a024700 1 Processor -- start 2023-10-06T03:15:55.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.900+0000 7f7d6a024700 1 -- start start 2023-10-06T03:15:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d6a024700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7d6415d560 0x7f7d640d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d6a024700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d641591b0 0x7f7d64159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d6a024700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d640b2ad0 con 0x7f7d6415d930 2023-10-06T03:15:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d6a024700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d640b4160 con 0x7f7d641591b0 2023-10-06T03:15:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d6a024700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d640b2230 con 0x7f7d6415d560 2023-10-06T03:15:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d63fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d641591b0 0x7f7d64159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d63fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d641591b0 0x7f7d64159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47618/0 (socket says 172.21.15.82:47618) 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d63fff700 1 -- 172.21.15.82:0/151675064 learned_addr learned my addr 172.21.15.82:0/151675064 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d637fe700 1 --2- 172.21.15.82:0/151675064 >> v2:172.21.15.134:3300/0 conn(0x7f7d6415d560 0x7f7d640d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d63fff700 1 -- 172.21.15.82:0/151675064 >> v2:172.21.15.134:3300/0 conn(0x7f7d6415d560 msgr2=0x7f7d640d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d63fff700 1 --2- 172.21.15.82:0/151675064 >> v2:172.21.15.134:3300/0 conn(0x7f7d6415d560 0x7f7d640d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d63fff700 1 -- 172.21.15.82:0/151675064 >> v1:172.21.15.134:6789/0 conn(0x7f7d6415d930 legacy=0x7f7d640b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d63fff700 1 -- 172.21.15.82:0/151675064 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d640b2510 con 0x7f7d641591b0 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.901+0000 7f7d63fff700 1 --2- 172.21.15.82:0/151675064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d641591b0 0x7f7d64159600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7d64071410 tx=0x7f7d5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49a4a1b88893b13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d627fc700 1 -- 172.21.15.82:0/151675064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c009e70 con 0x7f7d641591b0 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d627fc700 1 -- 172.21.15.82:0/151675064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c00b860 con 0x7f7d641591b0 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d627fc700 1 -- 172.21.15.82:0/151675064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00bc00 con 0x7f7d641591b0 2023-10-06T03:15:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d6a024700 1 -- 172.21.15.82:0/151675064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d641591b0 msgr2=0x7f7d64159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d6a024700 1 --2- 172.21.15.82:0/151675064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d641591b0 0x7f7d64159600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7d64071410 tx=0x7f7d5c009250 comp rx=0 tx=0).stop 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d6a024700 1 -- 172.21.15.82:0/151675064 shutdown_connections 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d6a024700 1 --2- 172.21.15.82:0/151675064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d641591b0 0x7f7d64159600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d6a024700 1 --2- 172.21.15.82:0/151675064 >> v2:172.21.15.134:3300/0 conn(0x7f7d6415d560 0x7f7d640d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d6a024700 1 -- 172.21.15.82:0/151675064 >> 172.21.15.82:0/151675064 conn(0x7f7d640d1180 msgr2=0x7f7d64069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d6a024700 1 -- 172.21.15.82:0/151675064 shutdown_connections 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.902+0000 7f7d6a024700 1 -- 172.21.15.82:0/151675064 wait complete. 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.903+0000 7f7d6a024700 1 Processor -- start 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.903+0000 7f7d6a024700 1 -- start start 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d6a024700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d641591b0 0x7f7d64147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d6a024700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d6415d560 0x7f7d640b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d6a024700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d6415d930 0x7f7d640b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d6a024700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d641477a0 con 0x7f7d6415d930 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d6a024700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64159af0 con 0x7f7d641591b0 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d6a024700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64159dd0 con 0x7f7d6415d560 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d63fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d6415d930 0x7f7d640b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d63fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d6415d930 0x7f7d640b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47630/0 (socket says 172.21.15.82:47630) 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d63fff700 1 -- 172.21.15.82:0/2247597333 learned_addr learned my addr 172.21.15.82:0/2247597333 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d637fe700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d641591b0 0x7f7d64147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d62ffd700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d6415d560 0x7f7d640b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d63fff700 1 -- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d6415d560 msgr2=0x7f7d640b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d63fff700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d6415d560 0x7f7d640b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d63fff700 1 -- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d641591b0 msgr2=0x7f7d64147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d63fff700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d641591b0 0x7f7d64147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d63fff700 1 -- 172.21.15.82:0/2247597333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0094f0 con 0x7f7d6415d930 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.905+0000 7f7d637fe700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d641591b0 0x7f7d64147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.904+0000 7f7d62ffd700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d6415d560 0x7f7d640b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.905+0000 7f7d63fff700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d6415d930 0x7f7d640b1070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009290 tx=0x7f7d5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.905+0000 7f7d4b7fe700 1 -- 172.21.15.82:0/2247597333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c011630 con 0x7f7d6415d930 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.905+0000 7f7d4b7fe700 1 -- 172.21.15.82:0/2247597333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c011790 con 0x7f7d6415d930 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.905+0000 7f7d4b7fe700 1 -- 172.21.15.82:0/2247597333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c011b50 con 0x7f7d6415d930 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.905+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6415a0b0 con 0x7f7d6415d930 2023-10-06T03:15:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.905+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d64154b70 con 0x7f7d6415d930 2023-10-06T03:15:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.906+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d64064050 con 0x7f7d6415d930 2023-10-06T03:15:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.906+0000 7f7d4b7fe700 1 -- 172.21.15.82:0/2247597333 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d5c0253f0 con 0x7f7d6415d930 2023-10-06T03:15:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.907+0000 7f7d4b7fe700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:55.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.907+0000 7f7d4b7fe700 1 -- 172.21.15.82:0/2247597333 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d5c0860b0 con 0x7f7d6415d930 2023-10-06T03:15:55.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.907+0000 7f7d637fe700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:55.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.907+0000 7f7d637fe700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d50066f30 0x7f7d500693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7d540076c0 tx=0x7f7d5400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:55.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:55.911+0000 7f7d4b7fe700 1 -- 172.21.15.82:0/2247597333 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d5c0531c0 con 0x7f7d6415d930 2023-10-06T03:15:56.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.095+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d640b27f0 con 0x7f7d6415d930 2023-10-06T03:15:56.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.096+0000 7f7d4b7fe700 1 -- 172.21.15.82:0/2247597333 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f7d5c0567e0 con 0x7f7d6415d930 2023-10-06T03:15:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:56.098 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d50066f30 msgr2=0x7f7d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d50066f30 0x7f7d500693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7d540076c0 tx=0x7f7d5400b040 comp rx=0 tx=0).stop 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d6415d930 msgr2=0x7f7d640b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d6415d930 0x7f7d640b1070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009290 tx=0x7f7d5c017000 comp rx=0 tx=0).stop 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 shutdown_connections 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d6415d930 0x7f7d640b1070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d641591b0 0x7f7d64147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 --2- 172.21.15.82:0/2247597333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d6415d560 0x7f7d640b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 >> 172.21.15.82:0/2247597333 conn(0x7f7d640d1180 msgr2=0x7f7d641580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 shutdown_connections 2023-10-06T03:15:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.098+0000 7f7d6a024700 1 -- 172.21.15.82:0/2247597333 wait complete. 2023-10-06T03:15:56.112 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:15:56.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:15:56.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.224+0000 7f4f98289700 1 Processor -- start 2023-10-06T03:15:56.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.224+0000 7f4f98289700 1 -- start start 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f98289700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f9015d560 0x7f4f900d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f98289700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f901591b0 0x7f4f90159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f98289700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f900b2ad0 con 0x7f4f9015d930 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f98289700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900b4160 con 0x7f4f901591b0 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f98289700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90159b70 con 0x7f4f9015d560 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f95824700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4f9015d930 0x7f4f900b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52836/0 (socket says 172.21.15.82:52836) 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f95824700 1 -- 172.21.15.82:0/3289440416 learned_addr learned my addr 172.21.15.82:0/3289440416 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f96826700 1 --2- 172.21.15.82:0/3289440416 >> v2:172.21.15.134:3300/0 conn(0x7f4f901591b0 0x7f4f90159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249858189 0 0) 0x7f4f900b2ad0 con 0x7f4f9015d930 2023-10-06T03:15:56.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f96025700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f9015d560 0x7f4f900d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.225+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f7c003570 con 0x7f4f9015d930 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3428986939 0 0) 0x7f4f7c003570 con 0x7f4f9015d930 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f9015d560 msgr2=0x7f4f900d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f9015d560 0x7f4f900d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 >> v2:172.21.15.134:3300/0 conn(0x7f4f901591b0 msgr2=0x7f4f90159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 --2- 172.21.15.82:0/3289440416 >> v2:172.21.15.134:3300/0 conn(0x7f4f901591b0 0x7f4f90159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900b2230 con 0x7f4f9015d930 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f4f80001470 con 0x7f4f9015d930 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 >> v1:172.21.15.82:6789/0 conn(0x7f4f9015d930 legacy=0x7f4f900b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f9015d560 0x7f4f7c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7c003fe0 0x7f4f7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f7c004d50 0x7f4f7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b4160 con 0x7f4f7c004d50 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90159b70 con 0x7f4f7c003fe0 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c00ba90 con 0x7f4f9015d560 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f96826700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f7c004d50 0x7f4f7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f96025700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f9015d560 0x7f4f7c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95824700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7c003fe0 0x7f4f7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f96826700 1 -- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f9015d560 msgr2=0x7f4f7c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f96826700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f9015d560 0x7f4f7c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f96826700 1 -- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7c003fe0 msgr2=0x7f4f7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:56.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f96826700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7c003fe0 0x7f4f7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f96826700 1 -- 172.21.15.82:0/3289440416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c003570 con 0x7f4f7c004d50 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f96826700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f7c004d50 0x7f4f7c0051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800e210 tx=0x7f4f8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4953b9090a0efb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800ea60 con 0x7f4f7c004d50 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8800f040 con 0x7f4f7c004d50 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.226+0000 7f4f95023700 1 -- 172.21.15.82:0/3289440416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800ee10 con 0x7f4f7c004d50 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.227+0000 7f4f98289700 1 -- 172.21.15.82:0/3289440416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f7c004d50 msgr2=0x7f4f7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.227+0000 7f4f98289700 1 --2- 172.21.15.82:0/3289440416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f7c004d50 0x7f4f7c0051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800e210 tx=0x7f4f8800b040 comp rx=0 tx=0).stop 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.227+0000 7f4f96826700 1 -- 172.21.15.82:0/3289440416 reap_dead start 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.227+0000 7f4f98289700 1 -- 172.21.15.82:0/3289440416 shutdown_connections 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.227+0000 7f4f98289700 1 -- 172.21.15.82:0/3289440416 >> 172.21.15.82:0/3289440416 conn(0x7f4f900d1180 msgr2=0x7f4f90069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.227+0000 7f4f98289700 1 -- 172.21.15.82:0/3289440416 shutdown_connections 2023-10-06T03:15:56.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.227+0000 7f4f98289700 1 -- 172.21.15.82:0/3289440416 wait complete. 2023-10-06T03:15:56.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.228+0000 7f4f98289700 1 Processor -- start 2023-10-06T03:15:56.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.228+0000 7f4f98289700 1 -- start start 2023-10-06T03:15:56.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f98289700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f7c004d50 0x7f4f9013a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f98289700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f9013fd80 0x7f4f9013cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f98289700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f9016ce40 0x7f4f90138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f98289700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9013b860 con 0x7f4f9013fd80 2023-10-06T03:15:56.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f98289700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9013a9f0 con 0x7f4f9016ce40 2023-10-06T03:15:56.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f98289700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9013af30 con 0x7f4f7c004d50 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f9013fd80 0x7f4f9013cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f9013fd80 0x7f4f9013cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47642/0 (socket says 172.21.15.82:47642) 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 -- 172.21.15.82:0/2279308195 learned_addr learned my addr 172.21.15.82:0/2279308195 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f96826700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f9016ce40 0x7f4f90138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f96025700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f7c004d50 0x7f4f9013a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 -- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f7c004d50 msgr2=0x7f4f9013a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f7c004d50 0x7f4f9013a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 -- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f9016ce40 msgr2=0x7f4f90138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f9016ce40 0x7f4f90138b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 -- 172.21.15.82:0/2279308195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9013b210 con 0x7f4f9013fd80 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f95824700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f9013fd80 0x7f4f9013cf40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f800073c0 tx=0x7f4f900d0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:56.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f867fc700 1 -- 172.21.15.82:0/2279308195 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80018030 con 0x7f4f9013fd80 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f867fc700 1 -- 172.21.15.82:0/2279308195 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000f8d0 con 0x7f4f9013fd80 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f867fc700 1 -- 172.21.15.82:0/2279308195 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000fc90 con 0x7f4f9013fd80 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9013b4f0 con 0x7f4f9013fd80 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.229+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9013d480 con 0x7f4f9013fd80 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.230+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9013b9d0 con 0x7f4f9013fd80 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.231+0000 7f4f867fc700 1 -- 172.21.15.82:0/2279308195 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f8001b070 con 0x7f4f9013fd80 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.231+0000 7f4f867fc700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.231+0000 7f4f867fc700 1 -- 172.21.15.82:0/2279308195 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f80019070 con 0x7f4f9013fd80 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.231+0000 7f4f96025700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.232+0000 7f4f96025700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4f74066f30 0x7f4f740693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c006f00 tx=0x7f4f8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:56.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.235+0000 7f4f867fc700 1 -- 172.21.15.82:0/2279308195 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f800516c0 con 0x7f4f9013fd80 2023-10-06T03:15:56.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.414+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f90064050 con 0x7f4f74066f30 2023-10-06T03:15:56.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.424+0000 7f4f867fc700 1 -- 172.21.15.82:0/2279308195 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286935 (secure 0 0 0) 0x7f4f90064050 con 0x7f4f74066f30 2023-10-06T03:15:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:56.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4f74066f30 msgr2=0x7f4f740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4f74066f30 0x7f4f740693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c006f00 tx=0x7f4f8c008040 comp rx=0 tx=0).stop 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f9013fd80 msgr2=0x7f4f9013cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f9013fd80 0x7f4f9013cf40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f800073c0 tx=0x7f4f900d0570 comp rx=0 tx=0).stop 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 shutdown_connections 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f9016ce40 0x7f4f90138b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f7c004d50 0x7f4f9013a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 --2- 172.21.15.82:0/2279308195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f9013fd80 0x7f4f9013cf40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 >> 172.21.15.82:0/2279308195 conn(0x7f4f900d1180 msgr2=0x7f4f900b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:56.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 shutdown_connections 2023-10-06T03:15:56.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.427+0000 7f4f98289700 1 -- 172.21.15.82:0/2279308195 wait complete. 2023-10-06T03:15:56.433 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:15:56.441 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-06T03:15:55.148518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381096,"kb_used_data":2792,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593624,"statfs":{"total":773094113280,"available":770655870976,"internally_reserved":0,"allocated":2859008,"data_stored":1765414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.772153"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405704+0000","last_change":"2023-10-06T03:15:52.401448+0000","last_active":"2023-10-06T03:15:52.405704+0000","last_peered":"2023-10-06T03:15:52.405704+0000","last_clean":"2023-10-06T03:15:52.405704+0000","last_became_active":"2023-10-06T03:15:52.401163+0000","last_became_peered":"2023-10-06T03:15:52.401163+0000","last_unstale":"2023-10-06T03:15:52.405704+0000","last_undegraded":"2023-10-06T03:15:52.405704+0000","last_fullsized":"2023-10-06T03:15:52.405704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:12.727676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407826+0000","last_change":"2023-10-06T03:15:52.400840+0000","last_active":"2023-10-06T03:15:52.407826+0000","last_peered":"2023-10-06T03:15:52.407826+0000","last_clean":"2023-10-06T03:15:52.407826+0000","last_became_active":"2023-10-06T03:15:52.400551+0000","last_became_peered":"2023-10-06T03:15:52.400551+0000","last_unstale":"2023-10-06T03:15:52.407826+0000","last_undegraded":"2023-10-06T03:15:52.407826+0000","last_fullsized":"2023-10-06T03:15:52.407826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403045+0000","last_change":"2023-10-06T03:15:52.397230+0000","last_active":"2023-10-06T03:15:52.403045+0000","last_peered":"2023-10-06T03:15:52.403045+0000","last_clean":"2023-10-06T03:15:52.403045+0000","last_became_active":"2023-10-06T03:15:52.396958+0000","last_became_peered":"2023-10-06T03:15:52.396958+0000","last_unstale":"2023-10-06T03:15:52.403045+0000","last_undegraded":"2023-10-06T03:15:52.403045+0000","last_fullsized":"2023-10-06T03:15:52.403045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:36.699116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408300+0000","last_change":"2023-10-06T03:15:52.402222+0000","last_active":"2023-10-06T03:15:52.408300+0000","last_peered":"2023-10-06T03:15:52.408300+0000","last_clean":"2023-10-06T03:15:52.408300+0000","last_became_active":"2023-10-06T03:15:52.401929+0000","last_became_peered":"2023-10-06T03:15:52.401929+0000","last_unstale":"2023-10-06T03:15:52.408300+0000","last_undegraded":"2023-10-06T03:15:52.408300+0000","last_fullsized":"2023-10-06T03:15:52.408300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:27.381001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409687+0000","last_change":"2023-10-06T03:15:52.402998+0000","last_active":"2023-10-06T03:15:52.409687+0000","last_peered":"2023-10-06T03:15:52.409687+0000","last_clean":"2023-10-06T03:15:52.409687+0000","last_became_active":"2023-10-06T03:15:52.402744+0000","last_became_peered":"2023-10-06T03:15:52.402744+0000","last_unstale":"2023-10-06T03:15:52.409687+0000","last_undegraded":"2023-10-06T03:15:52.409687+0000","last_fullsized":"2023-10-06T03:15:52.409687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407765+0000","last_change":"2023-10-06T03:15:52.400543+0000","last_active":"2023-10-06T03:15:52.407765+0000","last_peered":"2023-10-06T03:15:52.407765+0000","last_clean":"2023-10-06T03:15:52.407765+0000","last_became_active":"2023-10-06T03:15:52.400234+0000","last_became_peered":"2023-10-06T03:15:52.400234+0000","last_unstale":"2023-10-06T03:15:52.407765+0000","last_undegraded":"2023-10-06T03:15:52.407765+0000","last_fullsized":"2023-10-06T03:15:52.407765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:22.091211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415196+0000","last_change":"2023-10-06T03:15:52.411636+0000","last_active":"2023-10-06T03:15:52.415196+0000","last_peered":"2023-10-06T03:15:52.415196+0000","last_clean":"2023-10-06T03:15:52.415196+0000","last_became_active":"2023-10-06T03:15:52.410475+0000","last_became_peered":"2023-10-06T03:15:52.410475+0000","last_unstale":"2023-10-06T03:15:52.415196+0000","last_undegraded":"2023-10-06T03:15:52.415196+0000","last_fullsized":"2023-10-06T03:15:52.415196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395701+0000","last_change":"2023-10-06T03:15:52.391661+0000","last_active":"2023-10-06T03:15:52.395701+0000","last_peered":"2023-10-06T03:15:52.395701+0000","last_clean":"2023-10-06T03:15:52.395701+0000","last_became_active":"2023-10-06T03:15:52.390749+0000","last_became_peered":"2023-10-06T03:15:52.390749+0000","last_unstale":"2023-10-06T03:15:52.395701+0000","last_undegraded":"2023-10-06T03:15:52.395701+0000","last_fullsized":"2023-10-06T03:15:52.395701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409753+0000","last_change":"2023-10-06T03:15:52.403195+0000","last_active":"2023-10-06T03:15:52.409753+0000","last_peered":"2023-10-06T03:15:52.409753+0000","last_clean":"2023-10-06T03:15:52.409753+0000","last_became_active":"2023-10-06T03:15:52.402869+0000","last_became_peered":"2023-10-06T03:15:52.402869+0000","last_unstale":"2023-10-06T03:15:52.409753+0000","last_undegraded":"2023-10-06T03:15:52.409753+0000","last_fullsized":"2023-10-06T03:15:52.409753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:35.985027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.401152+0000","last_change":"2023-10-06T03:15:52.395407+0000","last_active":"2023-10-06T03:15:52.401152+0000","last_peered":"2023-10-06T03:15:52.401152+0000","last_clean":"2023-10-06T03:15:52.401152+0000","last_became_active":"2023-10-06T03:15:52.395152+0000","last_became_peered":"2023-10-06T03:15:52.395152+0000","last_unstale":"2023-10-06T03:15:52.401152+0000","last_undegraded":"2023-10-06T03:15:52.401152+0000","last_fullsized":"2023-10-06T03:15:52.401152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407807+0000","last_change":"2023-10-06T03:15:52.399379+0000","last_active":"2023-10-06T03:15:52.407807+0000","last_peered":"2023-10-06T03:15:52.407807+0000","last_clean":"2023-10-06T03:15:52.407807+0000","last_became_active":"2023-10-06T03:15:52.399116+0000","last_became_peered":"2023-10-06T03:15:52.399116+0000","last_unstale":"2023-10-06T03:15:52.407807+0000","last_undegraded":"2023-10-06T03:15:52.407807+0000","last_fullsized":"2023-10-06T03:15:52.407807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:24.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404234+0000","last_change":"2023-10-06T03:15:52.398110+0000","last_active":"2023-10-06T03:15:52.404234+0000","last_peered":"2023-10-06T03:15:52.404234+0000","last_clean":"2023-10-06T03:15:52.404234+0000","last_became_active":"2023-10-06T03:15:52.397691+0000","last_became_peered":"2023-10-06T03:15:52.397691+0000","last_unstale":"2023-10-06T03:15:52.404234+0000","last_undegraded":"2023-10-06T03:15:52.404234+0000","last_fullsized":"2023-10-06T03:15:52.404234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:20.541949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405781+0000","last_change":"2023-10-06T03:15:52.401787+0000","last_active":"2023-10-06T03:15:52.405781+0000","last_peered":"2023-10-06T03:15:52.405781+0000","last_clean":"2023-10-06T03:15:52.405781+0000","last_became_active":"2023-10-06T03:15:52.400804+0000","last_became_peered":"2023-10-06T03:15:52.400804+0000","last_unstale":"2023-10-06T03:15:52.405781+0000","last_undegraded":"2023-10-06T03:15:52.405781+0000","last_fullsized":"2023-10-06T03:15:52.405781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:00.679276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402120+0000","last_change":"2023-10-06T03:15:52.396439+0000","last_active":"2023-10-06T03:15:52.402120+0000","last_peered":"2023-10-06T03:15:52.402120+0000","last_clean":"2023-10-06T03:15:52.402120+0000","last_became_active":"2023-10-06T03:15:52.396218+0000","last_became_peered":"2023-10-06T03:15:52.396218+0000","last_unstale":"2023-10-06T03:15:52.402120+0000","last_undegraded":"2023-10-06T03:15:52.402120+0000","last_fullsized":"2023-10-06T03:15:52.402120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413375+0000","last_change":"2023-10-06T03:15:52.401847+0000","last_active":"2023-10-06T03:15:52.413375+0000","last_peered":"2023-10-06T03:15:52.413375+0000","last_clean":"2023-10-06T03:15:52.413375+0000","last_became_active":"2023-10-06T03:15:52.401531+0000","last_became_peered":"2023-10-06T03:15:52.401531+0000","last_unstale":"2023-10-06T03:15:52.413375+0000","last_undegraded":"2023-10-06T03:15:52.413375+0000","last_fullsized":"2023-10-06T03:15:52.413375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.398194+0000","last_change":"2023-10-06T03:15:52.394021+0000","last_active":"2023-10-06T03:15:52.398194+0000","last_peered":"2023-10-06T03:15:52.398194+0000","last_clean":"2023-10-06T03:15:52.398194+0000","last_became_active":"2023-10-06T03:15:52.393712+0000","last_became_peered":"2023-10-06T03:15:52.393712+0000","last_unstale":"2023-10-06T03:15:52.398194+0000","last_undegraded":"2023-10-06T03:15:52.398194+0000","last_fullsized":"2023-10-06T03:15:52.398194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:10.769614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409766+0000","last_change":"2023-10-06T03:15:52.404215+0000","last_active":"2023-10-06T03:15:52.409766+0000","last_peered":"2023-10-06T03:15:52.409766+0000","last_clean":"2023-10-06T03:15:52.409766+0000","last_became_active":"2023-10-06T03:15:52.403876+0000","last_became_peered":"2023-10-06T03:15:52.403876+0000","last_unstale":"2023-10-06T03:15:52.409766+0000","last_undegraded":"2023-10-06T03:15:52.409766+0000","last_fullsized":"2023-10-06T03:15:52.409766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407690+0000","last_change":"2023-10-06T03:15:52.397291+0000","last_active":"2023-10-06T03:15:52.407690+0000","last_peered":"2023-10-06T03:15:52.407690+0000","last_clean":"2023-10-06T03:15:52.407690+0000","last_became_active":"2023-10-06T03:15:52.397010+0000","last_became_peered":"2023-10-06T03:15:52.397010+0000","last_unstale":"2023-10-06T03:15:52.407690+0000","last_undegraded":"2023-10-06T03:15:52.407690+0000","last_fullsized":"2023-10-06T03:15:52.407690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409687+0000","last_change":"2023-10-06T03:15:52.403844+0000","last_active":"2023-10-06T03:15:52.409687+0000","last_peered":"2023-10-06T03:15:52.409687+0000","last_clean":"2023-10-06T03:15:52.409687+0000","last_became_active":"2023-10-06T03:15:52.403593+0000","last_became_peered":"2023-10-06T03:15:52.403593+0000","last_unstale":"2023-10-06T03:15:52.409687+0000","last_undegraded":"2023-10-06T03:15:52.409687+0000","last_fullsized":"2023-10-06T03:15:52.409687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:23.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408446+0000","last_change":"2023-10-06T03:15:52.404280+0000","last_active":"2023-10-06T03:15:52.408446+0000","last_peered":"2023-10-06T03:15:52.408446+0000","last_clean":"2023-10-06T03:15:52.408446+0000","last_became_active":"2023-10-06T03:15:52.403932+0000","last_became_peered":"2023-10-06T03:15:52.403932+0000","last_unstale":"2023-10-06T03:15:52.408446+0000","last_undegraded":"2023-10-06T03:15:52.408446+0000","last_fullsized":"2023-10-06T03:15:52.408446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415370+0000","last_change":"2023-10-06T03:15:52.412076+0000","last_active":"2023-10-06T03:15:52.415370+0000","last_peered":"2023-10-06T03:15:52.415370+0000","last_clean":"2023-10-06T03:15:52.415370+0000","last_became_active":"2023-10-06T03:15:52.410526+0000","last_became_peered":"2023-10-06T03:15:52.410526+0000","last_unstale":"2023-10-06T03:15:52.415370+0000","last_undegraded":"2023-10-06T03:15:52.415370+0000","last_fullsized":"2023-10-06T03:15:52.415370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404668+0000","last_change":"2023-10-06T03:15:52.399635+0000","last_active":"2023-10-06T03:15:52.404668+0000","last_peered":"2023-10-06T03:15:52.404668+0000","last_clean":"2023-10-06T03:15:52.404668+0000","last_became_active":"2023-10-06T03:15:52.399371+0000","last_became_peered":"2023-10-06T03:15:52.399371+0000","last_unstale":"2023-10-06T03:15:52.404668+0000","last_undegraded":"2023-10-06T03:15:52.404668+0000","last_fullsized":"2023-10-06T03:15:52.404668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404276+0000","last_change":"2023-10-06T03:15:52.401220+0000","last_active":"2023-10-06T03:15:52.404276+0000","last_peered":"2023-10-06T03:15:52.404276+0000","last_clean":"2023-10-06T03:15:52.404276+0000","last_became_active":"2023-10-06T03:15:52.400120+0000","last_became_peered":"2023-10-06T03:15:52.400120+0000","last_unstale":"2023-10-06T03:15:52.404276+0000","last_undegraded":"2023-10-06T03:15:52.404276+0000","last_fullsized":"2023-10-06T03:15:52.404276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413306+0000","last_change":"2023-10-06T03:15:52.401474+0000","last_active":"2023-10-06T03:15:52.413306+0000","last_peered":"2023-10-06T03:15:52.413306+0000","last_clean":"2023-10-06T03:15:52.413306+0000","last_became_active":"2023-10-06T03:15:52.401210+0000","last_became_peered":"2023-10-06T03:15:52.401210+0000","last_unstale":"2023-10-06T03:15:52.413306+0000","last_undegraded":"2023-10-06T03:15:52.413306+0000","last_fullsized":"2023-10-06T03:15:52.413306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409165+0000","last_change":"2023-10-06T03:15:52.402928+0000","last_active":"2023-10-06T03:15:52.409165+0000","last_peered":"2023-10-06T03:15:52.409165+0000","last_clean":"2023-10-06T03:15:52.409165+0000","last_became_active":"2023-10-06T03:15:52.402659+0000","last_became_peered":"2023-10-06T03:15:52.402659+0000","last_unstale":"2023-10-06T03:15:52.409165+0000","last_undegraded":"2023-10-06T03:15:52.409165+0000","last_fullsized":"2023-10-06T03:15:52.409165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:27.381001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405592+0000","last_change":"2023-10-06T03:15:52.398134+0000","last_active":"2023-10-06T03:15:52.405592+0000","last_peered":"2023-10-06T03:15:52.405592+0000","last_clean":"2023-10-06T03:15:52.405592+0000","last_became_active":"2023-10-06T03:15:52.397881+0000","last_became_peered":"2023-10-06T03:15:52.397881+0000","last_unstale":"2023-10-06T03:15:52.405592+0000","last_undegraded":"2023-10-06T03:15:52.405592+0000","last_fullsized":"2023-10-06T03:15:52.405592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:30.488004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412503+0000","last_change":"2023-10-06T03:15:52.403876+0000","last_active":"2023-10-06T03:15:52.412503+0000","last_peered":"2023-10-06T03:15:52.412503+0000","last_clean":"2023-10-06T03:15:52.412503+0000","last_became_active":"2023-10-06T03:15:52.403598+0000","last_became_peered":"2023-10-06T03:15:52.403598+0000","last_unstale":"2023-10-06T03:15:52.412503+0000","last_undegraded":"2023-10-06T03:15:52.412503+0000","last_fullsized":"2023-10-06T03:15:52.412503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413297+0000","last_change":"2023-10-06T03:15:51.399470+0000","last_active":"2023-10-06T03:15:52.413297+0000","last_peered":"2023-10-06T03:15:52.413297+0000","last_clean":"2023-10-06T03:15:52.413297+0000","last_became_active":"2023-10-06T03:15:51.399099+0000","last_became_peered":"2023-10-06T03:15:51.399099+0000","last_unstale":"2023-10-06T03:15:52.413297+0000","last_undegraded":"2023-10-06T03:15:52.413297+0000","last_fullsized":"2023-10-06T03:15:52.413297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403880+0000","last_change":"2023-10-06T03:15:52.400465+0000","last_active":"2023-10-06T03:15:52.403880+0000","last_peered":"2023-10-06T03:15:52.403880+0000","last_clean":"2023-10-06T03:15:52.403880+0000","last_became_active":"2023-10-06T03:15:52.400175+0000","last_became_peered":"2023-10-06T03:15:52.400175+0000","last_unstale":"2023-10-06T03:15:52.403880+0000","last_undegraded":"2023-10-06T03:15:52.403880+0000","last_fullsized":"2023-10-06T03:15:52.403880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:35.985027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396234+0000","last_change":"2023-10-06T03:15:51.401117+0000","last_active":"2023-10-06T03:15:52.396234+0000","last_peered":"2023-10-06T03:15:52.396234+0000","last_clean":"2023-10-06T03:15:52.396234+0000","last_became_active":"2023-10-06T03:15:51.400839+0000","last_became_peered":"2023-10-06T03:15:51.400839+0000","last_unstale":"2023-10-06T03:15:52.396234+0000","last_undegraded":"2023-10-06T03:15:52.396234+0000","last_fullsized":"2023-10-06T03:15:52.396234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:36.643445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404590+0000","last_change":"2023-10-06T03:15:52.398565+0000","last_active":"2023-10-06T03:15:52.404590+0000","last_peered":"2023-10-06T03:15:52.404590+0000","last_clean":"2023-10-06T03:15:52.404590+0000","last_became_active":"2023-10-06T03:15:52.398307+0000","last_became_peered":"2023-10-06T03:15:52.398307+0000","last_unstale":"2023-10-06T03:15:52.404590+0000","last_undegraded":"2023-10-06T03:15:52.404590+0000","last_fullsized":"2023-10-06T03:15:52.404590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.391829+0000","last_change":"2023-10-06T03:15:51.398624+0000","last_active":"2023-10-06T03:15:52.391829+0000","last_peered":"2023-10-06T03:15:52.391829+0000","last_clean":"2023-10-06T03:15:52.391829+0000","last_became_active":"2023-10-06T03:15:51.398391+0000","last_became_peered":"2023-10-06T03:15:51.398391+0000","last_unstale":"2023-10-06T03:15:52.391829+0000","last_undegraded":"2023-10-06T03:15:52.391829+0000","last_fullsized":"2023-10-06T03:15:52.391829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407778+0000","last_change":"2023-10-06T03:15:52.401764+0000","last_active":"2023-10-06T03:15:52.407778+0000","last_peered":"2023-10-06T03:15:52.407778+0000","last_clean":"2023-10-06T03:15:52.407778+0000","last_became_active":"2023-10-06T03:15:52.401456+0000","last_became_peered":"2023-10-06T03:15:52.401456+0000","last_unstale":"2023-10-06T03:15:52.407778+0000","last_undegraded":"2023-10-06T03:15:52.407778+0000","last_fullsized":"2023-10-06T03:15:52.407778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:31.512733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.386122+0000","last_change":"2023-10-06T03:15:51.397770+0000","last_active":"2023-10-06T03:15:52.386122+0000","last_peered":"2023-10-06T03:15:52.386122+0000","last_clean":"2023-10-06T03:15:52.386122+0000","last_became_active":"2023-10-06T03:15:51.396623+0000","last_became_peered":"2023-10-06T03:15:51.396623+0000","last_unstale":"2023-10-06T03:15:52.386122+0000","last_undegraded":"2023-10-06T03:15:52.386122+0000","last_fullsized":"2023-10-06T03:15:52.386122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.401114+0000","last_change":"2023-10-06T03:15:52.399019+0000","last_active":"2023-10-06T03:15:52.401114+0000","last_peered":"2023-10-06T03:15:52.401114+0000","last_clean":"2023-10-06T03:15:52.401114+0000","last_became_active":"2023-10-06T03:15:52.398286+0000","last_became_peered":"2023-10-06T03:15:52.398286+0000","last_unstale":"2023-10-06T03:15:52.401114+0000","last_undegraded":"2023-10-06T03:15:52.401114+0000","last_fullsized":"2023-10-06T03:15:52.401114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:48.612711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388731+0000","last_change":"2023-10-06T03:15:51.397296+0000","last_active":"2023-10-06T03:15:52.388731+0000","last_peered":"2023-10-06T03:15:52.388731+0000","last_clean":"2023-10-06T03:15:52.388731+0000","last_became_active":"2023-10-06T03:15:51.397042+0000","last_became_peered":"2023-10-06T03:15:51.397042+0000","last_unstale":"2023-10-06T03:15:52.388731+0000","last_undegraded":"2023-10-06T03:15:52.388731+0000","last_fullsized":"2023-10-06T03:15:52.388731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412296+0000","last_change":"2023-10-06T03:15:52.407501+0000","last_active":"2023-10-06T03:15:52.412296+0000","last_peered":"2023-10-06T03:15:52.412296+0000","last_clean":"2023-10-06T03:15:52.412296+0000","last_became_active":"2023-10-06T03:15:52.407276+0000","last_became_peered":"2023-10-06T03:15:52.407276+0000","last_unstale":"2023-10-06T03:15:52.412296+0000","last_undegraded":"2023-10-06T03:15:52.412296+0000","last_fullsized":"2023-10-06T03:15:52.412296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418342+0000","last_change":"2023-10-06T03:15:51.401981+0000","last_active":"2023-10-06T03:15:52.418342+0000","last_peered":"2023-10-06T03:15:52.418342+0000","last_clean":"2023-10-06T03:15:52.418342+0000","last_became_active":"2023-10-06T03:15:51.401737+0000","last_became_peered":"2023-10-06T03:15:51.401737+0000","last_unstale":"2023-10-06T03:15:52.418342+0000","last_undegraded":"2023-10-06T03:15:52.418342+0000","last_fullsized":"2023-10-06T03:15:52.418342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409103+0000","last_change":"2023-10-06T03:15:52.402215+0000","last_active":"2023-10-06T03:15:52.409103+0000","last_peered":"2023-10-06T03:15:52.409103+0000","last_clean":"2023-10-06T03:15:52.409103+0000","last_became_active":"2023-10-06T03:15:52.401984+0000","last_became_peered":"2023-10-06T03:15:52.401984+0000","last_unstale":"2023-10-06T03:15:52.409103+0000","last_undegraded":"2023-10-06T03:15:52.409103+0000","last_fullsized":"2023-10-06T03:15:52.409103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.420512+0000","last_change":"2023-10-06T03:15:51.398687+0000","last_active":"2023-10-06T03:15:52.420512+0000","last_peered":"2023-10-06T03:15:52.420512+0000","last_clean":"2023-10-06T03:15:52.420512+0000","last_became_active":"2023-10-06T03:15:51.398419+0000","last_became_peered":"2023-10-06T03:15:51.398419+0000","last_unstale":"2023-10-06T03:15:52.420512+0000","last_undegraded":"2023-10-06T03:15:52.420512+0000","last_fullsized":"2023-10-06T03:15:52.420512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408183+0000","last_change":"2023-10-06T03:15:52.404174+0000","last_active":"2023-10-06T03:15:52.408183+0000","last_peered":"2023-10-06T03:15:52.408183+0000","last_clean":"2023-10-06T03:15:52.408183+0000","last_became_active":"2023-10-06T03:15:52.403892+0000","last_became_peered":"2023-10-06T03:15:52.403892+0000","last_unstale":"2023-10-06T03:15:52.408183+0000","last_undegraded":"2023-10-06T03:15:52.408183+0000","last_fullsized":"2023-10-06T03:15:52.408183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:48.612711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418455+0000","last_change":"2023-10-06T03:15:51.399272+0000","last_active":"2023-10-06T03:15:52.418455+0000","last_peered":"2023-10-06T03:15:52.418455+0000","last_clean":"2023-10-06T03:15:52.418455+0000","last_became_active":"2023-10-06T03:15:51.398980+0000","last_became_peered":"2023-10-06T03:15:51.398980+0000","last_unstale":"2023-10-06T03:15:52.418455+0000","last_undegraded":"2023-10-06T03:15:52.418455+0000","last_fullsized":"2023-10-06T03:15:52.418455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:30.507247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403724+0000","last_change":"2023-10-06T03:15:52.400547+0000","last_active":"2023-10-06T03:15:52.403724+0000","last_peered":"2023-10-06T03:15:52.403724+0000","last_clean":"2023-10-06T03:15:52.403724+0000","last_became_active":"2023-10-06T03:15:52.400318+0000","last_became_peered":"2023-10-06T03:15:52.400318+0000","last_unstale":"2023-10-06T03:15:52.403724+0000","last_undegraded":"2023-10-06T03:15:52.403724+0000","last_fullsized":"2023-10-06T03:15:52.403724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:04.891285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385392+0000","last_change":"2023-10-06T03:15:51.397316+0000","last_active":"2023-10-06T03:15:52.385392+0000","last_peered":"2023-10-06T03:15:52.385392+0000","last_clean":"2023-10-06T03:15:52.385392+0000","last_became_active":"2023-10-06T03:15:51.397057+0000","last_became_peered":"2023-10-06T03:15:51.397057+0000","last_unstale":"2023-10-06T03:15:52.385392+0000","last_undegraded":"2023-10-06T03:15:52.385392+0000","last_fullsized":"2023-10-06T03:15:52.385392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412525+0000","last_change":"2023-10-06T03:15:52.404046+0000","last_active":"2023-10-06T03:15:52.412525+0000","last_peered":"2023-10-06T03:15:52.412525+0000","last_clean":"2023-10-06T03:15:52.412525+0000","last_became_active":"2023-10-06T03:15:52.403608+0000","last_became_peered":"2023-10-06T03:15:52.403608+0000","last_unstale":"2023-10-06T03:15:52.412525+0000","last_undegraded":"2023-10-06T03:15:52.412525+0000","last_fullsized":"2023-10-06T03:15:52.412525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.393335+0000","last_change":"2023-10-06T03:15:51.400696+0000","last_active":"2023-10-06T03:15:52.393335+0000","last_peered":"2023-10-06T03:15:52.393335+0000","last_clean":"2023-10-06T03:15:52.393335+0000","last_became_active":"2023-10-06T03:15:51.400423+0000","last_became_peered":"2023-10-06T03:15:51.400423+0000","last_unstale":"2023-10-06T03:15:52.393335+0000","last_undegraded":"2023-10-06T03:15:52.393335+0000","last_fullsized":"2023-10-06T03:15:52.393335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:47.458357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409679+0000","last_change":"2023-10-06T03:15:52.402973+0000","last_active":"2023-10-06T03:15:52.409679+0000","last_peered":"2023-10-06T03:15:52.409679+0000","last_clean":"2023-10-06T03:15:52.409679+0000","last_became_active":"2023-10-06T03:15:52.402707+0000","last_became_peered":"2023-10-06T03:15:52.402707+0000","last_unstale":"2023-10-06T03:15:52.409679+0000","last_undegraded":"2023-10-06T03:15:52.409679+0000","last_fullsized":"2023-10-06T03:15:52.409679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418712+0000","last_change":"2023-10-06T03:15:51.398207+0000","last_active":"2023-10-06T03:15:52.418712+0000","last_peered":"2023-10-06T03:15:52.418712+0000","last_clean":"2023-10-06T03:15:52.418712+0000","last_became_active":"2023-10-06T03:15:51.397903+0000","last_became_peered":"2023-10-06T03:15:51.397903+0000","last_unstale":"2023-10-06T03:15:52.418712+0000","last_undegraded":"2023-10-06T03:15:52.418712+0000","last_fullsized":"2023-10-06T03:15:52.418712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415171+0000","last_change":"2023-10-06T03:15:52.411310+0000","last_active":"2023-10-06T03:15:52.415171+0000","last_peered":"2023-10-06T03:15:52.415171+0000","last_clean":"2023-10-06T03:15:52.415171+0000","last_became_active":"2023-10-06T03:15:52.411060+0000","last_became_peered":"2023-10-06T03:15:52.411060+0000","last_unstale":"2023-10-06T03:15:52.415171+0000","last_undegraded":"2023-10-06T03:15:52.415171+0000","last_fullsized":"2023-10-06T03:15:52.415171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418008+0000","last_change":"2023-10-06T03:15:51.399461+0000","last_active":"2023-10-06T03:15:52.418008+0000","last_peered":"2023-10-06T03:15:52.418008+0000","last_clean":"2023-10-06T03:15:52.418008+0000","last_became_active":"2023-10-06T03:15:51.398657+0000","last_became_peered":"2023-10-06T03:15:51.398657+0000","last_unstale":"2023-10-06T03:15:52.418008+0000","last_undegraded":"2023-10-06T03:15:52.418008+0000","last_fullsized":"2023-10-06T03:15:52.418008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.595391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412382+0000","last_change":"2023-10-06T03:15:52.401919+0000","last_active":"2023-10-06T03:15:52.412382+0000","last_peered":"2023-10-06T03:15:52.412382+0000","last_clean":"2023-10-06T03:15:52.412382+0000","last_became_active":"2023-10-06T03:15:52.401624+0000","last_became_peered":"2023-10-06T03:15:52.401624+0000","last_unstale":"2023-10-06T03:15:52.412382+0000","last_undegraded":"2023-10-06T03:15:52.412382+0000","last_fullsized":"2023-10-06T03:15:52.412382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418041+0000","last_change":"2023-10-06T03:15:51.399919+0000","last_active":"2023-10-06T03:15:52.418041+0000","last_peered":"2023-10-06T03:15:52.418041+0000","last_clean":"2023-10-06T03:15:52.418041+0000","last_became_active":"2023-10-06T03:15:51.399678+0000","last_became_peered":"2023-10-06T03:15:51.399678+0000","last_unstale":"2023-10-06T03:15:52.418041+0000","last_undegraded":"2023-10-06T03:15:52.418041+0000","last_fullsized":"2023-10-06T03:15:52.418041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:57.295789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.406812+0000","last_change":"2023-10-06T03:15:52.397998+0000","last_active":"2023-10-06T03:15:52.406812+0000","last_peered":"2023-10-06T03:15:52.406812+0000","last_clean":"2023-10-06T03:15:52.406812+0000","last_became_active":"2023-10-06T03:15:52.397706+0000","last_became_peered":"2023-10-06T03:15:52.397706+0000","last_unstale":"2023-10-06T03:15:52.406812+0000","last_undegraded":"2023-10-06T03:15:52.406812+0000","last_fullsized":"2023-10-06T03:15:52.406812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:32.121745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.417854+0000","last_change":"2023-10-06T03:15:51.401427+0000","last_active":"2023-10-06T03:15:52.417854+0000","last_peered":"2023-10-06T03:15:52.417854+0000","last_clean":"2023-10-06T03:15:52.417854+0000","last_became_active":"2023-10-06T03:15:51.401124+0000","last_became_peered":"2023-10-06T03:15:51.401124+0000","last_unstale":"2023-10-06T03:15:52.417854+0000","last_undegraded":"2023-10-06T03:15:52.417854+0000","last_fullsized":"2023-10-06T03:15:52.417854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:41.329304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407021+0000","last_change":"2023-10-06T03:15:52.398501+0000","last_active":"2023-10-06T03:15:52.407021+0000","last_peered":"2023-10-06T03:15:52.407021+0000","last_clean":"2023-10-06T03:15:52.407021+0000","last_became_active":"2023-10-06T03:15:52.398218+0000","last_became_peered":"2023-10-06T03:15:52.398218+0000","last_unstale":"2023-10-06T03:15:52.407021+0000","last_undegraded":"2023-10-06T03:15:52.407021+0000","last_fullsized":"2023-10-06T03:15:52.407021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:58.301276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.389184+0000","last_change":"2023-10-06T03:15:51.398288+0000","last_active":"2023-10-06T03:15:52.389184+0000","last_peered":"2023-10-06T03:15:52.389184+0000","last_clean":"2023-10-06T03:15:52.389184+0000","last_became_active":"2023-10-06T03:15:51.398015+0000","last_became_peered":"2023-10-06T03:15:51.398015+0000","last_unstale":"2023-10-06T03:15:52.389184+0000","last_undegraded":"2023-10-06T03:15:52.389184+0000","last_fullsized":"2023-10-06T03:15:52.389184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404625+0000","last_change":"2023-10-06T03:15:52.398846+0000","last_active":"2023-10-06T03:15:52.404625+0000","last_peered":"2023-10-06T03:15:52.404625+0000","last_clean":"2023-10-06T03:15:52.404625+0000","last_became_active":"2023-10-06T03:15:52.398603+0000","last_became_peered":"2023-10-06T03:15:52.398603+0000","last_unstale":"2023-10-06T03:15:52.404625+0000","last_undegraded":"2023-10-06T03:15:52.404625+0000","last_fullsized":"2023-10-06T03:15:52.404625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412777+0000","last_change":"2023-10-06T03:15:51.407297+0000","last_active":"2023-10-06T03:15:52.412777+0000","last_peered":"2023-10-06T03:15:52.412777+0000","last_clean":"2023-10-06T03:15:52.412777+0000","last_became_active":"2023-10-06T03:15:51.407027+0000","last_became_peered":"2023-10-06T03:15:51.407027+0000","last_unstale":"2023-10-06T03:15:52.412777+0000","last_undegraded":"2023-10-06T03:15:52.412777+0000","last_fullsized":"2023-10-06T03:15:52.412777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.595391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408429+0000","last_change":"2023-10-06T03:15:52.401694+0000","last_active":"2023-10-06T03:15:52.408429+0000","last_peered":"2023-10-06T03:15:52.408429+0000","last_clean":"2023-10-06T03:15:52.408429+0000","last_became_active":"2023-10-06T03:15:52.401416+0000","last_became_peered":"2023-10-06T03:15:52.401416+0000","last_unstale":"2023-10-06T03:15:52.408429+0000","last_undegraded":"2023-10-06T03:15:52.408429+0000","last_fullsized":"2023-10-06T03:15:52.408429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:01.423050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395011+0000","last_change":"2023-10-06T03:15:51.396237+0000","last_active":"2023-10-06T03:15:52.395011+0000","last_peered":"2023-10-06T03:15:52.395011+0000","last_clean":"2023-10-06T03:15:52.395011+0000","last_became_active":"2023-10-06T03:15:51.395961+0000","last_became_peered":"2023-10-06T03:15:51.395961+0000","last_unstale":"2023-10-06T03:15:52.395011+0000","last_undegraded":"2023-10-06T03:15:52.395011+0000","last_fullsized":"2023-10-06T03:15:52.395011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403024+0000","last_change":"2023-10-06T03:15:52.397196+0000","last_active":"2023-10-06T03:15:52.403024+0000","last_peered":"2023-10-06T03:15:52.403024+0000","last_clean":"2023-10-06T03:15:52.403024+0000","last_became_active":"2023-10-06T03:15:52.396909+0000","last_became_peered":"2023-10-06T03:15:52.396909+0000","last_unstale":"2023-10-06T03:15:52.403024+0000","last_undegraded":"2023-10-06T03:15:52.403024+0000","last_fullsized":"2023-10-06T03:15:52.403024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:04.891285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388015+0000","last_change":"2023-10-06T03:15:51.397413+0000","last_active":"2023-10-06T03:15:52.388015+0000","last_peered":"2023-10-06T03:15:52.388015+0000","last_clean":"2023-10-06T03:15:52.388015+0000","last_became_active":"2023-10-06T03:15:51.397074+0000","last_became_peered":"2023-10-06T03:15:51.397074+0000","last_unstale":"2023-10-06T03:15:52.388015+0000","last_undegraded":"2023-10-06T03:15:52.388015+0000","last_fullsized":"2023-10-06T03:15:52.388015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408667+0000","last_change":"2023-10-06T03:15:52.405384+0000","last_active":"2023-10-06T03:15:52.408667+0000","last_peered":"2023-10-06T03:15:52.408667+0000","last_clean":"2023-10-06T03:15:52.408667+0000","last_became_active":"2023-10-06T03:15:52.405148+0000","last_became_peered":"2023-10-06T03:15:52.405148+0000","last_unstale":"2023-10-06T03:15:52.408667+0000","last_undegraded":"2023-10-06T03:15:52.408667+0000","last_fullsized":"2023-10-06T03:15:52.408667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395105+0000","last_change":"2023-10-06T03:15:51.401070+0000","last_active":"2023-10-06T03:15:52.395105+0000","last_peered":"2023-10-06T03:15:52.395105+0000","last_clean":"2023-10-06T03:15:52.395105+0000","last_became_active":"2023-10-06T03:15:51.400536+0000","last_became_peered":"2023-10-06T03:15:51.400536+0000","last_unstale":"2023-10-06T03:15:52.395105+0000","last_undegraded":"2023-10-06T03:15:52.395105+0000","last_fullsized":"2023-10-06T03:15:52.395105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405811+0000","last_change":"2023-10-06T03:15:52.401281+0000","last_active":"2023-10-06T03:15:52.405811+0000","last_peered":"2023-10-06T03:15:52.405811+0000","last_clean":"2023-10-06T03:15:52.405811+0000","last_became_active":"2023-10-06T03:15:52.401028+0000","last_became_peered":"2023-10-06T03:15:52.401028+0000","last_unstale":"2023-10-06T03:15:52.405811+0000","last_undegraded":"2023-10-06T03:15:52.405811+0000","last_fullsized":"2023-10-06T03:15:52.405811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415300+0000","last_change":"2023-10-06T03:15:51.398105+0000","last_active":"2023-10-06T03:15:52.415300+0000","last_peered":"2023-10-06T03:15:52.415300+0000","last_clean":"2023-10-06T03:15:52.415300+0000","last_became_active":"2023-10-06T03:15:51.397877+0000","last_became_peered":"2023-10-06T03:15:51.397877+0000","last_unstale":"2023-10-06T03:15:52.415300+0000","last_undegraded":"2023-10-06T03:15:52.415300+0000","last_fullsized":"2023-10-06T03:15:52.415300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388474+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:15:52.388474+0000","last_peered":"2023-10-06T03:15:52.388474+0000","last_clean":"2023-10-06T03:15:52.388474+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:15:52.388474+0000","last_undegraded":"2023-10-06T03:15:52.388474+0000","last_fullsized":"2023-10-06T03:15:52.388474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412308+0000","last_change":"2023-10-06T03:15:52.407538+0000","last_active":"2023-10-06T03:15:52.412308+0000","last_peered":"2023-10-06T03:15:52.412308+0000","last_clean":"2023-10-06T03:15:52.412308+0000","last_became_active":"2023-10-06T03:15:52.407273+0000","last_became_peered":"2023-10-06T03:15:52.407273+0000","last_unstale":"2023-10-06T03:15:52.412308+0000","last_undegraded":"2023-10-06T03:15:52.412308+0000","last_fullsized":"2023-10-06T03:15:52.412308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:24.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392479+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:15:52.392479+0000","last_peered":"2023-10-06T03:15:52.392479+0000","last_clean":"2023-10-06T03:15:52.392479+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:15:52.392479+0000","last_undegraded":"2023-10-06T03:15:52.392479+0000","last_fullsized":"2023-10-06T03:15:52.392479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385832+0000","last_change":"2023-10-06T03:15:51.399935+0000","last_active":"2023-10-06T03:15:52.385832+0000","last_peered":"2023-10-06T03:15:52.385832+0000","last_clean":"2023-10-06T03:15:52.385832+0000","last_became_active":"2023-10-06T03:15:51.399621+0000","last_became_peered":"2023-10-06T03:15:51.399621+0000","last_unstale":"2023-10-06T03:15:52.385832+0000","last_undegraded":"2023-10-06T03:15:52.385832+0000","last_fullsized":"2023-10-06T03:15:52.385832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396231+0000","last_change":"2023-10-06T03:15:52.390913+0000","last_active":"2023-10-06T03:15:52.396231+0000","last_peered":"2023-10-06T03:15:52.396231+0000","last_clean":"2023-10-06T03:15:52.396231+0000","last_became_active":"2023-10-06T03:15:52.390637+0000","last_became_peered":"2023-10-06T03:15:52.390637+0000","last_unstale":"2023-10-06T03:15:52.396231+0000","last_undegraded":"2023-10-06T03:15:52.396231+0000","last_fullsized":"2023-10-06T03:15:52.396231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:52.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396289+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:15:52.396289+0000","last_peered":"2023-10-06T03:15:52.396289+0000","last_clean":"2023-10-06T03:15:52.396289+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:15:52.396289+0000","last_undegraded":"2023-10-06T03:15:52.396289+0000","last_fullsized":"2023-10-06T03:15:52.396289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392848+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:15:52.392848+0000","last_peered":"2023-10-06T03:15:52.392848+0000","last_clean":"2023-10-06T03:15:52.392848+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:15:52.392848+0000","last_undegraded":"2023-10-06T03:15:52.392848+0000","last_fullsized":"2023-10-06T03:15:52.392848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385325+0000","last_change":"2023-10-06T03:15:51.396703+0000","last_active":"2023-10-06T03:15:52.385325+0000","last_peered":"2023-10-06T03:15:52.385325+0000","last_clean":"2023-10-06T03:15:52.385325+0000","last_became_active":"2023-10-06T03:15:51.396436+0000","last_became_peered":"2023-10-06T03:15:51.396436+0000","last_unstale":"2023-10-06T03:15:52.385325+0000","last_undegraded":"2023-10-06T03:15:52.385325+0000","last_fullsized":"2023-10-06T03:15:52.385325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404610+0000","last_change":"2023-10-06T03:15:52.399034+0000","last_active":"2023-10-06T03:15:52.404610+0000","last_peered":"2023-10-06T03:15:52.404610+0000","last_clean":"2023-10-06T03:15:52.404610+0000","last_became_active":"2023-10-06T03:15:52.398801+0000","last_became_peered":"2023-10-06T03:15:52.398801+0000","last_unstale":"2023-10-06T03:15:52.404610+0000","last_undegraded":"2023-10-06T03:15:52.404610+0000","last_fullsized":"2023-10-06T03:15:52.404610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.393310+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:15:52.393310+0000","last_peered":"2023-10-06T03:15:52.393310+0000","last_clean":"2023-10-06T03:15:52.393310+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:15:52.393310+0000","last_undegraded":"2023-10-06T03:15:52.393310+0000","last_fullsized":"2023-10-06T03:15:52.393310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395966+0000","last_change":"2023-10-06T03:15:51.397023+0000","last_active":"2023-10-06T03:15:52.395966+0000","last_peered":"2023-10-06T03:15:52.395966+0000","last_clean":"2023-10-06T03:15:52.395966+0000","last_became_active":"2023-10-06T03:15:51.396769+0000","last_became_peered":"2023-10-06T03:15:51.396769+0000","last_unstale":"2023-10-06T03:15:52.395966+0000","last_undegraded":"2023-10-06T03:15:52.395966+0000","last_fullsized":"2023-10-06T03:15:52.395966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402231+0000","last_change":"2023-10-06T03:15:52.397382+0000","last_active":"2023-10-06T03:15:52.402231+0000","last_peered":"2023-10-06T03:15:52.402231+0000","last_clean":"2023-10-06T03:15:52.402231+0000","last_became_active":"2023-10-06T03:15:52.397128+0000","last_became_peered":"2023-10-06T03:15:52.397128+0000","last_unstale":"2023-10-06T03:15:52.402231+0000","last_undegraded":"2023-10-06T03:15:52.402231+0000","last_fullsized":"2023-10-06T03:15:52.402231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392559+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:15:52.392559+0000","last_peered":"2023-10-06T03:15:52.392559+0000","last_clean":"2023-10-06T03:15:52.392559+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:15:52.392559+0000","last_undegraded":"2023-10-06T03:15:52.392559+0000","last_fullsized":"2023-10-06T03:15:52.392559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.394632+0000","last_change":"2023-10-06T03:15:51.401653+0000","last_active":"2023-10-06T03:15:52.394632+0000","last_peered":"2023-10-06T03:15:52.394632+0000","last_clean":"2023-10-06T03:15:52.394632+0000","last_became_active":"2023-10-06T03:15:51.401467+0000","last_became_peered":"2023-10-06T03:15:51.401467+0000","last_unstale":"2023-10-06T03:15:52.394632+0000","last_undegraded":"2023-10-06T03:15:52.394632+0000","last_fullsized":"2023-10-06T03:15:52.394632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407029+0000","last_change":"2023-10-06T03:15:52.399597+0000","last_active":"2023-10-06T03:15:52.407029+0000","last_peered":"2023-10-06T03:15:52.407029+0000","last_clean":"2023-10-06T03:15:52.407029+0000","last_became_active":"2023-10-06T03:15:52.399333+0000","last_became_peered":"2023-10-06T03:15:52.399333+0000","last_unstale":"2023-10-06T03:15:52.407029+0000","last_undegraded":"2023-10-06T03:15:52.407029+0000","last_fullsized":"2023-10-06T03:15:52.407029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:42.334791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388470+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:15:52.388470+0000","last_peered":"2023-10-06T03:15:52.388470+0000","last_clean":"2023-10-06T03:15:52.388470+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:15:52.388470+0000","last_undegraded":"2023-10-06T03:15:52.388470+0000","last_fullsized":"2023-10-06T03:15:52.388470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.387909+0000","last_change":"2023-10-06T03:15:51.397390+0000","last_active":"2023-10-06T03:15:52.387909+0000","last_peered":"2023-10-06T03:15:52.387909+0000","last_clean":"2023-10-06T03:15:52.387909+0000","last_became_active":"2023-10-06T03:15:51.397066+0000","last_became_peered":"2023-10-06T03:15:51.397066+0000","last_unstale":"2023-10-06T03:15:52.387909+0000","last_undegraded":"2023-10-06T03:15:52.387909+0000","last_fullsized":"2023-10-06T03:15:52.387909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402326+0000","last_change":"2023-10-06T03:15:52.397246+0000","last_active":"2023-10-06T03:15:52.402326+0000","last_peered":"2023-10-06T03:15:52.402326+0000","last_clean":"2023-10-06T03:15:52.402326+0000","last_became_active":"2023-10-06T03:15:52.396967+0000","last_became_peered":"2023-10-06T03:15:52.396967+0000","last_unstale":"2023-10-06T03:15:52.402326+0000","last_undegraded":"2023-10-06T03:15:52.402326+0000","last_fullsized":"2023-10-06T03:15:52.402326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:38.322802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.394796+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:15:52.394796+0000","last_peered":"2023-10-06T03:15:52.394796+0000","last_clean":"2023-10-06T03:15:52.394796+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:15:52.394796+0000","last_undegraded":"2023-10-06T03:15:52.394796+0000","last_fullsized":"2023-10-06T03:15:52.394796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396400+0000","last_change":"2023-10-06T03:15:51.398607+0000","last_active":"2023-10-06T03:15:52.396400+0000","last_peered":"2023-10-06T03:15:52.396400+0000","last_clean":"2023-10-06T03:15:52.396400+0000","last_became_active":"2023-10-06T03:15:51.398350+0000","last_became_peered":"2023-10-06T03:15:51.398350+0000","last_unstale":"2023-10-06T03:15:52.396400+0000","last_undegraded":"2023-10-06T03:15:52.396400+0000","last_fullsized":"2023-10-06T03:15:52.396400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396430+0000","last_change":"2023-10-06T03:15:52.390631+0000","last_active":"2023-10-06T03:15:52.396430+0000","last_peered":"2023-10-06T03:15:52.396430+0000","last_clean":"2023-10-06T03:15:52.396430+0000","last_became_active":"2023-10-06T03:15:52.390376+0000","last_became_peered":"2023-10-06T03:15:52.390376+0000","last_unstale":"2023-10-06T03:15:52.396430+0000","last_undegraded":"2023-10-06T03:15:52.396430+0000","last_fullsized":"2023-10-06T03:15:52.396430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:38.322802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395054+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:15:52.395054+0000","last_peered":"2023-10-06T03:15:52.395054+0000","last_clean":"2023-10-06T03:15:52.395054+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:15:52.395054+0000","last_undegraded":"2023-10-06T03:15:52.395054+0000","last_fullsized":"2023-10-06T03:15:52.395054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.389055+0000","last_change":"2023-10-06T03:15:51.398658+0000","last_active":"2023-10-06T03:15:52.389055+0000","last_peered":"2023-10-06T03:15:52.389055+0000","last_clean":"2023-10-06T03:15:52.389055+0000","last_became_active":"2023-10-06T03:15:51.397983+0000","last_became_peered":"2023-10-06T03:15:51.397983+0000","last_unstale":"2023-10-06T03:15:52.389055+0000","last_undegraded":"2023-10-06T03:15:52.389055+0000","last_fullsized":"2023-10-06T03:15:52.389055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402303+0000","last_change":"2023-10-06T03:15:52.397235+0000","last_active":"2023-10-06T03:15:52.402303+0000","last_peered":"2023-10-06T03:15:52.402303+0000","last_clean":"2023-10-06T03:15:52.402303+0000","last_became_active":"2023-10-06T03:15:52.396993+0000","last_became_peered":"2023-10-06T03:15:52.396993+0000","last_unstale":"2023-10-06T03:15:52.402303+0000","last_undegraded":"2023-10-06T03:15:52.402303+0000","last_fullsized":"2023-10-06T03:15:52.402303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418401+0000","last_change":"2023-10-06T03:15:51.396724+0000","last_active":"2023-10-06T03:15:52.418401+0000","last_peered":"2023-10-06T03:15:52.418401+0000","last_clean":"2023-10-06T03:15:52.418401+0000","last_became_active":"2023-10-06T03:15:51.396495+0000","last_became_peered":"2023-10-06T03:15:51.396495+0000","last_unstale":"2023-10-06T03:15:52.418401+0000","last_undegraded":"2023-10-06T03:15:52.418401+0000","last_fullsized":"2023-10-06T03:15:52.418401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404335+0000","last_change":"2023-10-06T03:15:52.399707+0000","last_active":"2023-10-06T03:15:52.404335+0000","last_peered":"2023-10-06T03:15:52.404335+0000","last_clean":"2023-10-06T03:15:52.404335+0000","last_became_active":"2023-10-06T03:15:52.399315+0000","last_became_peered":"2023-10-06T03:15:52.399315+0000","last_unstale":"2023-10-06T03:15:52.404335+0000","last_undegraded":"2023-10-06T03:15:52.404335+0000","last_fullsized":"2023-10-06T03:15:52.404335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:55.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412599+0000","last_change":"2023-10-06T03:15:51.394879+0000","last_active":"2023-10-06T03:15:52.412599+0000","last_peered":"2023-10-06T03:15:52.412599+0000","last_clean":"2023-10-06T03:15:52.412599+0000","last_became_active":"2023-10-06T03:15:51.394338+0000","last_became_peered":"2023-10-06T03:15:51.394338+0000","last_unstale":"2023-10-06T03:15:52.412599+0000","last_undegraded":"2023-10-06T03:15:52.412599+0000","last_fullsized":"2023-10-06T03:15:52.412599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407753+0000","last_change":"2023-10-06T03:15:52.400514+0000","last_active":"2023-10-06T03:15:52.407753+0000","last_peered":"2023-10-06T03:15:52.407753+0000","last_clean":"2023-10-06T03:15:52.407753+0000","last_became_active":"2023-10-06T03:15:52.399876+0000","last_became_peered":"2023-10-06T03:15:52.399876+0000","last_unstale":"2023-10-06T03:15:52.407753+0000","last_undegraded":"2023-10-06T03:15:52.407753+0000","last_fullsized":"2023-10-06T03:15:52.407753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:27.152523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412710+0000","last_change":"2023-10-06T03:15:51.394704+0000","last_active":"2023-10-06T03:15:52.412710+0000","last_peered":"2023-10-06T03:15:52.412710+0000","last_clean":"2023-10-06T03:15:52.412710+0000","last_became_active":"2023-10-06T03:15:51.394420+0000","last_became_peered":"2023-10-06T03:15:51.394420+0000","last_unstale":"2023-10-06T03:15:52.412710+0000","last_undegraded":"2023-10-06T03:15:52.412710+0000","last_fullsized":"2023-10-06T03:15:52.412710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408476+0000","last_change":"2023-10-06T03:15:52.401606+0000","last_active":"2023-10-06T03:15:52.408476+0000","last_peered":"2023-10-06T03:15:52.408476+0000","last_clean":"2023-10-06T03:15:52.408476+0000","last_became_active":"2023-10-06T03:15:52.401319+0000","last_became_peered":"2023-10-06T03:15:52.401319+0000","last_unstale":"2023-10-06T03:15:52.408476+0000","last_undegraded":"2023-10-06T03:15:52.408476+0000","last_fullsized":"2023-10-06T03:15:52.408476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:26.415006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.414847+0000","last_change":"2023-10-06T03:15:51.397229+0000","last_active":"2023-10-06T03:15:52.414847+0000","last_peered":"2023-10-06T03:15:52.414847+0000","last_clean":"2023-10-06T03:15:52.414847+0000","last_became_active":"2023-10-06T03:15:51.396971+0000","last_became_peered":"2023-10-06T03:15:51.396971+0000","last_unstale":"2023-10-06T03:15:52.414847+0000","last_undegraded":"2023-10-06T03:15:52.414847+0000","last_fullsized":"2023-10-06T03:15:52.414847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403707+0000","last_change":"2023-10-06T03:15:52.399759+0000","last_active":"2023-10-06T03:15:52.403707+0000","last_peered":"2023-10-06T03:15:52.403707+0000","last_clean":"2023-10-06T03:15:52.403707+0000","last_became_active":"2023-10-06T03:15:52.399459+0000","last_became_peered":"2023-10-06T03:15:52.399459+0000","last_unstale":"2023-10-06T03:15:52.403707+0000","last_undegraded":"2023-10-06T03:15:52.403707+0000","last_fullsized":"2023-10-06T03:15:52.403707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418238+0000","last_change":"2023-10-06T03:15:51.398436+0000","last_active":"2023-10-06T03:15:52.418238+0000","last_peered":"2023-10-06T03:15:52.418238+0000","last_clean":"2023-10-06T03:15:52.418238+0000","last_became_active":"2023-10-06T03:15:51.397582+0000","last_became_peered":"2023-10-06T03:15:51.397582+0000","last_unstale":"2023-10-06T03:15:52.418238+0000","last_undegraded":"2023-10-06T03:15:52.418238+0000","last_fullsized":"2023-10-06T03:15:52.418238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402534+0000","last_change":"2023-10-06T03:15:52.396983+0000","last_active":"2023-10-06T03:15:52.402534+0000","last_peered":"2023-10-06T03:15:52.402534+0000","last_clean":"2023-10-06T03:15:52.402534+0000","last_became_active":"2023-10-06T03:15:52.396686+0000","last_became_peered":"2023-10-06T03:15:52.396686+0000","last_unstale":"2023-10-06T03:15:52.402534+0000","last_undegraded":"2023-10-06T03:15:52.402534+0000","last_fullsized":"2023-10-06T03:15:52.402534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.410272+0000","last_change":"2023-10-06T03:15:52.402390+0000","last_active":"2023-10-06T03:15:52.410272+0000","last_peered":"2023-10-06T03:15:52.410272+0000","last_clean":"2023-10-06T03:15:52.410272+0000","last_became_active":"2023-10-06T03:15:52.402104+0000","last_became_peered":"2023-10-06T03:15:52.402104+0000","last_unstale":"2023-10-06T03:15:52.410272+0000","last_undegraded":"2023-10-06T03:15:52.410272+0000","last_fullsized":"2023-10-06T03:15:52.410272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403729+0000","last_change":"2023-10-06T03:15:52.400667+0000","last_active":"2023-10-06T03:15:52.403729+0000","last_peered":"2023-10-06T03:15:52.403729+0000","last_clean":"2023-10-06T03:15:52.403729+0000","last_became_active":"2023-10-06T03:15:52.399974+0000","last_became_peered":"2023-10-06T03:15:52.399974+0000","last_unstale":"2023-10-06T03:15:52.403729+0000","last_undegraded":"2023-10-06T03:15:52.403729+0000","last_fullsized":"2023-10-06T03:15:52.403729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:52.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408497+0000","last_change":"2023-10-06T03:15:52.404305+0000","last_active":"2023-10-06T03:15:52.408497+0000","last_peered":"2023-10-06T03:15:52.408497+0000","last_clean":"2023-10-06T03:15:52.408497+0000","last_became_active":"2023-10-06T03:15:52.403971+0000","last_became_peered":"2023-10-06T03:15:52.403971+0000","last_unstale":"2023-10-06T03:15:52.408497+0000","last_undegraded":"2023-10-06T03:15:52.408497+0000","last_fullsized":"2023-10-06T03:15:52.408497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.002827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412347+0000","last_change":"2023-10-06T03:15:52.407238+0000","last_active":"2023-10-06T03:15:52.412347+0000","last_peered":"2023-10-06T03:15:52.412347+0000","last_clean":"2023-10-06T03:15:52.412347+0000","last_became_active":"2023-10-06T03:15:52.406982+0000","last_became_peered":"2023-10-06T03:15:52.406982+0000","last_unstale":"2023-10-06T03:15:52.412347+0000","last_undegraded":"2023-10-06T03:15:52.412347+0000","last_fullsized":"2023-10-06T03:15:52.412347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409124+0000","last_change":"2023-10-06T03:15:52.402218+0000","last_active":"2023-10-06T03:15:52.409124+0000","last_peered":"2023-10-06T03:15:52.409124+0000","last_clean":"2023-10-06T03:15:52.409124+0000","last_became_active":"2023-10-06T03:15:52.401956+0000","last_became_peered":"2023-10-06T03:15:52.401956+0000","last_unstale":"2023-10-06T03:15:52.409124+0000","last_undegraded":"2023-10-06T03:15:52.409124+0000","last_fullsized":"2023-10-06T03:15:52.409124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":664951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":192512,"data_stored":66280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:15:56.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:15:56.476 INFO:tasks.ceph.mds.b.smithi134.stderr:2023-10-06T03:15:56.475+0000 7fefd0ce5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:15:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.593+0000 7f12ff566700 1 Processor -- start 2023-10-06T03:15:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.593+0000 7f12ff566700 1 -- start start 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12ff566700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f12f815d560 0x7f12f80d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12ff566700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12f815d930 0x7f12f80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12ff566700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f81591b0 0x7f12f8159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12ff566700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80b2ad0 con 0x7f12f815d560 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12ff566700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80b4160 con 0x7f12f815d930 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12ff566700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80b1f80 con 0x7f12f81591b0 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f12f815d560 0x7f12f80d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f12f815d560 0x7f12f80d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47654/0 (socket says 172.21.15.82:47654) 2023-10-06T03:15:56.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 -- 172.21.15.82:0/2592727987 learned_addr learned my addr 172.21.15.82:0/2592727987 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 -- 172.21.15.82:0/2592727987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f81591b0 msgr2=0x7f12f8159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 --2- 172.21.15.82:0/2592727987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f81591b0 0x7f12f8159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 -- 172.21.15.82:0/2592727987 >> v2:172.21.15.134:3300/0 conn(0x7f12f815d930 msgr2=0x7f12f80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 --2- 172.21.15.82:0/2592727987 >> v2:172.21.15.134:3300/0 conn(0x7f12f815d930 0x7f12f80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 -- 172.21.15.82:0/2592727987 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8159b70 con 0x7f12f815d560 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12fd302700 1 --2- 172.21.15.82:0/2592727987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f815d560 0x7f12f80d0030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12f815e440 tx=0x7f12f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e3791812baaa20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.594+0000 7f12effff700 1 -- 172.21.15.82:0/2592727987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f400b860 con 0x7f12f815d560 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12effff700 1 -- 172.21.15.82:0/2592727987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f400b9c0 con 0x7f12f815d560 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12effff700 1 -- 172.21.15.82:0/2592727987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f400bd60 con 0x7f12f815d560 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 -- 172.21.15.82:0/2592727987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f815d560 msgr2=0x7f12f80d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 --2- 172.21.15.82:0/2592727987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f815d560 0x7f12f80d0030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12f815e440 tx=0x7f12f4009250 comp rx=0 tx=0).stop 2023-10-06T03:15:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 -- 172.21.15.82:0/2592727987 shutdown_connections 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 --2- 172.21.15.82:0/2592727987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f815d560 0x7f12f80d0030 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 --2- 172.21.15.82:0/2592727987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f81591b0 0x7f12f8159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 --2- 172.21.15.82:0/2592727987 >> v2:172.21.15.134:3300/0 conn(0x7f12f815d930 0x7f12f80b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 -- 172.21.15.82:0/2592727987 >> 172.21.15.82:0/2592727987 conn(0x7f12f80d1180 msgr2=0x7f12f8069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 -- 172.21.15.82:0/2592727987 shutdown_connections 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.595+0000 7f12ff566700 1 -- 172.21.15.82:0/2592727987 wait complete. 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.596+0000 7f12ff566700 1 Processor -- start 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.596+0000 7f12ff566700 1 -- start start 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12ff566700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f81591b0 0x7f12f814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12ff566700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f815d560 0x7f12f80aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12ff566700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f815d930 0x7f12f80b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12ff566700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f816a710 con 0x7f12f81591b0 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12ff566700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f816d530 con 0x7f12f815d560 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12ff566700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f816a430 con 0x7f12f815d930 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12fd302700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f81591b0 0x7f12f814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12fd302700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f81591b0 0x7f12f814f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47666/0 (socket says 172.21.15.82:47666) 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12fd302700 1 -- 172.21.15.82:0/2010844308 learned_addr learned my addr 172.21.15.82:0/2010844308 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12fd302700 1 -- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f815d930 msgr2=0x7f12f80b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12fd302700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f815d930 0x7f12f80b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12fd302700 1 -- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f815d560 msgr2=0x7f12f80aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12fd302700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f815d560 0x7f12f80aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.597+0000 7f12fd302700 1 -- 172.21.15.82:0/2010844308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f40094f0 con 0x7f12f81591b0 2023-10-06T03:15:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.598+0000 7f12fd302700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f81591b0 0x7f12f814f130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12f40090b0 tx=0x7f12f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:56.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.598+0000 7f12ed7fa700 1 -- 172.21.15.82:0/2010844308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4026480 con 0x7f12f81591b0 2023-10-06T03:15:56.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.598+0000 7f12ed7fa700 1 -- 172.21.15.82:0/2010844308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f401f070 con 0x7f12f81591b0 2023-10-06T03:15:56.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.598+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f816cc00 con 0x7f12f81591b0 2023-10-06T03:15:56.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.598+0000 7f12ed7fa700 1 -- 172.21.15.82:0/2010844308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4026830 con 0x7f12f81591b0 2023-10-06T03:15:56.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.598+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f816d1c0 con 0x7f12f81591b0 2023-10-06T03:15:56.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.599+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f8064050 con 0x7f12f81591b0 2023-10-06T03:15:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.599+0000 7f12ed7fa700 1 -- 172.21.15.82:0/2010844308 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12f401a430 con 0x7f12f81591b0 2023-10-06T03:15:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.600+0000 7f12ed7fa700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f12dc066f30 0x7f12dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.600+0000 7f12ed7fa700 1 -- 172.21.15.82:0/2010844308 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f12f4021070 con 0x7f12f81591b0 2023-10-06T03:15:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.600+0000 7f12fcb01700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f12dc066f30 0x7f12dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.600+0000 7f12fcb01700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f12dc066f30 0x7f12dc0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12e8006fd0 tx=0x7f12e8006d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:56.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.604+0000 7f12ed7fa700 1 -- 172.21.15.82:0/2010844308 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12f4053c40 con 0x7f12f81591b0 2023-10-06T03:15:56.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.783+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12f816d670 con 0x7f12dc066f30 2023-10-06T03:15:56.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.791+0000 7f12ed7fa700 1 -- 172.21.15.82:0/2010844308 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286935 (secure 0 0 0) 0x7f12e800c040 con 0x7f12dc066f30 2023-10-06T03:15:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:56.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.794+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f12dc066f30 msgr2=0x7f12dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.794+0000 7f12ff566700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f12dc066f30 0x7f12dc0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12e8006fd0 tx=0x7f12e8006d30 comp rx=0 tx=0).stop 2023-10-06T03:15:56.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.794+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f81591b0 msgr2=0x7f12f814f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:56.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.794+0000 7f12ff566700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f81591b0 0x7f12f814f130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12f40090b0 tx=0x7f12f4017000 comp rx=0 tx=0).stop 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.795+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 shutdown_connections 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.795+0000 7f12ff566700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f12dc066f30 0x7f12dc0693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.795+0000 7f12ff566700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f815d930 0x7f12f80b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.795+0000 7f12ff566700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f81591b0 0x7f12f814f130 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.795+0000 7f12ff566700 1 --2- 172.21.15.82:0/2010844308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f815d560 0x7f12f80aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.795+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 >> 172.21.15.82:0/2010844308 conn(0x7f12f80d1180 msgr2=0x7f12f80b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.795+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 shutdown_connections 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.795+0000 7f12ff566700 1 -- 172.21.15.82:0/2010844308 wait complete. 2023-10-06T03:15:56.800 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:15:56.808 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-06T03:15:55.148518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381096,"kb_used_data":2792,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593624,"statfs":{"total":773094113280,"available":770655870976,"internally_reserved":0,"allocated":2859008,"data_stored":1765414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.772153"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405704+0000","last_change":"2023-10-06T03:15:52.401448+0000","last_active":"2023-10-06T03:15:52.405704+0000","last_peered":"2023-10-06T03:15:52.405704+0000","last_clean":"2023-10-06T03:15:52.405704+0000","last_became_active":"2023-10-06T03:15:52.401163+0000","last_became_peered":"2023-10-06T03:15:52.401163+0000","last_unstale":"2023-10-06T03:15:52.405704+0000","last_undegraded":"2023-10-06T03:15:52.405704+0000","last_fullsized":"2023-10-06T03:15:52.405704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:12.727676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407826+0000","last_change":"2023-10-06T03:15:52.400840+0000","last_active":"2023-10-06T03:15:52.407826+0000","last_peered":"2023-10-06T03:15:52.407826+0000","last_clean":"2023-10-06T03:15:52.407826+0000","last_became_active":"2023-10-06T03:15:52.400551+0000","last_became_peered":"2023-10-06T03:15:52.400551+0000","last_unstale":"2023-10-06T03:15:52.407826+0000","last_undegraded":"2023-10-06T03:15:52.407826+0000","last_fullsized":"2023-10-06T03:15:52.407826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403045+0000","last_change":"2023-10-06T03:15:52.397230+0000","last_active":"2023-10-06T03:15:52.403045+0000","last_peered":"2023-10-06T03:15:52.403045+0000","last_clean":"2023-10-06T03:15:52.403045+0000","last_became_active":"2023-10-06T03:15:52.396958+0000","last_became_peered":"2023-10-06T03:15:52.396958+0000","last_unstale":"2023-10-06T03:15:52.403045+0000","last_undegraded":"2023-10-06T03:15:52.403045+0000","last_fullsized":"2023-10-06T03:15:52.403045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:36.699116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408300+0000","last_change":"2023-10-06T03:15:52.402222+0000","last_active":"2023-10-06T03:15:52.408300+0000","last_peered":"2023-10-06T03:15:52.408300+0000","last_clean":"2023-10-06T03:15:52.408300+0000","last_became_active":"2023-10-06T03:15:52.401929+0000","last_became_peered":"2023-10-06T03:15:52.401929+0000","last_unstale":"2023-10-06T03:15:52.408300+0000","last_undegraded":"2023-10-06T03:15:52.408300+0000","last_fullsized":"2023-10-06T03:15:52.408300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:27.381001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409687+0000","last_change":"2023-10-06T03:15:52.402998+0000","last_active":"2023-10-06T03:15:52.409687+0000","last_peered":"2023-10-06T03:15:52.409687+0000","last_clean":"2023-10-06T03:15:52.409687+0000","last_became_active":"2023-10-06T03:15:52.402744+0000","last_became_peered":"2023-10-06T03:15:52.402744+0000","last_unstale":"2023-10-06T03:15:52.409687+0000","last_undegraded":"2023-10-06T03:15:52.409687+0000","last_fullsized":"2023-10-06T03:15:52.409687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407765+0000","last_change":"2023-10-06T03:15:52.400543+0000","last_active":"2023-10-06T03:15:52.407765+0000","last_peered":"2023-10-06T03:15:52.407765+0000","last_clean":"2023-10-06T03:15:52.407765+0000","last_became_active":"2023-10-06T03:15:52.400234+0000","last_became_peered":"2023-10-06T03:15:52.400234+0000","last_unstale":"2023-10-06T03:15:52.407765+0000","last_undegraded":"2023-10-06T03:15:52.407765+0000","last_fullsized":"2023-10-06T03:15:52.407765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:22.091211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415196+0000","last_change":"2023-10-06T03:15:52.411636+0000","last_active":"2023-10-06T03:15:52.415196+0000","last_peered":"2023-10-06T03:15:52.415196+0000","last_clean":"2023-10-06T03:15:52.415196+0000","last_became_active":"2023-10-06T03:15:52.410475+0000","last_became_peered":"2023-10-06T03:15:52.410475+0000","last_unstale":"2023-10-06T03:15:52.415196+0000","last_undegraded":"2023-10-06T03:15:52.415196+0000","last_fullsized":"2023-10-06T03:15:52.415196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395701+0000","last_change":"2023-10-06T03:15:52.391661+0000","last_active":"2023-10-06T03:15:52.395701+0000","last_peered":"2023-10-06T03:15:52.395701+0000","last_clean":"2023-10-06T03:15:52.395701+0000","last_became_active":"2023-10-06T03:15:52.390749+0000","last_became_peered":"2023-10-06T03:15:52.390749+0000","last_unstale":"2023-10-06T03:15:52.395701+0000","last_undegraded":"2023-10-06T03:15:52.395701+0000","last_fullsized":"2023-10-06T03:15:52.395701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409753+0000","last_change":"2023-10-06T03:15:52.403195+0000","last_active":"2023-10-06T03:15:52.409753+0000","last_peered":"2023-10-06T03:15:52.409753+0000","last_clean":"2023-10-06T03:15:52.409753+0000","last_became_active":"2023-10-06T03:15:52.402869+0000","last_became_peered":"2023-10-06T03:15:52.402869+0000","last_unstale":"2023-10-06T03:15:52.409753+0000","last_undegraded":"2023-10-06T03:15:52.409753+0000","last_fullsized":"2023-10-06T03:15:52.409753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:35.985027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.401152+0000","last_change":"2023-10-06T03:15:52.395407+0000","last_active":"2023-10-06T03:15:52.401152+0000","last_peered":"2023-10-06T03:15:52.401152+0000","last_clean":"2023-10-06T03:15:52.401152+0000","last_became_active":"2023-10-06T03:15:52.395152+0000","last_became_peered":"2023-10-06T03:15:52.395152+0000","last_unstale":"2023-10-06T03:15:52.401152+0000","last_undegraded":"2023-10-06T03:15:52.401152+0000","last_fullsized":"2023-10-06T03:15:52.401152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407807+0000","last_change":"2023-10-06T03:15:52.399379+0000","last_active":"2023-10-06T03:15:52.407807+0000","last_peered":"2023-10-06T03:15:52.407807+0000","last_clean":"2023-10-06T03:15:52.407807+0000","last_became_active":"2023-10-06T03:15:52.399116+0000","last_became_peered":"2023-10-06T03:15:52.399116+0000","last_unstale":"2023-10-06T03:15:52.407807+0000","last_undegraded":"2023-10-06T03:15:52.407807+0000","last_fullsized":"2023-10-06T03:15:52.407807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:24.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404234+0000","last_change":"2023-10-06T03:15:52.398110+0000","last_active":"2023-10-06T03:15:52.404234+0000","last_peered":"2023-10-06T03:15:52.404234+0000","last_clean":"2023-10-06T03:15:52.404234+0000","last_became_active":"2023-10-06T03:15:52.397691+0000","last_became_peered":"2023-10-06T03:15:52.397691+0000","last_unstale":"2023-10-06T03:15:52.404234+0000","last_undegraded":"2023-10-06T03:15:52.404234+0000","last_fullsized":"2023-10-06T03:15:52.404234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:20.541949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405781+0000","last_change":"2023-10-06T03:15:52.401787+0000","last_active":"2023-10-06T03:15:52.405781+0000","last_peered":"2023-10-06T03:15:52.405781+0000","last_clean":"2023-10-06T03:15:52.405781+0000","last_became_active":"2023-10-06T03:15:52.400804+0000","last_became_peered":"2023-10-06T03:15:52.400804+0000","last_unstale":"2023-10-06T03:15:52.405781+0000","last_undegraded":"2023-10-06T03:15:52.405781+0000","last_fullsized":"2023-10-06T03:15:52.405781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:00.679276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402120+0000","last_change":"2023-10-06T03:15:52.396439+0000","last_active":"2023-10-06T03:15:52.402120+0000","last_peered":"2023-10-06T03:15:52.402120+0000","last_clean":"2023-10-06T03:15:52.402120+0000","last_became_active":"2023-10-06T03:15:52.396218+0000","last_became_peered":"2023-10-06T03:15:52.396218+0000","last_unstale":"2023-10-06T03:15:52.402120+0000","last_undegraded":"2023-10-06T03:15:52.402120+0000","last_fullsized":"2023-10-06T03:15:52.402120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413375+0000","last_change":"2023-10-06T03:15:52.401847+0000","last_active":"2023-10-06T03:15:52.413375+0000","last_peered":"2023-10-06T03:15:52.413375+0000","last_clean":"2023-10-06T03:15:52.413375+0000","last_became_active":"2023-10-06T03:15:52.401531+0000","last_became_peered":"2023-10-06T03:15:52.401531+0000","last_unstale":"2023-10-06T03:15:52.413375+0000","last_undegraded":"2023-10-06T03:15:52.413375+0000","last_fullsized":"2023-10-06T03:15:52.413375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.398194+0000","last_change":"2023-10-06T03:15:52.394021+0000","last_active":"2023-10-06T03:15:52.398194+0000","last_peered":"2023-10-06T03:15:52.398194+0000","last_clean":"2023-10-06T03:15:52.398194+0000","last_became_active":"2023-10-06T03:15:52.393712+0000","last_became_peered":"2023-10-06T03:15:52.393712+0000","last_unstale":"2023-10-06T03:15:52.398194+0000","last_undegraded":"2023-10-06T03:15:52.398194+0000","last_fullsized":"2023-10-06T03:15:52.398194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:10.769614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409766+0000","last_change":"2023-10-06T03:15:52.404215+0000","last_active":"2023-10-06T03:15:52.409766+0000","last_peered":"2023-10-06T03:15:52.409766+0000","last_clean":"2023-10-06T03:15:52.409766+0000","last_became_active":"2023-10-06T03:15:52.403876+0000","last_became_peered":"2023-10-06T03:15:52.403876+0000","last_unstale":"2023-10-06T03:15:52.409766+0000","last_undegraded":"2023-10-06T03:15:52.409766+0000","last_fullsized":"2023-10-06T03:15:52.409766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407690+0000","last_change":"2023-10-06T03:15:52.397291+0000","last_active":"2023-10-06T03:15:52.407690+0000","last_peered":"2023-10-06T03:15:52.407690+0000","last_clean":"2023-10-06T03:15:52.407690+0000","last_became_active":"2023-10-06T03:15:52.397010+0000","last_became_peered":"2023-10-06T03:15:52.397010+0000","last_unstale":"2023-10-06T03:15:52.407690+0000","last_undegraded":"2023-10-06T03:15:52.407690+0000","last_fullsized":"2023-10-06T03:15:52.407690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409687+0000","last_change":"2023-10-06T03:15:52.403844+0000","last_active":"2023-10-06T03:15:52.409687+0000","last_peered":"2023-10-06T03:15:52.409687+0000","last_clean":"2023-10-06T03:15:52.409687+0000","last_became_active":"2023-10-06T03:15:52.403593+0000","last_became_peered":"2023-10-06T03:15:52.403593+0000","last_unstale":"2023-10-06T03:15:52.409687+0000","last_undegraded":"2023-10-06T03:15:52.409687+0000","last_fullsized":"2023-10-06T03:15:52.409687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:23.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408446+0000","last_change":"2023-10-06T03:15:52.404280+0000","last_active":"2023-10-06T03:15:52.408446+0000","last_peered":"2023-10-06T03:15:52.408446+0000","last_clean":"2023-10-06T03:15:52.408446+0000","last_became_active":"2023-10-06T03:15:52.403932+0000","last_became_peered":"2023-10-06T03:15:52.403932+0000","last_unstale":"2023-10-06T03:15:52.408446+0000","last_undegraded":"2023-10-06T03:15:52.408446+0000","last_fullsized":"2023-10-06T03:15:52.408446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415370+0000","last_change":"2023-10-06T03:15:52.412076+0000","last_active":"2023-10-06T03:15:52.415370+0000","last_peered":"2023-10-06T03:15:52.415370+0000","last_clean":"2023-10-06T03:15:52.415370+0000","last_became_active":"2023-10-06T03:15:52.410526+0000","last_became_peered":"2023-10-06T03:15:52.410526+0000","last_unstale":"2023-10-06T03:15:52.415370+0000","last_undegraded":"2023-10-06T03:15:52.415370+0000","last_fullsized":"2023-10-06T03:15:52.415370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404668+0000","last_change":"2023-10-06T03:15:52.399635+0000","last_active":"2023-10-06T03:15:52.404668+0000","last_peered":"2023-10-06T03:15:52.404668+0000","last_clean":"2023-10-06T03:15:52.404668+0000","last_became_active":"2023-10-06T03:15:52.399371+0000","last_became_peered":"2023-10-06T03:15:52.399371+0000","last_unstale":"2023-10-06T03:15:52.404668+0000","last_undegraded":"2023-10-06T03:15:52.404668+0000","last_fullsized":"2023-10-06T03:15:52.404668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404276+0000","last_change":"2023-10-06T03:15:52.401220+0000","last_active":"2023-10-06T03:15:52.404276+0000","last_peered":"2023-10-06T03:15:52.404276+0000","last_clean":"2023-10-06T03:15:52.404276+0000","last_became_active":"2023-10-06T03:15:52.400120+0000","last_became_peered":"2023-10-06T03:15:52.400120+0000","last_unstale":"2023-10-06T03:15:52.404276+0000","last_undegraded":"2023-10-06T03:15:52.404276+0000","last_fullsized":"2023-10-06T03:15:52.404276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413306+0000","last_change":"2023-10-06T03:15:52.401474+0000","last_active":"2023-10-06T03:15:52.413306+0000","last_peered":"2023-10-06T03:15:52.413306+0000","last_clean":"2023-10-06T03:15:52.413306+0000","last_became_active":"2023-10-06T03:15:52.401210+0000","last_became_peered":"2023-10-06T03:15:52.401210+0000","last_unstale":"2023-10-06T03:15:52.413306+0000","last_undegraded":"2023-10-06T03:15:52.413306+0000","last_fullsized":"2023-10-06T03:15:52.413306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409165+0000","last_change":"2023-10-06T03:15:52.402928+0000","last_active":"2023-10-06T03:15:52.409165+0000","last_peered":"2023-10-06T03:15:52.409165+0000","last_clean":"2023-10-06T03:15:52.409165+0000","last_became_active":"2023-10-06T03:15:52.402659+0000","last_became_peered":"2023-10-06T03:15:52.402659+0000","last_unstale":"2023-10-06T03:15:52.409165+0000","last_undegraded":"2023-10-06T03:15:52.409165+0000","last_fullsized":"2023-10-06T03:15:52.409165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:27.381001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405592+0000","last_change":"2023-10-06T03:15:52.398134+0000","last_active":"2023-10-06T03:15:52.405592+0000","last_peered":"2023-10-06T03:15:52.405592+0000","last_clean":"2023-10-06T03:15:52.405592+0000","last_became_active":"2023-10-06T03:15:52.397881+0000","last_became_peered":"2023-10-06T03:15:52.397881+0000","last_unstale":"2023-10-06T03:15:52.405592+0000","last_undegraded":"2023-10-06T03:15:52.405592+0000","last_fullsized":"2023-10-06T03:15:52.405592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:30.488004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412503+0000","last_change":"2023-10-06T03:15:52.403876+0000","last_active":"2023-10-06T03:15:52.412503+0000","last_peered":"2023-10-06T03:15:52.412503+0000","last_clean":"2023-10-06T03:15:52.412503+0000","last_became_active":"2023-10-06T03:15:52.403598+0000","last_became_peered":"2023-10-06T03:15:52.403598+0000","last_unstale":"2023-10-06T03:15:52.412503+0000","last_undegraded":"2023-10-06T03:15:52.412503+0000","last_fullsized":"2023-10-06T03:15:52.412503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413297+0000","last_change":"2023-10-06T03:15:51.399470+0000","last_active":"2023-10-06T03:15:52.413297+0000","last_peered":"2023-10-06T03:15:52.413297+0000","last_clean":"2023-10-06T03:15:52.413297+0000","last_became_active":"2023-10-06T03:15:51.399099+0000","last_became_peered":"2023-10-06T03:15:51.399099+0000","last_unstale":"2023-10-06T03:15:52.413297+0000","last_undegraded":"2023-10-06T03:15:52.413297+0000","last_fullsized":"2023-10-06T03:15:52.413297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403880+0000","last_change":"2023-10-06T03:15:52.400465+0000","last_active":"2023-10-06T03:15:52.403880+0000","last_peered":"2023-10-06T03:15:52.403880+0000","last_clean":"2023-10-06T03:15:52.403880+0000","last_became_active":"2023-10-06T03:15:52.400175+0000","last_became_peered":"2023-10-06T03:15:52.400175+0000","last_unstale":"2023-10-06T03:15:52.403880+0000","last_undegraded":"2023-10-06T03:15:52.403880+0000","last_fullsized":"2023-10-06T03:15:52.403880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:35.985027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396234+0000","last_change":"2023-10-06T03:15:51.401117+0000","last_active":"2023-10-06T03:15:52.396234+0000","last_peered":"2023-10-06T03:15:52.396234+0000","last_clean":"2023-10-06T03:15:52.396234+0000","last_became_active":"2023-10-06T03:15:51.400839+0000","last_became_peered":"2023-10-06T03:15:51.400839+0000","last_unstale":"2023-10-06T03:15:52.396234+0000","last_undegraded":"2023-10-06T03:15:52.396234+0000","last_fullsized":"2023-10-06T03:15:52.396234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:36.643445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404590+0000","last_change":"2023-10-06T03:15:52.398565+0000","last_active":"2023-10-06T03:15:52.404590+0000","last_peered":"2023-10-06T03:15:52.404590+0000","last_clean":"2023-10-06T03:15:52.404590+0000","last_became_active":"2023-10-06T03:15:52.398307+0000","last_became_peered":"2023-10-06T03:15:52.398307+0000","last_unstale":"2023-10-06T03:15:52.404590+0000","last_undegraded":"2023-10-06T03:15:52.404590+0000","last_fullsized":"2023-10-06T03:15:52.404590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.391829+0000","last_change":"2023-10-06T03:15:51.398624+0000","last_active":"2023-10-06T03:15:52.391829+0000","last_peered":"2023-10-06T03:15:52.391829+0000","last_clean":"2023-10-06T03:15:52.391829+0000","last_became_active":"2023-10-06T03:15:51.398391+0000","last_became_peered":"2023-10-06T03:15:51.398391+0000","last_unstale":"2023-10-06T03:15:52.391829+0000","last_undegraded":"2023-10-06T03:15:52.391829+0000","last_fullsized":"2023-10-06T03:15:52.391829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407778+0000","last_change":"2023-10-06T03:15:52.401764+0000","last_active":"2023-10-06T03:15:52.407778+0000","last_peered":"2023-10-06T03:15:52.407778+0000","last_clean":"2023-10-06T03:15:52.407778+0000","last_became_active":"2023-10-06T03:15:52.401456+0000","last_became_peered":"2023-10-06T03:15:52.401456+0000","last_unstale":"2023-10-06T03:15:52.407778+0000","last_undegraded":"2023-10-06T03:15:52.407778+0000","last_fullsized":"2023-10-06T03:15:52.407778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:31.512733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.386122+0000","last_change":"2023-10-06T03:15:51.397770+0000","last_active":"2023-10-06T03:15:52.386122+0000","last_peered":"2023-10-06T03:15:52.386122+0000","last_clean":"2023-10-06T03:15:52.386122+0000","last_became_active":"2023-10-06T03:15:51.396623+0000","last_became_peered":"2023-10-06T03:15:51.396623+0000","last_unstale":"2023-10-06T03:15:52.386122+0000","last_undegraded":"2023-10-06T03:15:52.386122+0000","last_fullsized":"2023-10-06T03:15:52.386122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.401114+0000","last_change":"2023-10-06T03:15:52.399019+0000","last_active":"2023-10-06T03:15:52.401114+0000","last_peered":"2023-10-06T03:15:52.401114+0000","last_clean":"2023-10-06T03:15:52.401114+0000","last_became_active":"2023-10-06T03:15:52.398286+0000","last_became_peered":"2023-10-06T03:15:52.398286+0000","last_unstale":"2023-10-06T03:15:52.401114+0000","last_undegraded":"2023-10-06T03:15:52.401114+0000","last_fullsized":"2023-10-06T03:15:52.401114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:48.612711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388731+0000","last_change":"2023-10-06T03:15:51.397296+0000","last_active":"2023-10-06T03:15:52.388731+0000","last_peered":"2023-10-06T03:15:52.388731+0000","last_clean":"2023-10-06T03:15:52.388731+0000","last_became_active":"2023-10-06T03:15:51.397042+0000","last_became_peered":"2023-10-06T03:15:51.397042+0000","last_unstale":"2023-10-06T03:15:52.388731+0000","last_undegraded":"2023-10-06T03:15:52.388731+0000","last_fullsized":"2023-10-06T03:15:52.388731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412296+0000","last_change":"2023-10-06T03:15:52.407501+0000","last_active":"2023-10-06T03:15:52.412296+0000","last_peered":"2023-10-06T03:15:52.412296+0000","last_clean":"2023-10-06T03:15:52.412296+0000","last_became_active":"2023-10-06T03:15:52.407276+0000","last_became_peered":"2023-10-06T03:15:52.407276+0000","last_unstale":"2023-10-06T03:15:52.412296+0000","last_undegraded":"2023-10-06T03:15:52.412296+0000","last_fullsized":"2023-10-06T03:15:52.412296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418342+0000","last_change":"2023-10-06T03:15:51.401981+0000","last_active":"2023-10-06T03:15:52.418342+0000","last_peered":"2023-10-06T03:15:52.418342+0000","last_clean":"2023-10-06T03:15:52.418342+0000","last_became_active":"2023-10-06T03:15:51.401737+0000","last_became_peered":"2023-10-06T03:15:51.401737+0000","last_unstale":"2023-10-06T03:15:52.418342+0000","last_undegraded":"2023-10-06T03:15:52.418342+0000","last_fullsized":"2023-10-06T03:15:52.418342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409103+0000","last_change":"2023-10-06T03:15:52.402215+0000","last_active":"2023-10-06T03:15:52.409103+0000","last_peered":"2023-10-06T03:15:52.409103+0000","last_clean":"2023-10-06T03:15:52.409103+0000","last_became_active":"2023-10-06T03:15:52.401984+0000","last_became_peered":"2023-10-06T03:15:52.401984+0000","last_unstale":"2023-10-06T03:15:52.409103+0000","last_undegraded":"2023-10-06T03:15:52.409103+0000","last_fullsized":"2023-10-06T03:15:52.409103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.420512+0000","last_change":"2023-10-06T03:15:51.398687+0000","last_active":"2023-10-06T03:15:52.420512+0000","last_peered":"2023-10-06T03:15:52.420512+0000","last_clean":"2023-10-06T03:15:52.420512+0000","last_became_active":"2023-10-06T03:15:51.398419+0000","last_became_peered":"2023-10-06T03:15:51.398419+0000","last_unstale":"2023-10-06T03:15:52.420512+0000","last_undegraded":"2023-10-06T03:15:52.420512+0000","last_fullsized":"2023-10-06T03:15:52.420512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408183+0000","last_change":"2023-10-06T03:15:52.404174+0000","last_active":"2023-10-06T03:15:52.408183+0000","last_peered":"2023-10-06T03:15:52.408183+0000","last_clean":"2023-10-06T03:15:52.408183+0000","last_became_active":"2023-10-06T03:15:52.403892+0000","last_became_peered":"2023-10-06T03:15:52.403892+0000","last_unstale":"2023-10-06T03:15:52.408183+0000","last_undegraded":"2023-10-06T03:15:52.408183+0000","last_fullsized":"2023-10-06T03:15:52.408183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:48.612711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418455+0000","last_change":"2023-10-06T03:15:51.399272+0000","last_active":"2023-10-06T03:15:52.418455+0000","last_peered":"2023-10-06T03:15:52.418455+0000","last_clean":"2023-10-06T03:15:52.418455+0000","last_became_active":"2023-10-06T03:15:51.398980+0000","last_became_peered":"2023-10-06T03:15:51.398980+0000","last_unstale":"2023-10-06T03:15:52.418455+0000","last_undegraded":"2023-10-06T03:15:52.418455+0000","last_fullsized":"2023-10-06T03:15:52.418455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:30.507247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403724+0000","last_change":"2023-10-06T03:15:52.400547+0000","last_active":"2023-10-06T03:15:52.403724+0000","last_peered":"2023-10-06T03:15:52.403724+0000","last_clean":"2023-10-06T03:15:52.403724+0000","last_became_active":"2023-10-06T03:15:52.400318+0000","last_became_peered":"2023-10-06T03:15:52.400318+0000","last_unstale":"2023-10-06T03:15:52.403724+0000","last_undegraded":"2023-10-06T03:15:52.403724+0000","last_fullsized":"2023-10-06T03:15:52.403724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:04.891285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385392+0000","last_change":"2023-10-06T03:15:51.397316+0000","last_active":"2023-10-06T03:15:52.385392+0000","last_peered":"2023-10-06T03:15:52.385392+0000","last_clean":"2023-10-06T03:15:52.385392+0000","last_became_active":"2023-10-06T03:15:51.397057+0000","last_became_peered":"2023-10-06T03:15:51.397057+0000","last_unstale":"2023-10-06T03:15:52.385392+0000","last_undegraded":"2023-10-06T03:15:52.385392+0000","last_fullsized":"2023-10-06T03:15:52.385392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412525+0000","last_change":"2023-10-06T03:15:52.404046+0000","last_active":"2023-10-06T03:15:52.412525+0000","last_peered":"2023-10-06T03:15:52.412525+0000","last_clean":"2023-10-06T03:15:52.412525+0000","last_became_active":"2023-10-06T03:15:52.403608+0000","last_became_peered":"2023-10-06T03:15:52.403608+0000","last_unstale":"2023-10-06T03:15:52.412525+0000","last_undegraded":"2023-10-06T03:15:52.412525+0000","last_fullsized":"2023-10-06T03:15:52.412525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.393335+0000","last_change":"2023-10-06T03:15:51.400696+0000","last_active":"2023-10-06T03:15:52.393335+0000","last_peered":"2023-10-06T03:15:52.393335+0000","last_clean":"2023-10-06T03:15:52.393335+0000","last_became_active":"2023-10-06T03:15:51.400423+0000","last_became_peered":"2023-10-06T03:15:51.400423+0000","last_unstale":"2023-10-06T03:15:52.393335+0000","last_undegraded":"2023-10-06T03:15:52.393335+0000","last_fullsized":"2023-10-06T03:15:52.393335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:47.458357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409679+0000","last_change":"2023-10-06T03:15:52.402973+0000","last_active":"2023-10-06T03:15:52.409679+0000","last_peered":"2023-10-06T03:15:52.409679+0000","last_clean":"2023-10-06T03:15:52.409679+0000","last_became_active":"2023-10-06T03:15:52.402707+0000","last_became_peered":"2023-10-06T03:15:52.402707+0000","last_unstale":"2023-10-06T03:15:52.409679+0000","last_undegraded":"2023-10-06T03:15:52.409679+0000","last_fullsized":"2023-10-06T03:15:52.409679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418712+0000","last_change":"2023-10-06T03:15:51.398207+0000","last_active":"2023-10-06T03:15:52.418712+0000","last_peered":"2023-10-06T03:15:52.418712+0000","last_clean":"2023-10-06T03:15:52.418712+0000","last_became_active":"2023-10-06T03:15:51.397903+0000","last_became_peered":"2023-10-06T03:15:51.397903+0000","last_unstale":"2023-10-06T03:15:52.418712+0000","last_undegraded":"2023-10-06T03:15:52.418712+0000","last_fullsized":"2023-10-06T03:15:52.418712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415171+0000","last_change":"2023-10-06T03:15:52.411310+0000","last_active":"2023-10-06T03:15:52.415171+0000","last_peered":"2023-10-06T03:15:52.415171+0000","last_clean":"2023-10-06T03:15:52.415171+0000","last_became_active":"2023-10-06T03:15:52.411060+0000","last_became_peered":"2023-10-06T03:15:52.411060+0000","last_unstale":"2023-10-06T03:15:52.415171+0000","last_undegraded":"2023-10-06T03:15:52.415171+0000","last_fullsized":"2023-10-06T03:15:52.415171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418008+0000","last_change":"2023-10-06T03:15:51.399461+0000","last_active":"2023-10-06T03:15:52.418008+0000","last_peered":"2023-10-06T03:15:52.418008+0000","last_clean":"2023-10-06T03:15:52.418008+0000","last_became_active":"2023-10-06T03:15:51.398657+0000","last_became_peered":"2023-10-06T03:15:51.398657+0000","last_unstale":"2023-10-06T03:15:52.418008+0000","last_undegraded":"2023-10-06T03:15:52.418008+0000","last_fullsized":"2023-10-06T03:15:52.418008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.595391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412382+0000","last_change":"2023-10-06T03:15:52.401919+0000","last_active":"2023-10-06T03:15:52.412382+0000","last_peered":"2023-10-06T03:15:52.412382+0000","last_clean":"2023-10-06T03:15:52.412382+0000","last_became_active":"2023-10-06T03:15:52.401624+0000","last_became_peered":"2023-10-06T03:15:52.401624+0000","last_unstale":"2023-10-06T03:15:52.412382+0000","last_undegraded":"2023-10-06T03:15:52.412382+0000","last_fullsized":"2023-10-06T03:15:52.412382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418041+0000","last_change":"2023-10-06T03:15:51.399919+0000","last_active":"2023-10-06T03:15:52.418041+0000","last_peered":"2023-10-06T03:15:52.418041+0000","last_clean":"2023-10-06T03:15:52.418041+0000","last_became_active":"2023-10-06T03:15:51.399678+0000","last_became_peered":"2023-10-06T03:15:51.399678+0000","last_unstale":"2023-10-06T03:15:52.418041+0000","last_undegraded":"2023-10-06T03:15:52.418041+0000","last_fullsized":"2023-10-06T03:15:52.418041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:57.295789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.406812+0000","last_change":"2023-10-06T03:15:52.397998+0000","last_active":"2023-10-06T03:15:52.406812+0000","last_peered":"2023-10-06T03:15:52.406812+0000","last_clean":"2023-10-06T03:15:52.406812+0000","last_became_active":"2023-10-06T03:15:52.397706+0000","last_became_peered":"2023-10-06T03:15:52.397706+0000","last_unstale":"2023-10-06T03:15:52.406812+0000","last_undegraded":"2023-10-06T03:15:52.406812+0000","last_fullsized":"2023-10-06T03:15:52.406812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:32.121745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.417854+0000","last_change":"2023-10-06T03:15:51.401427+0000","last_active":"2023-10-06T03:15:52.417854+0000","last_peered":"2023-10-06T03:15:52.417854+0000","last_clean":"2023-10-06T03:15:52.417854+0000","last_became_active":"2023-10-06T03:15:51.401124+0000","last_became_peered":"2023-10-06T03:15:51.401124+0000","last_unstale":"2023-10-06T03:15:52.417854+0000","last_undegraded":"2023-10-06T03:15:52.417854+0000","last_fullsized":"2023-10-06T03:15:52.417854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:41.329304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407021+0000","last_change":"2023-10-06T03:15:52.398501+0000","last_active":"2023-10-06T03:15:52.407021+0000","last_peered":"2023-10-06T03:15:52.407021+0000","last_clean":"2023-10-06T03:15:52.407021+0000","last_became_active":"2023-10-06T03:15:52.398218+0000","last_became_peered":"2023-10-06T03:15:52.398218+0000","last_unstale":"2023-10-06T03:15:52.407021+0000","last_undegraded":"2023-10-06T03:15:52.407021+0000","last_fullsized":"2023-10-06T03:15:52.407021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:58.301276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.389184+0000","last_change":"2023-10-06T03:15:51.398288+0000","last_active":"2023-10-06T03:15:52.389184+0000","last_peered":"2023-10-06T03:15:52.389184+0000","last_clean":"2023-10-06T03:15:52.389184+0000","last_became_active":"2023-10-06T03:15:51.398015+0000","last_became_peered":"2023-10-06T03:15:51.398015+0000","last_unstale":"2023-10-06T03:15:52.389184+0000","last_undegraded":"2023-10-06T03:15:52.389184+0000","last_fullsized":"2023-10-06T03:15:52.389184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404625+0000","last_change":"2023-10-06T03:15:52.398846+0000","last_active":"2023-10-06T03:15:52.404625+0000","last_peered":"2023-10-06T03:15:52.404625+0000","last_clean":"2023-10-06T03:15:52.404625+0000","last_became_active":"2023-10-06T03:15:52.398603+0000","last_became_peered":"2023-10-06T03:15:52.398603+0000","last_unstale":"2023-10-06T03:15:52.404625+0000","last_undegraded":"2023-10-06T03:15:52.404625+0000","last_fullsized":"2023-10-06T03:15:52.404625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412777+0000","last_change":"2023-10-06T03:15:51.407297+0000","last_active":"2023-10-06T03:15:52.412777+0000","last_peered":"2023-10-06T03:15:52.412777+0000","last_clean":"2023-10-06T03:15:52.412777+0000","last_became_active":"2023-10-06T03:15:51.407027+0000","last_became_peered":"2023-10-06T03:15:51.407027+0000","last_unstale":"2023-10-06T03:15:52.412777+0000","last_undegraded":"2023-10-06T03:15:52.412777+0000","last_fullsized":"2023-10-06T03:15:52.412777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.595391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408429+0000","last_change":"2023-10-06T03:15:52.401694+0000","last_active":"2023-10-06T03:15:52.408429+0000","last_peered":"2023-10-06T03:15:52.408429+0000","last_clean":"2023-10-06T03:15:52.408429+0000","last_became_active":"2023-10-06T03:15:52.401416+0000","last_became_peered":"2023-10-06T03:15:52.401416+0000","last_unstale":"2023-10-06T03:15:52.408429+0000","last_undegraded":"2023-10-06T03:15:52.408429+0000","last_fullsized":"2023-10-06T03:15:52.408429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:01.423050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395011+0000","last_change":"2023-10-06T03:15:51.396237+0000","last_active":"2023-10-06T03:15:52.395011+0000","last_peered":"2023-10-06T03:15:52.395011+0000","last_clean":"2023-10-06T03:15:52.395011+0000","last_became_active":"2023-10-06T03:15:51.395961+0000","last_became_peered":"2023-10-06T03:15:51.395961+0000","last_unstale":"2023-10-06T03:15:52.395011+0000","last_undegraded":"2023-10-06T03:15:52.395011+0000","last_fullsized":"2023-10-06T03:15:52.395011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403024+0000","last_change":"2023-10-06T03:15:52.397196+0000","last_active":"2023-10-06T03:15:52.403024+0000","last_peered":"2023-10-06T03:15:52.403024+0000","last_clean":"2023-10-06T03:15:52.403024+0000","last_became_active":"2023-10-06T03:15:52.396909+0000","last_became_peered":"2023-10-06T03:15:52.396909+0000","last_unstale":"2023-10-06T03:15:52.403024+0000","last_undegraded":"2023-10-06T03:15:52.403024+0000","last_fullsized":"2023-10-06T03:15:52.403024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:04.891285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388015+0000","last_change":"2023-10-06T03:15:51.397413+0000","last_active":"2023-10-06T03:15:52.388015+0000","last_peered":"2023-10-06T03:15:52.388015+0000","last_clean":"2023-10-06T03:15:52.388015+0000","last_became_active":"2023-10-06T03:15:51.397074+0000","last_became_peered":"2023-10-06T03:15:51.397074+0000","last_unstale":"2023-10-06T03:15:52.388015+0000","last_undegraded":"2023-10-06T03:15:52.388015+0000","last_fullsized":"2023-10-06T03:15:52.388015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408667+0000","last_change":"2023-10-06T03:15:52.405384+0000","last_active":"2023-10-06T03:15:52.408667+0000","last_peered":"2023-10-06T03:15:52.408667+0000","last_clean":"2023-10-06T03:15:52.408667+0000","last_became_active":"2023-10-06T03:15:52.405148+0000","last_became_peered":"2023-10-06T03:15:52.405148+0000","last_unstale":"2023-10-06T03:15:52.408667+0000","last_undegraded":"2023-10-06T03:15:52.408667+0000","last_fullsized":"2023-10-06T03:15:52.408667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395105+0000","last_change":"2023-10-06T03:15:51.401070+0000","last_active":"2023-10-06T03:15:52.395105+0000","last_peered":"2023-10-06T03:15:52.395105+0000","last_clean":"2023-10-06T03:15:52.395105+0000","last_became_active":"2023-10-06T03:15:51.400536+0000","last_became_peered":"2023-10-06T03:15:51.400536+0000","last_unstale":"2023-10-06T03:15:52.395105+0000","last_undegraded":"2023-10-06T03:15:52.395105+0000","last_fullsized":"2023-10-06T03:15:52.395105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405811+0000","last_change":"2023-10-06T03:15:52.401281+0000","last_active":"2023-10-06T03:15:52.405811+0000","last_peered":"2023-10-06T03:15:52.405811+0000","last_clean":"2023-10-06T03:15:52.405811+0000","last_became_active":"2023-10-06T03:15:52.401028+0000","last_became_peered":"2023-10-06T03:15:52.401028+0000","last_unstale":"2023-10-06T03:15:52.405811+0000","last_undegraded":"2023-10-06T03:15:52.405811+0000","last_fullsized":"2023-10-06T03:15:52.405811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415300+0000","last_change":"2023-10-06T03:15:51.398105+0000","last_active":"2023-10-06T03:15:52.415300+0000","last_peered":"2023-10-06T03:15:52.415300+0000","last_clean":"2023-10-06T03:15:52.415300+0000","last_became_active":"2023-10-06T03:15:51.397877+0000","last_became_peered":"2023-10-06T03:15:51.397877+0000","last_unstale":"2023-10-06T03:15:52.415300+0000","last_undegraded":"2023-10-06T03:15:52.415300+0000","last_fullsized":"2023-10-06T03:15:52.415300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388474+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:15:52.388474+0000","last_peered":"2023-10-06T03:15:52.388474+0000","last_clean":"2023-10-06T03:15:52.388474+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:15:52.388474+0000","last_undegraded":"2023-10-06T03:15:52.388474+0000","last_fullsized":"2023-10-06T03:15:52.388474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412308+0000","last_change":"2023-10-06T03:15:52.407538+0000","last_active":"2023-10-06T03:15:52.412308+0000","last_peered":"2023-10-06T03:15:52.412308+0000","last_clean":"2023-10-06T03:15:52.412308+0000","last_became_active":"2023-10-06T03:15:52.407273+0000","last_became_peered":"2023-10-06T03:15:52.407273+0000","last_unstale":"2023-10-06T03:15:52.412308+0000","last_undegraded":"2023-10-06T03:15:52.412308+0000","last_fullsized":"2023-10-06T03:15:52.412308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:24.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392479+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:15:52.392479+0000","last_peered":"2023-10-06T03:15:52.392479+0000","last_clean":"2023-10-06T03:15:52.392479+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:15:52.392479+0000","last_undegraded":"2023-10-06T03:15:52.392479+0000","last_fullsized":"2023-10-06T03:15:52.392479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385832+0000","last_change":"2023-10-06T03:15:51.399935+0000","last_active":"2023-10-06T03:15:52.385832+0000","last_peered":"2023-10-06T03:15:52.385832+0000","last_clean":"2023-10-06T03:15:52.385832+0000","last_became_active":"2023-10-06T03:15:51.399621+0000","last_became_peered":"2023-10-06T03:15:51.399621+0000","last_unstale":"2023-10-06T03:15:52.385832+0000","last_undegraded":"2023-10-06T03:15:52.385832+0000","last_fullsized":"2023-10-06T03:15:52.385832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396231+0000","last_change":"2023-10-06T03:15:52.390913+0000","last_active":"2023-10-06T03:15:52.396231+0000","last_peered":"2023-10-06T03:15:52.396231+0000","last_clean":"2023-10-06T03:15:52.396231+0000","last_became_active":"2023-10-06T03:15:52.390637+0000","last_became_peered":"2023-10-06T03:15:52.390637+0000","last_unstale":"2023-10-06T03:15:52.396231+0000","last_undegraded":"2023-10-06T03:15:52.396231+0000","last_fullsized":"2023-10-06T03:15:52.396231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:52.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396289+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:15:52.396289+0000","last_peered":"2023-10-06T03:15:52.396289+0000","last_clean":"2023-10-06T03:15:52.396289+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:15:52.396289+0000","last_undegraded":"2023-10-06T03:15:52.396289+0000","last_fullsized":"2023-10-06T03:15:52.396289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392848+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:15:52.392848+0000","last_peered":"2023-10-06T03:15:52.392848+0000","last_clean":"2023-10-06T03:15:52.392848+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:15:52.392848+0000","last_undegraded":"2023-10-06T03:15:52.392848+0000","last_fullsized":"2023-10-06T03:15:52.392848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385325+0000","last_change":"2023-10-06T03:15:51.396703+0000","last_active":"2023-10-06T03:15:52.385325+0000","last_peered":"2023-10-06T03:15:52.385325+0000","last_clean":"2023-10-06T03:15:52.385325+0000","last_became_active":"2023-10-06T03:15:51.396436+0000","last_became_peered":"2023-10-06T03:15:51.396436+0000","last_unstale":"2023-10-06T03:15:52.385325+0000","last_undegraded":"2023-10-06T03:15:52.385325+0000","last_fullsized":"2023-10-06T03:15:52.385325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404610+0000","last_change":"2023-10-06T03:15:52.399034+0000","last_active":"2023-10-06T03:15:52.404610+0000","last_peered":"2023-10-06T03:15:52.404610+0000","last_clean":"2023-10-06T03:15:52.404610+0000","last_became_active":"2023-10-06T03:15:52.398801+0000","last_became_peered":"2023-10-06T03:15:52.398801+0000","last_unstale":"2023-10-06T03:15:52.404610+0000","last_undegraded":"2023-10-06T03:15:52.404610+0000","last_fullsized":"2023-10-06T03:15:52.404610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.393310+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:15:52.393310+0000","last_peered":"2023-10-06T03:15:52.393310+0000","last_clean":"2023-10-06T03:15:52.393310+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:15:52.393310+0000","last_undegraded":"2023-10-06T03:15:52.393310+0000","last_fullsized":"2023-10-06T03:15:52.393310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395966+0000","last_change":"2023-10-06T03:15:51.397023+0000","last_active":"2023-10-06T03:15:52.395966+0000","last_peered":"2023-10-06T03:15:52.395966+0000","last_clean":"2023-10-06T03:15:52.395966+0000","last_became_active":"2023-10-06T03:15:51.396769+0000","last_became_peered":"2023-10-06T03:15:51.396769+0000","last_unstale":"2023-10-06T03:15:52.395966+0000","last_undegraded":"2023-10-06T03:15:52.395966+0000","last_fullsized":"2023-10-06T03:15:52.395966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402231+0000","last_change":"2023-10-06T03:15:52.397382+0000","last_active":"2023-10-06T03:15:52.402231+0000","last_peered":"2023-10-06T03:15:52.402231+0000","last_clean":"2023-10-06T03:15:52.402231+0000","last_became_active":"2023-10-06T03:15:52.397128+0000","last_became_peered":"2023-10-06T03:15:52.397128+0000","last_unstale":"2023-10-06T03:15:52.402231+0000","last_undegraded":"2023-10-06T03:15:52.402231+0000","last_fullsized":"2023-10-06T03:15:52.402231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392559+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:15:52.392559+0000","last_peered":"2023-10-06T03:15:52.392559+0000","last_clean":"2023-10-06T03:15:52.392559+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:15:52.392559+0000","last_undegraded":"2023-10-06T03:15:52.392559+0000","last_fullsized":"2023-10-06T03:15:52.392559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.394632+0000","last_change":"2023-10-06T03:15:51.401653+0000","last_active":"2023-10-06T03:15:52.394632+0000","last_peered":"2023-10-06T03:15:52.394632+0000","last_clean":"2023-10-06T03:15:52.394632+0000","last_became_active":"2023-10-06T03:15:51.401467+0000","last_became_peered":"2023-10-06T03:15:51.401467+0000","last_unstale":"2023-10-06T03:15:52.394632+0000","last_undegraded":"2023-10-06T03:15:52.394632+0000","last_fullsized":"2023-10-06T03:15:52.394632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407029+0000","last_change":"2023-10-06T03:15:52.399597+0000","last_active":"2023-10-06T03:15:52.407029+0000","last_peered":"2023-10-06T03:15:52.407029+0000","last_clean":"2023-10-06T03:15:52.407029+0000","last_became_active":"2023-10-06T03:15:52.399333+0000","last_became_peered":"2023-10-06T03:15:52.399333+0000","last_unstale":"2023-10-06T03:15:52.407029+0000","last_undegraded":"2023-10-06T03:15:52.407029+0000","last_fullsized":"2023-10-06T03:15:52.407029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:42.334791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388470+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:15:52.388470+0000","last_peered":"2023-10-06T03:15:52.388470+0000","last_clean":"2023-10-06T03:15:52.388470+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:15:52.388470+0000","last_undegraded":"2023-10-06T03:15:52.388470+0000","last_fullsized":"2023-10-06T03:15:52.388470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.387909+0000","last_change":"2023-10-06T03:15:51.397390+0000","last_active":"2023-10-06T03:15:52.387909+0000","last_peered":"2023-10-06T03:15:52.387909+0000","last_clean":"2023-10-06T03:15:52.387909+0000","last_became_active":"2023-10-06T03:15:51.397066+0000","last_became_peered":"2023-10-06T03:15:51.397066+0000","last_unstale":"2023-10-06T03:15:52.387909+0000","last_undegraded":"2023-10-06T03:15:52.387909+0000","last_fullsized":"2023-10-06T03:15:52.387909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402326+0000","last_change":"2023-10-06T03:15:52.397246+0000","last_active":"2023-10-06T03:15:52.402326+0000","last_peered":"2023-10-06T03:15:52.402326+0000","last_clean":"2023-10-06T03:15:52.402326+0000","last_became_active":"2023-10-06T03:15:52.396967+0000","last_became_peered":"2023-10-06T03:15:52.396967+0000","last_unstale":"2023-10-06T03:15:52.402326+0000","last_undegraded":"2023-10-06T03:15:52.402326+0000","last_fullsized":"2023-10-06T03:15:52.402326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:38.322802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.394796+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:15:52.394796+0000","last_peered":"2023-10-06T03:15:52.394796+0000","last_clean":"2023-10-06T03:15:52.394796+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:15:52.394796+0000","last_undegraded":"2023-10-06T03:15:52.394796+0000","last_fullsized":"2023-10-06T03:15:52.394796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396400+0000","last_change":"2023-10-06T03:15:51.398607+0000","last_active":"2023-10-06T03:15:52.396400+0000","last_peered":"2023-10-06T03:15:52.396400+0000","last_clean":"2023-10-06T03:15:52.396400+0000","last_became_active":"2023-10-06T03:15:51.398350+0000","last_became_peered":"2023-10-06T03:15:51.398350+0000","last_unstale":"2023-10-06T03:15:52.396400+0000","last_undegraded":"2023-10-06T03:15:52.396400+0000","last_fullsized":"2023-10-06T03:15:52.396400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396430+0000","last_change":"2023-10-06T03:15:52.390631+0000","last_active":"2023-10-06T03:15:52.396430+0000","last_peered":"2023-10-06T03:15:52.396430+0000","last_clean":"2023-10-06T03:15:52.396430+0000","last_became_active":"2023-10-06T03:15:52.390376+0000","last_became_peered":"2023-10-06T03:15:52.390376+0000","last_unstale":"2023-10-06T03:15:52.396430+0000","last_undegraded":"2023-10-06T03:15:52.396430+0000","last_fullsized":"2023-10-06T03:15:52.396430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:38.322802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395054+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:15:52.395054+0000","last_peered":"2023-10-06T03:15:52.395054+0000","last_clean":"2023-10-06T03:15:52.395054+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:15:52.395054+0000","last_undegraded":"2023-10-06T03:15:52.395054+0000","last_fullsized":"2023-10-06T03:15:52.395054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.389055+0000","last_change":"2023-10-06T03:15:51.398658+0000","last_active":"2023-10-06T03:15:52.389055+0000","last_peered":"2023-10-06T03:15:52.389055+0000","last_clean":"2023-10-06T03:15:52.389055+0000","last_became_active":"2023-10-06T03:15:51.397983+0000","last_became_peered":"2023-10-06T03:15:51.397983+0000","last_unstale":"2023-10-06T03:15:52.389055+0000","last_undegraded":"2023-10-06T03:15:52.389055+0000","last_fullsized":"2023-10-06T03:15:52.389055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402303+0000","last_change":"2023-10-06T03:15:52.397235+0000","last_active":"2023-10-06T03:15:52.402303+0000","last_peered":"2023-10-06T03:15:52.402303+0000","last_clean":"2023-10-06T03:15:52.402303+0000","last_became_active":"2023-10-06T03:15:52.396993+0000","last_became_peered":"2023-10-06T03:15:52.396993+0000","last_unstale":"2023-10-06T03:15:52.402303+0000","last_undegraded":"2023-10-06T03:15:52.402303+0000","last_fullsized":"2023-10-06T03:15:52.402303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418401+0000","last_change":"2023-10-06T03:15:51.396724+0000","last_active":"2023-10-06T03:15:52.418401+0000","last_peered":"2023-10-06T03:15:52.418401+0000","last_clean":"2023-10-06T03:15:52.418401+0000","last_became_active":"2023-10-06T03:15:51.396495+0000","last_became_peered":"2023-10-06T03:15:51.396495+0000","last_unstale":"2023-10-06T03:15:52.418401+0000","last_undegraded":"2023-10-06T03:15:52.418401+0000","last_fullsized":"2023-10-06T03:15:52.418401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404335+0000","last_change":"2023-10-06T03:15:52.399707+0000","last_active":"2023-10-06T03:15:52.404335+0000","last_peered":"2023-10-06T03:15:52.404335+0000","last_clean":"2023-10-06T03:15:52.404335+0000","last_became_active":"2023-10-06T03:15:52.399315+0000","last_became_peered":"2023-10-06T03:15:52.399315+0000","last_unstale":"2023-10-06T03:15:52.404335+0000","last_undegraded":"2023-10-06T03:15:52.404335+0000","last_fullsized":"2023-10-06T03:15:52.404335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:55.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412599+0000","last_change":"2023-10-06T03:15:51.394879+0000","last_active":"2023-10-06T03:15:52.412599+0000","last_peered":"2023-10-06T03:15:52.412599+0000","last_clean":"2023-10-06T03:15:52.412599+0000","last_became_active":"2023-10-06T03:15:51.394338+0000","last_became_peered":"2023-10-06T03:15:51.394338+0000","last_unstale":"2023-10-06T03:15:52.412599+0000","last_undegraded":"2023-10-06T03:15:52.412599+0000","last_fullsized":"2023-10-06T03:15:52.412599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407753+0000","last_change":"2023-10-06T03:15:52.400514+0000","last_active":"2023-10-06T03:15:52.407753+0000","last_peered":"2023-10-06T03:15:52.407753+0000","last_clean":"2023-10-06T03:15:52.407753+0000","last_became_active":"2023-10-06T03:15:52.399876+0000","last_became_peered":"2023-10-06T03:15:52.399876+0000","last_unstale":"2023-10-06T03:15:52.407753+0000","last_undegraded":"2023-10-06T03:15:52.407753+0000","last_fullsized":"2023-10-06T03:15:52.407753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:27.152523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412710+0000","last_change":"2023-10-06T03:15:51.394704+0000","last_active":"2023-10-06T03:15:52.412710+0000","last_peered":"2023-10-06T03:15:52.412710+0000","last_clean":"2023-10-06T03:15:52.412710+0000","last_became_active":"2023-10-06T03:15:51.394420+0000","last_became_peered":"2023-10-06T03:15:51.394420+0000","last_unstale":"2023-10-06T03:15:52.412710+0000","last_undegraded":"2023-10-06T03:15:52.412710+0000","last_fullsized":"2023-10-06T03:15:52.412710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408476+0000","last_change":"2023-10-06T03:15:52.401606+0000","last_active":"2023-10-06T03:15:52.408476+0000","last_peered":"2023-10-06T03:15:52.408476+0000","last_clean":"2023-10-06T03:15:52.408476+0000","last_became_active":"2023-10-06T03:15:52.401319+0000","last_became_peered":"2023-10-06T03:15:52.401319+0000","last_unstale":"2023-10-06T03:15:52.408476+0000","last_undegraded":"2023-10-06T03:15:52.408476+0000","last_fullsized":"2023-10-06T03:15:52.408476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:26.415006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.414847+0000","last_change":"2023-10-06T03:15:51.397229+0000","last_active":"2023-10-06T03:15:52.414847+0000","last_peered":"2023-10-06T03:15:52.414847+0000","last_clean":"2023-10-06T03:15:52.414847+0000","last_became_active":"2023-10-06T03:15:51.396971+0000","last_became_peered":"2023-10-06T03:15:51.396971+0000","last_unstale":"2023-10-06T03:15:52.414847+0000","last_undegraded":"2023-10-06T03:15:52.414847+0000","last_fullsized":"2023-10-06T03:15:52.414847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403707+0000","last_change":"2023-10-06T03:15:52.399759+0000","last_active":"2023-10-06T03:15:52.403707+0000","last_peered":"2023-10-06T03:15:52.403707+0000","last_clean":"2023-10-06T03:15:52.403707+0000","last_became_active":"2023-10-06T03:15:52.399459+0000","last_became_peered":"2023-10-06T03:15:52.399459+0000","last_unstale":"2023-10-06T03:15:52.403707+0000","last_undegraded":"2023-10-06T03:15:52.403707+0000","last_fullsized":"2023-10-06T03:15:52.403707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418238+0000","last_change":"2023-10-06T03:15:51.398436+0000","last_active":"2023-10-06T03:15:52.418238+0000","last_peered":"2023-10-06T03:15:52.418238+0000","last_clean":"2023-10-06T03:15:52.418238+0000","last_became_active":"2023-10-06T03:15:51.397582+0000","last_became_peered":"2023-10-06T03:15:51.397582+0000","last_unstale":"2023-10-06T03:15:52.418238+0000","last_undegraded":"2023-10-06T03:15:52.418238+0000","last_fullsized":"2023-10-06T03:15:52.418238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402534+0000","last_change":"2023-10-06T03:15:52.396983+0000","last_active":"2023-10-06T03:15:52.402534+0000","last_peered":"2023-10-06T03:15:52.402534+0000","last_clean":"2023-10-06T03:15:52.402534+0000","last_became_active":"2023-10-06T03:15:52.396686+0000","last_became_peered":"2023-10-06T03:15:52.396686+0000","last_unstale":"2023-10-06T03:15:52.402534+0000","last_undegraded":"2023-10-06T03:15:52.402534+0000","last_fullsized":"2023-10-06T03:15:52.402534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.410272+0000","last_change":"2023-10-06T03:15:52.402390+0000","last_active":"2023-10-06T03:15:52.410272+0000","last_peered":"2023-10-06T03:15:52.410272+0000","last_clean":"2023-10-06T03:15:52.410272+0000","last_became_active":"2023-10-06T03:15:52.402104+0000","last_became_peered":"2023-10-06T03:15:52.402104+0000","last_unstale":"2023-10-06T03:15:52.410272+0000","last_undegraded":"2023-10-06T03:15:52.410272+0000","last_fullsized":"2023-10-06T03:15:52.410272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403729+0000","last_change":"2023-10-06T03:15:52.400667+0000","last_active":"2023-10-06T03:15:52.403729+0000","last_peered":"2023-10-06T03:15:52.403729+0000","last_clean":"2023-10-06T03:15:52.403729+0000","last_became_active":"2023-10-06T03:15:52.399974+0000","last_became_peered":"2023-10-06T03:15:52.399974+0000","last_unstale":"2023-10-06T03:15:52.403729+0000","last_undegraded":"2023-10-06T03:15:52.403729+0000","last_fullsized":"2023-10-06T03:15:52.403729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:52.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408497+0000","last_change":"2023-10-06T03:15:52.404305+0000","last_active":"2023-10-06T03:15:52.408497+0000","last_peered":"2023-10-06T03:15:52.408497+0000","last_clean":"2023-10-06T03:15:52.408497+0000","last_became_active":"2023-10-06T03:15:52.403971+0000","last_became_peered":"2023-10-06T03:15:52.403971+0000","last_unstale":"2023-10-06T03:15:52.408497+0000","last_undegraded":"2023-10-06T03:15:52.408497+0000","last_fullsized":"2023-10-06T03:15:52.408497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.002827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412347+0000","last_change":"2023-10-06T03:15:52.407238+0000","last_active":"2023-10-06T03:15:52.412347+0000","last_peered":"2023-10-06T03:15:52.412347+0000","last_clean":"2023-10-06T03:15:52.412347+0000","last_became_active":"2023-10-06T03:15:52.406982+0000","last_became_peered":"2023-10-06T03:15:52.406982+0000","last_unstale":"2023-10-06T03:15:52.412347+0000","last_undegraded":"2023-10-06T03:15:52.412347+0000","last_fullsized":"2023-10-06T03:15:52.412347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409124+0000","last_change":"2023-10-06T03:15:52.402218+0000","last_active":"2023-10-06T03:15:52.409124+0000","last_peered":"2023-10-06T03:15:52.409124+0000","last_clean":"2023-10-06T03:15:52.409124+0000","last_became_active":"2023-10-06T03:15:52.401956+0000","last_became_peered":"2023-10-06T03:15:52.401956+0000","last_unstale":"2023-10-06T03:15:52.409124+0000","last_undegraded":"2023-10-06T03:15:52.409124+0000","last_fullsized":"2023-10-06T03:15:52.409124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":664951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":192512,"data_stored":66280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:15:56.817 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:15:56.817 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T03:15:56.817 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T03:15:56.818 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T03:15:56.818 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T03:15:56.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.961+0000 7ff891604700 1 Processor -- start 2023-10-06T03:15:57.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.961+0000 7ff891604700 1 -- start start 2023-10-06T03:15:57.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff891604700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d850 0x7ff88c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff891604700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff88c0b6170 0x7ff88c0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff891604700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88c069f70 con 0x7ff88c15d480 2023-10-06T03:15:57.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff891604700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88c0687c0 con 0x7ff88c0b6170 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff891604700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c068aa0 con 0x7ff88c15d850 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff890e03700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff88c0b6170 0x7ff88c0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff88b7fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d850 0x7ff88c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff88bfff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff88c15d480 0x7ff88c069860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:39032/0 (socket says 172.21.15.82:39032) 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.962+0000 7ff88bfff700 1 -- 172.21.15.82:0/4071043514 learned_addr learned my addr 172.21.15.82:0/4071043514 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff88affd700 1 -- 172.21.15.82:0/4071043514 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610687594 0 0) 0x7ff88c069f70 con 0x7ff88c15d480 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff890e03700 1 -- 172.21.15.82:0/4071043514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d850 msgr2=0x7ff88c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff890e03700 1 --2- 172.21.15.82:0/4071043514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d850 0x7ff88c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff890e03700 1 -- 172.21.15.82:0/4071043514 >> v1:172.21.15.134:6789/0 conn(0x7ff88c15d480 legacy=0x7ff88c069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff890e03700 1 -- 172.21.15.82:0/4071043514 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c068d80 con 0x7ff88c0b6170 2023-10-06T03:15:57.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff890e03700 1 --2- 172.21.15.82:0/4071043514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c0b0310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff884009e60 tx=0x7ff884009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06fc28790de925 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff88affd700 1 -- 172.21.15.82:0/4071043514 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88400e070 con 0x7ff88c0b6170 2023-10-06T03:15:57.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff88affd700 1 -- 172.21.15.82:0/4071043514 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88400bb60 con 0x7ff88c0b6170 2023-10-06T03:15:57.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff88affd700 1 -- 172.21.15.82:0/4071043514 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884012430 con 0x7ff88c0b6170 2023-10-06T03:15:57.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff891604700 1 -- 172.21.15.82:0/4071043514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 msgr2=0x7ff88c0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff891604700 1 --2- 172.21.15.82:0/4071043514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c0b0310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff884009e60 tx=0x7ff884009780 comp rx=0 tx=0).stop 2023-10-06T03:15:57.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff891604700 1 -- 172.21.15.82:0/4071043514 shutdown_connections 2023-10-06T03:15:57.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff891604700 1 --2- 172.21.15.82:0/4071043514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c0b0310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff891604700 1 --2- 172.21.15.82:0/4071043514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d850 0x7ff88c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.963+0000 7ff891604700 1 -- 172.21.15.82:0/4071043514 >> 172.21.15.82:0/4071043514 conn(0x7ff88c0ccf80 msgr2=0x7ff88c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.964+0000 7ff891604700 1 -- 172.21.15.82:0/4071043514 shutdown_connections 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.964+0000 7ff891604700 1 -- 172.21.15.82:0/4071043514 wait complete. 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.965+0000 7ff891604700 1 Processor -- start 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.965+0000 7ff891604700 1 -- start start 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.965+0000 7ff891604700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c13df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.965+0000 7ff891604700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d480 0x7ff88c16ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.965+0000 7ff891604700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c15d850 0x7ff88c0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.965+0000 7ff891604700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c0cb4b0 con 0x7ff88c0b6170 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.965+0000 7ff891604700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c14e7d0 con 0x7ff88c15d850 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.965+0000 7ff891604700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c16d920 con 0x7ff88c15d480 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c13df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c13df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47684/0 (socket says 172.21.15.82:47684) 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 -- 172.21.15.82:0/93520711 learned_addr learned my addr 172.21.15.82:0/93520711 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88b7fe700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d480 0x7ff88c16ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 -- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d480 msgr2=0x7ff88c16ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff890e03700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c15d850 0x7ff88c0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d480 0x7ff88c16ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 -- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c15d850 msgr2=0x7ff88c0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c15d850 0x7ff88c0c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 -- 172.21.15.82:0/93520711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884009a20 con 0x7ff88c0b6170 2023-10-06T03:15:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88b7fe700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d480 0x7ff88c16ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff88bfff700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c13df80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00c7e0 tx=0x7ff87c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff873fff700 1 -- 172.21.15.82:0/93520711 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c005b30 con 0x7ff88c0b6170 2023-10-06T03:15:57.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff873fff700 1 -- 172.21.15.82:0/93520711 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c005c90 con 0x7ff88c0b6170 2023-10-06T03:15:57.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c16dc00 con 0x7ff88c0b6170 2023-10-06T03:15:57.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff873fff700 1 -- 172.21.15.82:0/93520711 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c007300 con 0x7ff88c0b6170 2023-10-06T03:15:57.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.966+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c0cadf0 con 0x7ff88c0b6170 2023-10-06T03:15:57.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.967+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88c04c3c0 con 0x7ff88c0b6170 2023-10-06T03:15:57.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.967+0000 7ff873fff700 1 -- 172.21.15.82:0/93520711 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff87c01b400 con 0x7ff88c0b6170 2023-10-06T03:15:57.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.968+0000 7ff873fff700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff878066f30 0x7ff8780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.968+0000 7ff873fff700 1 -- 172.21.15.82:0/93520711 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff87c084190 con 0x7ff88c0b6170 2023-10-06T03:15:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.968+0000 7ff88b7fe700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff878066f30 0x7ff8780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.968+0000 7ff88b7fe700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff878066f30 0x7ff8780693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff880006f00 tx=0x7ff880008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:56.972+0000 7ff873fff700 1 -- 172.21.15.82:0/93520711 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff87c051320 con 0x7ff88c0b6170 2023-10-06T03:15:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.207+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff88c069060 con 0x7ff88c0b6170 2023-10-06T03:15:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.210+0000 7ff873fff700 1 -- 172.21.15.82:0/93520711 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163705 (secure 0 0 0) 0x7ff87c054940 con 0x7ff88c0b6170 2023-10-06T03:15:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:57.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff878066f30 msgr2=0x7ff8780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff878066f30 0x7ff8780693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff880006f00 tx=0x7ff880008040 comp rx=0 tx=0).stop 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 msgr2=0x7ff88c13df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c13df80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00c7e0 tx=0x7ff87c007df0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 shutdown_connections 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c15d850 0x7ff88c0c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff88c0b6170 0x7ff88c13df80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff878066f30 0x7ff8780693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 --2- 172.21.15.82:0/93520711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff88c15d480 0x7ff88c16ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 >> 172.21.15.82:0/93520711 conn(0x7ff88c0ccf80 msgr2=0x7ff88c141ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 shutdown_connections 2023-10-06T03:15:57.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.213+0000 7ff891604700 1 -- 172.21.15.82:0/93520711 wait complete. 2023-10-06T03:15:57.249 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":90261},{"type":"v1","addr":"172.21.15.134:6833","nonce":90261}]},"active_addr":"172.21.15.134:6833/90261","active_change":"2023-10-06T03:15:39.140608+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3490024179}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2697836707}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3336968674}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":479851371}]}]} 2023-10-06T03:15:57.271 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T03:15:57.271 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T03:15:57.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:57.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.512+0000 7f3e03151700 1 Processor -- start 2023-10-06T03:15:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.512+0000 7f3e03151700 1 -- start start 2023-10-06T03:15:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e03151700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dfc15d560 0x7f3dfc0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e03151700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc1591b0 0x7f3dfc159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e03151700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc0b2ad0 con 0x7f3dfc15d930 2023-10-06T03:15:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e03151700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc0b4160 con 0x7f3dfc15d560 2023-10-06T03:15:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e03151700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc159b70 con 0x7f3dfc1591b0 2023-10-06T03:15:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e00eed700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dfc15d560 0x7f3dfc0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e016ee700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc1591b0 0x7f3dfc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3dfbfff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3dfc15d930 0x7f3dfc0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:49674/0 (socket says 172.21.15.82:49674) 2023-10-06T03:15:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e00eed700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dfc15d560 0x7f3dfc0d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44512/0 (socket says 172.21.15.82:44512) 2023-10-06T03:15:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3e016ee700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc1591b0 0x7f3dfc159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42210/0 (socket says 172.21.15.82:42210) 2023-10-06T03:15:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.513+0000 7f3dfbfff700 1 -- 172.21.15.82:0/2936206838 learned_addr learned my addr 172.21.15.82:0/2936206838 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e016ee700 1 -- 172.21.15.82:0/2936206838 >> v2:172.21.15.134:3300/0 conn(0x7f3dfc15d560 msgr2=0x7f3dfc0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e016ee700 1 --2- 172.21.15.82:0/2936206838 >> v2:172.21.15.134:3300/0 conn(0x7f3dfc15d560 0x7f3dfc0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e016ee700 1 -- 172.21.15.82:0/2936206838 >> v1:172.21.15.134:6789/0 conn(0x7f3dfc15d930 legacy=0x7f3dfc0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e016ee700 1 -- 172.21.15.82:0/2936206838 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc0b2230 con 0x7f3dfc1591b0 2023-10-06T03:15:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e00eed700 1 --2- 172.21.15.82:0/2936206838 >> v2:172.21.15.134:3300/0 conn(0x7f3dfc15d560 0x7f3dfc0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e016ee700 1 --2- 172.21.15.82:0/2936206838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc1591b0 0x7f3dfc159630 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009e60 tx=0x7f3df4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b706137583b98964 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3dfb7fe700 1 -- 172.21.15.82:0/2936206838 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df400e070 con 0x7f3dfc1591b0 2023-10-06T03:15:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3dfb7fe700 1 -- 172.21.15.82:0/2936206838 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df400bb60 con 0x7f3dfc1591b0 2023-10-06T03:15:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3dfb7fe700 1 -- 172.21.15.82:0/2936206838 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4012430 con 0x7f3dfc1591b0 2023-10-06T03:15:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e03151700 1 -- 172.21.15.82:0/2936206838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc1591b0 msgr2=0x7f3dfc159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e03151700 1 --2- 172.21.15.82:0/2936206838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc1591b0 0x7f3dfc159630 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009e60 tx=0x7f3df4009780 comp rx=0 tx=0).stop 2023-10-06T03:15:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e03151700 1 -- 172.21.15.82:0/2936206838 shutdown_connections 2023-10-06T03:15:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e03151700 1 --2- 172.21.15.82:0/2936206838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc1591b0 0x7f3dfc159630 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e03151700 1 --2- 172.21.15.82:0/2936206838 >> v2:172.21.15.134:3300/0 conn(0x7f3dfc15d560 0x7f3dfc0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.514+0000 7f3e03151700 1 -- 172.21.15.82:0/2936206838 >> 172.21.15.82:0/2936206838 conn(0x7f3dfc0d1180 msgr2=0x7f3dfc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:57.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.515+0000 7f3e03151700 1 -- 172.21.15.82:0/2936206838 shutdown_connections 2023-10-06T03:15:57.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.515+0000 7f3e03151700 1 -- 172.21.15.82:0/2936206838 wait complete. 2023-10-06T03:15:57.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.516+0000 7f3e03151700 1 Processor -- start 2023-10-06T03:15:57.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.516+0000 7f3e03151700 1 -- start start 2023-10-06T03:15:57.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.516+0000 7f3e03151700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dfc1591b0 0x7f3dfc159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.516+0000 7f3e03151700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dfc15d560 0x7f3dfc147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.516+0000 7f3e03151700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc15d930 0x7f3dfc1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.516+0000 7f3e03151700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc15b040 con 0x7f3dfc15d560 2023-10-06T03:15:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.516+0000 7f3e03151700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc15a280 con 0x7f3dfc1591b0 2023-10-06T03:15:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.516+0000 7f3e03151700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc147680 con 0x7f3dfc15d930 2023-10-06T03:15:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dfc15d560 0x7f3dfc147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dfc15d560 0x7f3dfc147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43464/0 (socket says 172.21.15.82:43464) 2023-10-06T03:15:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 -- 172.21.15.82:0/3417577997 learned_addr learned my addr 172.21.15.82:0/3417577997 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3e00eed700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dfc1591b0 0x7f3dfc159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3e016ee700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc15d930 0x7f3dfc1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 -- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc15d930 msgr2=0x7f3dfc1575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc15d930 0x7f3dfc1575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 -- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dfc1591b0 msgr2=0x7f3dfc159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dfc1591b0 0x7f3dfc159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 -- 172.21.15.82:0/3417577997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0009420 con 0x7f3dfc15d560 2023-10-06T03:15:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3dfbfff700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dfc15d560 0x7f3dfc147140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3de800c560 tx=0x7f3de8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3df8ff9700 1 -- 172.21.15.82:0/3417577997 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8005b30 con 0x7f3dfc15d560 2023-10-06T03:15:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3df8ff9700 1 -- 172.21.15.82:0/3417577997 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de8005c90 con 0x7f3dfc15d560 2023-10-06T03:15:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df4009a20 con 0x7f3dfc15d560 2023-10-06T03:15:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3df8ff9700 1 -- 172.21.15.82:0/3417577997 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8007320 con 0x7f3dfc15d560 2023-10-06T03:15:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.517+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc15a7c0 con 0x7f3dfc15d560 2023-10-06T03:15:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.518+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc064050 con 0x7f3dfc15d560 2023-10-06T03:15:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.519+0000 7f3df8ff9700 1 -- 172.21.15.82:0/3417577997 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3de801b3b0 con 0x7f3dfc15d560 2023-10-06T03:15:57.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.519+0000 7f3df8ff9700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3de0066f60 0x7f3de0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.519+0000 7f3df8ff9700 1 -- 172.21.15.82:0/3417577997 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3de8083a30 con 0x7f3dfc15d560 2023-10-06T03:15:57.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.519+0000 7f3e00eed700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3de0066f60 0x7f3de0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.520+0000 7f3e00eed700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3de0066f60 0x7f3de0069410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009f40 tx=0x7f3df00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.523+0000 7f3df8ff9700 1 -- 172.21.15.82:0/3417577997 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3de8050b40 con 0x7f3dfc15d560 2023-10-06T03:15:57.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:15:57.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:15:57.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.712+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dfc0b2510 con 0x7f3dfc15d560 2023-10-06T03:15:57.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.713+0000 7f3df8ff9700 1 -- 172.21.15.82:0/3417577997 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f3de8017020 con 0x7f3dfc15d560 2023-10-06T03:15:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:57.715 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3de0066f60 msgr2=0x7f3de0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3de0066f60 0x7f3de0069410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009f40 tx=0x7f3df00091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dfc15d560 msgr2=0x7f3dfc147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dfc15d560 0x7f3dfc147140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3de800c560 tx=0x7f3de8001020 comp rx=0 tx=0).stop 2023-10-06T03:15:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 shutdown_connections 2023-10-06T03:15:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3de0066f60 0x7f3de0069410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dfc15d930 0x7f3dfc1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dfc1591b0 0x7f3dfc159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 --2- 172.21.15.82:0/3417577997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dfc15d560 0x7f3dfc147140 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 >> 172.21.15.82:0/3417577997 conn(0x7f3dfc0d1180 msgr2=0x7f3dfc067e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 shutdown_connections 2023-10-06T03:15:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.715+0000 7f3e03151700 1 -- 172.21.15.82:0/3417577997 wait complete. 2023-10-06T03:15:57.729 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T03:15:57.729 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:15:57.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.840+0000 7fb67fa1c700 1 Processor -- start 2023-10-06T03:15:57.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.840+0000 7fb67fa1c700 1 -- start start 2023-10-06T03:15:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.841+0000 7fb67fa1c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb67815d930 0x7fb6780d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.841+0000 7fb67fa1c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780b2ad0 con 0x7fb67815d560 2023-10-06T03:15:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.841+0000 7fb67fa1c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780b4160 con 0x7fb6781591b0 2023-10-06T03:15:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.841+0000 7fb67fa1c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6780b2230 con 0x7fb67815d930 2023-10-06T03:15:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.841+0000 7fb67cfb7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb67815d930 0x7fb6780d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.841+0000 7fb67d7b8700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb67815d560 0x7fb6780b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53782/0 (socket says 172.21.15.82:53782) 2023-10-06T03:15:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.841+0000 7fb67d7b8700 1 -- 172.21.15.82:0/3245894506 learned_addr learned my addr 172.21.15.82:0/3245894506 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67cfb7700 1 -- 172.21.15.82:0/3245894506 >> v1:172.21.15.134:6789/0 conn(0x7fb6781591b0 legacy=0x7fb678159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67cfb7700 1 -- 172.21.15.82:0/3245894506 >> v1:172.21.15.82:6789/0 conn(0x7fb67815d560 legacy=0x7fb6780b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67cfb7700 1 -- 172.21.15.82:0/3245894506 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780b2510 con 0x7fb67815d930 2023-10-06T03:15:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67cfb7700 1 --2- 172.21.15.82:0/3245894506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d930 0x7fb6780d0030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6680098e0 tx=0x7fb6680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf42296c2455503d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb66ffff700 1 -- 172.21.15.82:0/3245894506 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668009e80 con 0x7fb67815d930 2023-10-06T03:15:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb66ffff700 1 -- 172.21.15.82:0/3245894506 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800b820 con 0x7fb67815d930 2023-10-06T03:15:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb66ffff700 1 -- 172.21.15.82:0/3245894506 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800bba0 con 0x7fb67815d930 2023-10-06T03:15:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3245894506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d930 msgr2=0x7fb6780d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67fa1c700 1 --2- 172.21.15.82:0/3245894506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d930 0x7fb6780d0030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6680098e0 tx=0x7fb6680091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3245894506 shutdown_connections 2023-10-06T03:15:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67fa1c700 1 --2- 172.21.15.82:0/3245894506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d930 0x7fb6780d0030 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.842+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3245894506 >> 172.21.15.82:0/3245894506 conn(0x7fb6780d1180 msgr2=0x7fb678069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.843+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3245894506 shutdown_connections 2023-10-06T03:15:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.843+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3245894506 wait complete. 2023-10-06T03:15:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.844+0000 7fb67fa1c700 1 Processor -- start 2023-10-06T03:15:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.844+0000 7fb67fa1c700 1 -- start start 2023-10-06T03:15:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.844+0000 7fb67fa1c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6781591b0 0x7fb67814f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67fa1c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d560 0x7fb67814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67fa1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67815d930 0x7fb678169600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67fa1c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67814fdc0 con 0x7fb67815d560 2023-10-06T03:15:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67fa1c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6781500a0 con 0x7fb67815d930 2023-10-06T03:15:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67fa1c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb678150380 con 0x7fb6781591b0 2023-10-06T03:15:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d560 0x7fb67814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d560 0x7fb67814f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43482/0 (socket says 172.21.15.82:43482) 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 -- 172.21.15.82:0/3662661500 learned_addr learned my addr 172.21.15.82:0/3662661500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67dfb9700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67815d930 0x7fb678169600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67d7b8700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6781591b0 0x7fb67814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 -- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6781591b0 msgr2=0x7fb67814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6781591b0 0x7fb67814f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 -- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67815d930 msgr2=0x7fb678169600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67815d930 0x7fb678169600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 -- 172.21.15.82:0/3662661500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668009420 con 0x7fb67815d560 2023-10-06T03:15:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67dfb9700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67815d930 0x7fb678169600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67cfb7700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d560 0x7fb67814f550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6680030c0 tx=0x7fb668016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb66d7fa700 1 -- 172.21.15.82:0/3662661500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800bb60 con 0x7fb67815d560 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb66d7fa700 1 -- 172.21.15.82:0/3662661500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66801c690 con 0x7fb67815d560 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb678150660 con 0x7fb67815d560 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb66d7fa700 1 -- 172.21.15.82:0/3662661500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66801ca30 con 0x7fb67815d560 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.845+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67814fa90 con 0x7fb67815d560 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.846+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67815b270 con 0x7fb67815d560 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.846+0000 7fb66d7fa700 1 -- 172.21.15.82:0/3662661500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb66801a450 con 0x7fb67815d560 2023-10-06T03:15:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.847+0000 7fb66d7fa700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb65c066f30 0x7fb65c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.847+0000 7fb66d7fa700 1 -- 172.21.15.82:0/3662661500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb6680869a0 con 0x7fb67815d560 2023-10-06T03:15:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.847+0000 7fb67d7b8700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb65c066f30 0x7fb65c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.847+0000 7fb67d7b8700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb65c066f30 0x7fb65c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb674007fd0 tx=0x7fb674009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:57.851+0000 7fb66d7fa700 1 -- 172.21.15.82:0/3662661500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb67815b270 con 0x7fb67815d560 2023-10-06T03:15:58.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.038+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb67815b270 con 0x7fb67815d560 2023-10-06T03:15:58.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.039+0000 7fb66d7fa700 1 -- 172.21.15.82:0/3662661500 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fb67815b270 con 0x7fb67815d560 2023-10-06T03:15:58.041 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:15:58.041 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:15:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb65c066f30 msgr2=0x7fb65c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb65c066f30 0x7fb65c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb674007fd0 tx=0x7fb674009040 comp rx=0 tx=0).stop 2023-10-06T03:15:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d560 msgr2=0x7fb67814f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d560 0x7fb67814f550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6680030c0 tx=0x7fb668016000 comp rx=0 tx=0).stop 2023-10-06T03:15:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 shutdown_connections 2023-10-06T03:15:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb67815d930 0x7fb678169600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb65c066f30 0x7fb65c0693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6781591b0 0x7fb67814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 --2- 172.21.15.82:0/3662661500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67815d560 0x7fb67814f550 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 >> 172.21.15.82:0/3662661500 conn(0x7fb6780d1180 msgr2=0x7fb678069520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 shutdown_connections 2023-10-06T03:15:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.041+0000 7fb67fa1c700 1 -- 172.21.15.82:0/3662661500 wait complete. 2023-10-06T03:15:58.055 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T03:15:58.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T03:15:58.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T03:15:58.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T03:15:58.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T03:15:58.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T03:15:58.058 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T03:15:58.058 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T03:15:58.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.249+0000 7f79ff377700 1 Processor -- start 2023-10-06T03:15:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.249+0000 7f79ff377700 1 -- start start 2023-10-06T03:15:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.250+0000 7f79ff377700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79f80cb8f0 0x7f79f80ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.250+0000 7f79ff377700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f80adf70 con 0x7f79f806f610 2023-10-06T03:15:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79ff377700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f80ad360 con 0x7f79f80ab3b0 2023-10-06T03:15:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79ff377700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f80b0e00 con 0x7f79f80cb8f0 2023-10-06T03:15:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79fd113700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79f80cb8f0 0x7f79f80ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79fc912700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f79f806f610 0x7f79f8156220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53796/0 (socket says 172.21.15.82:53796) 2023-10-06T03:15:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79fc912700 1 -- 172.21.15.82:0/506148973 learned_addr learned my addr 172.21.15.82:0/506148973 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79fd113700 1 --2- 172.21.15.82:0/506148973 >> v2:172.21.15.82:3300/0 conn(0x7f79f80cb8f0 0x7f79f80ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43490/0 (socket says 172.21.15.82:43490) 2023-10-06T03:15:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79fd113700 1 -- 172.21.15.82:0/506148973 >> v1:172.21.15.134:6789/0 conn(0x7f79f80ab3b0 legacy=0x7f79f80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79fd113700 1 -- 172.21.15.82:0/506148973 >> v1:172.21.15.82:6789/0 conn(0x7f79f806f610 legacy=0x7f79f8156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.251+0000 7f79fd113700 1 -- 172.21.15.82:0/506148973 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80ad640 con 0x7f79f80cb8f0 2023-10-06T03:15:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.252+0000 7f79fd113700 1 --2- 172.21.15.82:0/506148973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80cb8f0 0x7f79f80ae400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79f400bb70 tx=0x7f79f400b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3940af6aa6b1abd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.252+0000 7f79effff700 1 -- 172.21.15.82:0/506148973 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4005c10 con 0x7f79f80cb8f0 2023-10-06T03:15:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.252+0000 7f79effff700 1 -- 172.21.15.82:0/506148973 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4005d70 con 0x7f79f80cb8f0 2023-10-06T03:15:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.252+0000 7f79effff700 1 -- 172.21.15.82:0/506148973 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f400dbe0 con 0x7f79f80cb8f0 2023-10-06T03:15:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.252+0000 7f3a1b3b1700 1 Processor -- start 2023-10-06T03:15:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.252+0000 7f3a1b3b1700 1 -- start start 2023-10-06T03:15:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f79ff377700 1 -- 172.21.15.82:0/506148973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80cb8f0 msgr2=0x7f79f80ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f79ff377700 1 --2- 172.21.15.82:0/506148973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80cb8f0 0x7f79f80ae400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79f400bb70 tx=0x7f79f400b3e0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f79ff377700 1 -- 172.21.15.82:0/506148973 shutdown_connections 2023-10-06T03:15:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f79ff377700 1 --2- 172.21.15.82:0/506148973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80cb8f0 0x7f79f80ae400 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f79ff377700 1 -- 172.21.15.82:0/506148973 >> 172.21.15.82:0/506148973 conn(0x7f79f8068b90 msgr2=0x7f79f80694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f79ff377700 1 -- 172.21.15.82:0/506148973 shutdown_connections 2023-10-06T03:15:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f79ff377700 1 -- 172.21.15.82:0/506148973 wait complete. 2023-10-06T03:15:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f3a1b3b1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3a140b1a60 0x7f3a140cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f3a1b3b1700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140add40 con 0x7f3a140a6db0 2023-10-06T03:15:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f3a1b3b1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140b1150 con 0x7f3a140a69e0 2023-10-06T03:15:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7f3a1b3b1700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140ae8e0 con 0x7f3a140b1a60 2023-10-06T03:15:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f3a1914d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3a140a69e0 0x7f3a140ae1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:49696/0 (socket says 172.21.15.82:49696) 2023-10-06T03:15:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f3a1914d700 1 -- 172.21.15.82:0/1500459461 learned_addr learned my addr 172.21.15.82:0/1500459461 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f3a1994e700 1 --2- 172.21.15.82:0/1500459461 >> v2:172.21.15.134:3300/0 conn(0x7f3a140b1a60 0x7f3a140cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7ff8b17c8700 1 Processor -- start 2023-10-06T03:15:58.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.253+0000 7ff8b17c8700 1 -- start start 2023-10-06T03:15:58.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7ff8b17c8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8ac0cb8f0 0x7ff8ac0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7ff8b17c8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8ac06ed20 0x7ff8ac0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7ff8b17c8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac0acac0 con 0x7ff8ac0cbcc0 2023-10-06T03:15:58.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7ff8b17c8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0afda0 con 0x7ff8ac0cb8f0 2023-10-06T03:15:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7ff8b17c8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0abeb0 con 0x7ff8ac06ed20 2023-10-06T03:15:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7ff8ab7fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8ac06ed20 0x7ff8ac0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7ff8ab7fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8ac06ed20 0x7ff8ac0ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44542/0 (socket says 172.21.15.82:44542) 2023-10-06T03:15:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7ff8ab7fe700 1 -- 172.21.15.82:0/2092270859 learned_addr learned my addr 172.21.15.82:0/2092270859 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f3a0bfff700 1 -- 172.21.15.82:0/1500459461 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077252818 0 0) 0x7f3a140b1150 con 0x7f3a140a69e0 2023-10-06T03:15:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f3a0bfff700 1 -- 172.21.15.82:0/1500459461 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a00003570 con 0x7f3a140a69e0 2023-10-06T03:15:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f3a1994e700 1 -- 172.21.15.82:0/1500459461 >> v1:172.21.15.134:6789/0 conn(0x7f3a140a69e0 legacy=0x7f3a140ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f3a1994e700 1 -- 172.21.15.82:0/1500459461 >> v1:172.21.15.82:6789/0 conn(0x7f3a140a6db0 legacy=0x7f3a140b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f3a1994e700 1 -- 172.21.15.82:0/1500459461 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140ad410 con 0x7f3a140b1a60 2023-10-06T03:15:58.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.254+0000 7f79ff377700 1 Processor -- start 2023-10-06T03:15:58.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7f79ff377700 1 -- start start 2023-10-06T03:15:58.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8aaffd700 1 --2- 172.21.15.82:0/2092270859 >> v2:172.21.15.82:3300/0 conn(0x7ff8ac0cb8f0 0x7ff8ac0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7f3a1994e700 1 --2- 172.21.15.82:0/1500459461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 0x7f3a140cb6b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009e60 tx=0x7f3a0c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0e44579f1a2d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8ab7fe700 1 -- 172.21.15.82:0/2092270859 >> v2:172.21.15.82:3300/0 conn(0x7ff8ac0cb8f0 msgr2=0x7ff8ac0ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8ab7fe700 1 --2- 172.21.15.82:0/2092270859 >> v2:172.21.15.82:3300/0 conn(0x7ff8ac0cb8f0 0x7ff8ac0ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8ab7fe700 1 -- 172.21.15.82:0/2092270859 >> v1:172.21.15.82:6789/0 conn(0x7ff8ac0cbcc0 legacy=0x7ff8ac06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8ab7fe700 1 -- 172.21.15.82:0/2092270859 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0ac190 con 0x7ff8ac06ed20 2023-10-06T03:15:58.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8ab7fe700 1 --2- 172.21.15.82:0/2092270859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8ac06ed20 0x7ff8ac0ad350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0b2330 tx=0x7ff8a4009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab37f2fb9f85ac04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7f3a0bfff700 1 -- 172.21.15.82:0/1500459461 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00e070 con 0x7f3a140b1a60 2023-10-06T03:15:58.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7f3a0bfff700 1 -- 172.21.15.82:0/1500459461 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c00bb20 con 0x7f3a140b1a60 2023-10-06T03:15:58.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7f3a0bfff700 1 -- 172.21.15.82:0/1500459461 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c012430 con 0x7f3a140b1a60 2023-10-06T03:15:58.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8a9ffb700 1 -- 172.21.15.82:0/2092270859 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400dc20 con 0x7ff8ac06ed20 2023-10-06T03:15:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8a9ffb700 1 -- 172.21.15.82:0/2092270859 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400dd80 con 0x7ff8ac06ed20 2023-10-06T03:15:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.255+0000 7ff8a9ffb700 1 -- 172.21.15.82:0/2092270859 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400f670 con 0x7ff8ac06ed20 2023-10-06T03:15:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f14c035b700 1 Processor -- start 2023-10-06T03:15:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79ff377700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f806f610 0x7f79f80cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79ff377700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ab3b0 0x7f79f8165600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79ff377700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79f80cb8f0 0x7f79f8168490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79ff377700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8165b40 con 0x7f79f80ab3b0 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79ff377700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80a81e0 con 0x7f79f80cb8f0 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79ff377700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f81689d0 con 0x7f79f806f610 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79fc912700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ab3b0 0x7f79f8165600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79fc912700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ab3b0 0x7f79f8165600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43500/0 (socket says 172.21.15.82:43500) 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79fc912700 1 -- 172.21.15.82:0/1144851288 learned_addr learned my addr 172.21.15.82:0/1144851288 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79fd113700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f806f610 0x7f79f80cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f79fd914700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79f80cb8f0 0x7f79f8168490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/1500459461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 msgr2=0x7f3a140cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f3a1b3b1700 1 --2- 172.21.15.82:0/1500459461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 0x7f3a140cb6b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009e60 tx=0x7f3a0c009780 comp rx=0 tx=0).stop 2023-10-06T03:15:58.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79fd113700 1 -- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79f80cb8f0 msgr2=0x7f79f8168490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79fd113700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79f80cb8f0 0x7f79f8168490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79fd113700 1 -- 172.21.15.82:0/1144851288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ab3b0 msgr2=0x7f79f8165600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79fd113700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ab3b0 0x7f79f8165600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79fd113700 1 -- 172.21.15.82:0/1144851288 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f400b660 con 0x7f79f806f610 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79fd113700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f806f610 0x7f79f80cb080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79f80b2350 tx=0x7f79f401a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79ed7fa700 1 -- 172.21.15.82:0/1144851288 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4019430 con 0x7f79f806f610 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79ed7fa700 1 -- 172.21.15.82:0/1144851288 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4019590 con 0x7f79f806f610 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f80a75d0 con 0x7f79f806f610 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79ed7fa700 1 -- 172.21.15.82:0/1144851288 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4019990 con 0x7f79f806f610 2023-10-06T03:15:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f14c035b700 1 -- start start 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14c035b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14b80ab3b0 0x7f14b8156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14c035b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f14b80cbd50 0x7f14b8156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14c035b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b80adf70 con 0x7f14b80cb980 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14c035b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b80b0e00 con 0x7f14b80ab3b0 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14c035b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b80ad360 con 0x7f14b80cbd50 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14be8f8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f14b80cbd50 0x7f14b8156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14bd8f6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14b80ab3b0 0x7f14b8156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14bd8f6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14b80ab3b0 0x7f14b8156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43508/0 (socket says 172.21.15.82:43508) 2023-10-06T03:15:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f14bd8f6700 1 -- 172.21.15.82:0/2535151355 learned_addr learned my addr 172.21.15.82:0/2535151355 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2092270859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8ac06ed20 msgr2=0x7ff8ac0ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7ff8b17c8700 1 --2- 172.21.15.82:0/2092270859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8ac06ed20 0x7ff8ac0ad350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0b2330 tx=0x7ff8a4009f90 comp rx=0 tx=0).stop 2023-10-06T03:15:58.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.257+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f80a7b90 con 0x7f79f806f610 2023-10-06T03:15:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2092270859 shutdown_connections 2023-10-06T03:15:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7ff8b17c8700 1 --2- 172.21.15.82:0/2092270859 >> v2:172.21.15.82:3300/0 conn(0x7ff8ac0cb8f0 0x7ff8ac0ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7ff8b17c8700 1 --2- 172.21.15.82:0/2092270859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8ac06ed20 0x7ff8ac0ad350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2092270859 >> 172.21.15.82:0/2092270859 conn(0x7ff8ac0680b0 msgr2=0x7ff8ac0684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2092270859 shutdown_connections 2023-10-06T03:15:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2092270859 wait complete. 2023-10-06T03:15:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7f14bd8f6700 1 -- 172.21.15.82:0/2535151355 >> v2:172.21.15.134:3300/0 conn(0x7f14b80cbd50 msgr2=0x7f14b8156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7f14bd8f6700 1 --2- 172.21.15.82:0/2535151355 >> v2:172.21.15.134:3300/0 conn(0x7f14b80cbd50 0x7f14b8156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7f14bd8f6700 1 -- 172.21.15.82:0/2535151355 >> v1:172.21.15.134:6789/0 conn(0x7f14b80cb980 legacy=0x7f14b80ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7f14bd8f6700 1 -- 172.21.15.82:0/2535151355 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80ad640 con 0x7f14b80ab3b0 2023-10-06T03:15:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.258+0000 7f14bd8f6700 1 --2- 172.21.15.82:0/2535151355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 0x7f14b8156220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14b8064eb0 tx=0x7f14b00076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5c881dc26816fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/1500459461 shutdown_connections 2023-10-06T03:15:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f3a1b3b1700 1 --2- 172.21.15.82:0/1500459461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 0x7f3a140cb6b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.256+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/1500459461 >> 172.21.15.82:0/1500459461 conn(0x7f3a14068b90 msgr2=0x7f3a140694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.259+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/1500459461 shutdown_connections 2023-10-06T03:15:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7f79ed7fa700 1 -- 172.21.15.82:0/1144851288 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79f4005ee0 con 0x7f79f806f610 2023-10-06T03:15:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.259+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/1500459461 wait complete. 2023-10-06T03:15:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7f3a1b3b1700 1 Processor -- start 2023-10-06T03:15:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7ff8b17c8700 1 Processor -- start 2023-10-06T03:15:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7f79ed7fa700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f79dc066f60 0x7f79dc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7f79ed7fa700 1 -- 172.21.15.82:0/1144851288 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f79f4014030 con 0x7f79f806f610 2023-10-06T03:15:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f79fc912700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f79dc066f60 0x7f79dc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7ff8b17c8700 1 -- start start 2023-10-06T03:15:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7f3a1b3b1700 1 -- start start 2023-10-06T03:15:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7f14bd0f5700 1 -- 172.21.15.82:0/2535151355 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000bea0 con 0x7f14b80ab3b0 2023-10-06T03:15:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7f14bd0f5700 1 -- 172.21.15.82:0/2535151355 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b0007b70 con 0x7f14b80ab3b0 2023-10-06T03:15:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.260+0000 7f14bd0f5700 1 -- 172.21.15.82:0/2535151355 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00124d0 con 0x7f14b80ab3b0 2023-10-06T03:15:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f14c035b700 1 -- 172.21.15.82:0/2535151355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 msgr2=0x7f14b8156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f14c035b700 1 --2- 172.21.15.82:0/2535151355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 0x7f14b8156220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14b8064eb0 tx=0x7f14b00076f0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f79ff377700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f79d80015f0 0x7f79d8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 --> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79d8006b90 con 0x7f79d80015f0 2023-10-06T03:15:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7fe4b3a47700 1 Processor -- start 2023-10-06T03:15:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f899b03f700 1 Processor -- start 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7ff8b17c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8ac06ed20 0x7ff8ac0990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7ff8b17c8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8ac0cb8f0 0x7ff8ac158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7ff8b17c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8ac0cbcc0 0x7ff8ac069660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7ff8b17c8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac098500 con 0x7ff8ac06ed20 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7ff8b17c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0995e0 con 0x7ff8ac0cbcc0 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7ff8b17c8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac159380 con 0x7ff8ac0cb8f0 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8ac06ed20 0x7ff8ac0990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8ac06ed20 0x7ff8ac0990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43514/0 (socket says 172.21.15.82:43514) 2023-10-06T03:15:58.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 -- 172.21.15.82:0/2721201031 learned_addr learned my addr 172.21.15.82:0/2721201031 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aa7fc700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8ac0cb8f0 0x7ff8ac158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8ab7fe700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8ac0cbcc0 0x7ff8ac069660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 -- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8ac0cb8f0 msgr2=0x7ff8ac158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8ac0cb8f0 0x7ff8ac158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 -- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8ac0cbcc0 msgr2=0x7ff8ac069660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8ac0cbcc0 0x7ff8ac069660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 -- 172.21.15.82:0/2721201031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4009850 con 0x7ff8ac06ed20 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f79fc912700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f79dc066f60 0x7f79dc069410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79f815b150 tx=0x7f79f0001ad0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f79fd914700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f79d80015f0 0x7f79d8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f79fd914700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f79d80015f0 0x7f79d8003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f3a1b3b1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a140a69e0 0x7f3a1413f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f3a1b3b1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a140a6db0 0x7f3a14097230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1b3b1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 0x7f3a14097770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1b3b1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14142970 con 0x7f3a140a69e0 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1b3b1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14096da0 con 0x7f3a140b1a60 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1b3b1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1413fac0 con 0x7f3a140a6db0 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1994e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 0x7f3a14097770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1994e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 0x7f3a14097770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44582/0 (socket says 172.21.15.82:44582) 2023-10-06T03:15:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1994e700 1 -- 172.21.15.82:0/2057891170 learned_addr learned my addr 172.21.15.82:0/2057891170 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1914d700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a140a69e0 0x7f3a1413f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1894c700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a140a6db0 0x7f3a14097230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7f899b03f700 1 -- start start 2023-10-06T03:15:58.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7ff8aaffd700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8ac06ed20 0x7ff8ac0990a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00ec80 tx=0x7ff89c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f14c035b700 1 -- 172.21.15.82:0/2535151355 shutdown_connections 2023-10-06T03:15:58.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f14c035b700 1 --2- 172.21.15.82:0/2535151355 >> v2:172.21.15.134:3300/0 conn(0x7f14b80cbd50 0x7f14b8156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f14c035b700 1 --2- 172.21.15.82:0/2535151355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 0x7f14b8156220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f14c035b700 1 -- 172.21.15.82:0/2535151355 >> 172.21.15.82:0/2535151355 conn(0x7f14b8068b90 msgr2=0x7f14b80694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f14c035b700 1 -- 172.21.15.82:0/2535151355 shutdown_connections 2023-10-06T03:15:58.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f14c035b700 1 -- 172.21.15.82:0/2535151355 wait complete. 2023-10-06T03:15:58.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1914d700 1 -- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a140a6db0 msgr2=0x7f3a14097230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1914d700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a140a6db0 0x7f3a14097230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1914d700 1 -- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 msgr2=0x7f3a14097770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1914d700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a140b1a60 0x7f3a14097770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f3a1914d700 1 -- 172.21.15.82:0/2057891170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c009a20 con 0x7f3a140a69e0 2023-10-06T03:15:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f3a1914d700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a140a69e0 0x7f3a1413f580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c590 tx=0x7f3a04007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.261+0000 7fe4b3a47700 1 -- start start 2023-10-06T03:15:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b3a47700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe4ac0ab3b0 0x7fe4ac156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b3a47700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cbd50 0x7fe4ac156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b3a47700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac0adf70 con 0x7fe4ac0cb980 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b3a47700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0b0e00 con 0x7fe4ac0ab3b0 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b3a47700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0ad360 con 0x7fe4ac0cbd50 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b1fe4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cbd50 0x7fe4ac156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b0fe2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe4ac0ab3b0 0x7fe4ac156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b1fe4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cbd50 0x7fe4ac156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42262/0 (socket says 172.21.15.82:42262) 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b0fe2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe4ac0ab3b0 0x7fe4ac156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44594/0 (socket says 172.21.15.82:44594) 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f899b03f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940ab3b0 0x7f8994156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.262+0000 7f899b03f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89940cbd50 0x7f8994156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f899b03f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89940adf70 con 0x7f89940cb980 2023-10-06T03:15:58.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f899b03f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940b0e00 con 0x7f89940cbd50 2023-10-06T03:15:58.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f899b03f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89940ad360 con 0x7f89940ab3b0 2023-10-06T03:15:58.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f8993fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940ab3b0 0x7f8994156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f8993fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940ab3b0 0x7f8994156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42250/0 (socket says 172.21.15.82:42250) 2023-10-06T03:15:58.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f8993fff700 1 -- 172.21.15.82:0/307332945 learned_addr learned my addr 172.21.15.82:0/307332945 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b1fe4700 1 -- 172.21.15.82:0/3221547410 learned_addr learned my addr 172.21.15.82:0/3221547410 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f89995dc700 1 --2- 172.21.15.82:0/307332945 >> v2:172.21.15.82:3300/0 conn(0x7f89940cbd50 0x7f8994156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f3a1894c700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a140a6db0 0x7f3a14097230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:15:58.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f79ed7fa700 1 -- 172.21.15.82:0/1144851288 <== osd.2 v2:172.21.15.82:6824/90644 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f79d8006b90 con 0x7f79d80015f0 2023-10-06T03:15:58.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04005b80 con 0x7f3a140a69e0 2023-10-06T03:15:58.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00c850 con 0x7ff8ac06ed20 2023-10-06T03:15:58.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c00c9b0 con 0x7ff8ac06ed20 2023-10-06T03:15:58.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f89937fe700 1 -- 172.21.15.82:0/307332945 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176269529 0 0) 0x7f89940adf70 con 0x7f89940cb980 2023-10-06T03:15:58.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f89937fe700 1 -- 172.21.15.82:0/307332945 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f897c003570 con 0x7f89940cb980 2023-10-06T03:15:58.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00cd30 con 0x7ff8ac06ed20 2023-10-06T03:15:58.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac097980 con 0x7ff8ac06ed20 2023-10-06T03:15:58.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac097f40 con 0x7ff8ac06ed20 2023-10-06T03:15:58.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f8993fff700 1 -- 172.21.15.82:0/307332945 >> v2:172.21.15.82:3300/0 conn(0x7f89940cbd50 msgr2=0x7f8994156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f8993fff700 1 --2- 172.21.15.82:0/307332945 >> v2:172.21.15.82:3300/0 conn(0x7f89940cbd50 0x7f8994156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f8993fff700 1 -- 172.21.15.82:0/307332945 >> v1:172.21.15.134:6789/0 conn(0x7f89940cb980 legacy=0x7f89940ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f8993fff700 1 -- 172.21.15.82:0/307332945 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940ad640 con 0x7f89940ab3b0 2023-10-06T03:15:58.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04005ce0 con 0x7f3a140a69e0 2023-10-06T03:15:58.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040072e0 con 0x7f3a140a69e0 2023-10-06T03:15:58.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a14099340 con 0x7f3a140a69e0 2023-10-06T03:15:58.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a14142690 con 0x7f3a140a69e0 2023-10-06T03:15:58.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f8993fff700 1 --2- 172.21.15.82:0/307332945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940ab3b0 0x7f8994156220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8988007190 tx=0x7f8988009b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68cc5f26dffabc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b1fe4700 1 -- 172.21.15.82:0/3221547410 >> v2:172.21.15.134:3300/0 conn(0x7fe4ac0ab3b0 msgr2=0x7fe4ac156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b1fe4700 1 --2- 172.21.15.82:0/3221547410 >> v2:172.21.15.134:3300/0 conn(0x7fe4ac0ab3b0 0x7fe4ac156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b1fe4700 1 -- 172.21.15.82:0/3221547410 >> v1:172.21.15.134:6789/0 conn(0x7fe4ac0cb980 legacy=0x7fe4ac0ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.263+0000 7fe4b1fe4700 1 -- 172.21.15.82:0/3221547410 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac0ad640 con 0x7fe4ac0cbd50 2023-10-06T03:15:58.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7fe4b1fe4700 1 --2- 172.21.15.82:0/3221547410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cbd50 0x7fe4ac156760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800a330 tx=0x7fe4a800a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb87a11b3cdf219 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7fe4a3fff700 1 -- 172.21.15.82:0/3221547410 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8009c40 con 0x7fe4ac0cbd50 2023-10-06T03:15:58.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7fe4a3fff700 1 -- 172.21.15.82:0/3221547410 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a8009da0 con 0x7fe4ac0cbd50 2023-10-06T03:15:58.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7fe4a3fff700 1 -- 172.21.15.82:0/3221547410 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800f280 con 0x7fe4ac0cbd50 2023-10-06T03:15:58.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7fbe65795700 1 Processor -- start 2023-10-06T03:15:58.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f13f8098700 1 Processor -- start 2023-10-06T03:15:58.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.264+0000 7f14c035b700 1 Processor -- start 2023-10-06T03:15:58.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7fbe65795700 1 -- start start 2023-10-06T03:15:58.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7f14c035b700 1 -- start start 2023-10-06T03:15:58.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7f89937fe700 1 -- 172.21.15.82:0/307332945 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988007ac0 con 0x7f89940ab3b0 2023-10-06T03:15:58.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7f89937fe700 1 -- 172.21.15.82:0/307332945 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8988007c20 con 0x7f89940ab3b0 2023-10-06T03:15:58.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7f89937fe700 1 -- 172.21.15.82:0/307332945 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880090d0 con 0x7f89940ab3b0 2023-10-06T03:15:58.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7fe4b3a47700 1 -- 172.21.15.82:0/3221547410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cbd50 msgr2=0x7fe4ac156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7fe4b3a47700 1 --2- 172.21.15.82:0/3221547410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cbd50 0x7fe4ac156760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800a330 tx=0x7fe4a800a2c0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7fe4b3a47700 1 -- 172.21.15.82:0/3221547410 shutdown_connections 2023-10-06T03:15:58.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7fe4b3a47700 1 --2- 172.21.15.82:0/3221547410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cbd50 0x7fe4ac156760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7fe4b3a47700 1 --2- 172.21.15.82:0/3221547410 >> v2:172.21.15.134:3300/0 conn(0x7fe4ac0ab3b0 0x7fe4ac156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7fe4b3a47700 1 -- 172.21.15.82:0/3221547410 >> 172.21.15.82:0/3221547410 conn(0x7fe4ac068b90 msgr2=0x7fe4ac0694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8ac064050 con 0x7ff8ac06ed20 2023-10-06T03:15:58.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14c035b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 0x7f14b81578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14c035b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b80cb980 0x7f14b80aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14c035b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b80cbd50 0x7f14b8154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14c035b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8158950 con 0x7f14b80ab3b0 2023-10-06T03:15:58.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14c035b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80ab0a0 con 0x7f14b80cbd50 2023-10-06T03:15:58.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14c035b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80aadc0 con 0x7f14b80cb980 2023-10-06T03:15:58.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f899b03f700 1 -- 172.21.15.82:0/307332945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940ab3b0 msgr2=0x7f8994156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f899b03f700 1 --2- 172.21.15.82:0/307332945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940ab3b0 0x7f8994156220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8988007190 tx=0x7f8988009b70 comp rx=0 tx=0).stop 2023-10-06T03:15:58.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7fe4b3a47700 1 -- 172.21.15.82:0/3221547410 shutdown_connections 2023-10-06T03:15:58.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.265+0000 7f13f8098700 1 -- start start 2023-10-06T03:15:58.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f13f8098700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13f00cb980 0x7f13f00ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7fbe65795700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe600abb40 0x7fbe601559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7fbe65795700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600ac0e0 con 0x7fbe6006f0f0 2023-10-06T03:15:58.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7fbe65795700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600ac3c0 con 0x7fbe6006f4c0 2023-10-06T03:15:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7fbe65795700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600ac6a0 con 0x7fbe600abb40 2023-10-06T03:15:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f899b03f700 1 -- 172.21.15.82:0/307332945 shutdown_connections 2023-10-06T03:15:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f899b03f700 1 --2- 172.21.15.82:0/307332945 >> v2:172.21.15.82:3300/0 conn(0x7f89940cbd50 0x7f8994156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f899b03f700 1 --2- 172.21.15.82:0/307332945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940ab3b0 0x7f8994156220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f899b03f700 1 -- 172.21.15.82:0/307332945 >> 172.21.15.82:0/307332945 conn(0x7f8994068b90 msgr2=0x7f89940694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f13f8098700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f00adf70 con 0x7f13f0156930 2023-10-06T03:15:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f13f8098700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f00ad360 con 0x7f13f00ab3b0 2023-10-06T03:15:58.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f13f8098700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f00b0e00 con 0x7f13f00cb980 2023-10-06T03:15:58.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14bd8f6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b80cb980 0x7f14b80aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14be8f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b80cbd50 0x7f14b8154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14be0f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 0x7f14b81578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14be8f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b80cbd50 0x7f14b8154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44610/0 (socket says 172.21.15.82:44610) 2023-10-06T03:15:58.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14be0f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 0x7f14b81578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43546/0 (socket says 172.21.15.82:43546) 2023-10-06T03:15:58.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f14be8f8700 1 -- 172.21.15.82:0/2879101684 learned_addr learned my addr 172.21.15.82:0/2879101684 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f13f5e34700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13f00cb980 0x7f13f00ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f13f5e34700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13f00cb980 0x7f13f00ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43554/0 (socket says 172.21.15.82:43554) 2023-10-06T03:15:58.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f13f5e34700 1 -- 172.21.15.82:0/4236020252 learned_addr learned my addr 172.21.15.82:0/4236020252 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f13f6635700 1 --1- 172.21.15.82:0/4236020252 >> v1:172.21.15.82:6789/0 conn(0x7f13f0156930 0x7f13f00b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53830/0 (socket says 172.21.15.82:53830) 2023-10-06T03:15:58.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7fe4b3a47700 1 -- 172.21.15.82:0/3221547410 wait complete. 2023-10-06T03:15:58.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f899b03f700 1 -- 172.21.15.82:0/307332945 shutdown_connections 2023-10-06T03:15:58.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14be8f8700 1 -- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b80cb980 msgr2=0x7f14b80aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14be8f8700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b80cb980 0x7f14b80aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14be8f8700 1 -- 172.21.15.82:0/2879101684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 msgr2=0x7f14b81578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14be8f8700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b80ab3b0 0x7f14b81578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14be8f8700 1 -- 172.21.15.82:0/2879101684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0007990 con 0x7f14b80cbd50 2023-10-06T03:15:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f13f5e34700 1 -- 172.21.15.82:0/4236020252 >> v1:172.21.15.134:6789/0 conn(0x7f13f00ab3b0 legacy=0x7f13f0156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f13f5e34700 1 -- 172.21.15.82:0/4236020252 >> v1:172.21.15.82:6789/0 conn(0x7f13f0156930 legacy=0x7f13f00b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f13f5e34700 1 -- 172.21.15.82:0/4236020252 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f00ad640 con 0x7f13f00cb980 2023-10-06T03:15:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f13f4e32700 1 -- 172.21.15.82:0/4236020252 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326869025 0 0) 0x7f13f00ad360 con 0x7f13f00ab3b0 2023-10-06T03:15:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff89c013680 con 0x7ff8ac06ed20 2023-10-06T03:15:58.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14be8f8700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b80cbd50 0x7f14b8154c50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14b400ea50 tx=0x7f14b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400ee90 con 0x7f14b80cbd50 2023-10-06T03:15:58.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b400c850 con 0x7f14b80cbd50 2023-10-06T03:15:58.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f13f5e34700 1 --2- 172.21.15.82:0/4236020252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 0x7f13f00ae400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13e800d1f0 tx=0x7f13e800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6bde5207f6537c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7ff892ffd700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff898067000 0x7ff8980694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b8158300 con 0x7f14b80cbd50 2023-10-06T03:15:58.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b816e080 con 0x7f14b80cbd50 2023-10-06T03:15:58.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.267+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400cc10 con 0x7f14b80cbd50 2023-10-06T03:15:58.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7fe4b3a47700 1 Processor -- start 2023-10-06T03:15:58.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.266+0000 7f899b03f700 1 -- 172.21.15.82:0/307332945 wait complete. 2023-10-06T03:15:58.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f899b03f700 1 Processor -- start 2023-10-06T03:15:58.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7fe4b3a47700 1 -- start start 2023-10-06T03:15:58.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f899b03f700 1 -- start start 2023-10-06T03:15:58.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff89c084890 con 0x7ff8ac06ed20 2023-10-06T03:15:58.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7ff892ffd700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7ff89806f830 0x7ff898071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 --> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8980722f0 con 0x7ff89806f830 2023-10-06T03:15:58.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff89c00ce90 con 0x7ff8ac06ed20 2023-10-06T03:15:58.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b3a47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0ab3b0 0x7fe4ac154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b3a47700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cb980 0x7fe4ac0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b3a47700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4ac0cbd50 0x7fe4ac0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b3a47700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0aad00 con 0x7fe4ac0ab3b0 2023-10-06T03:15:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b3a47700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac158ce0 con 0x7fe4ac0cbd50 2023-10-06T03:15:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b3a47700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1580d0 con 0x7fe4ac0cb980 2023-10-06T03:15:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a040076d0 con 0x7f3a140a69e0 2023-10-06T03:15:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a14064050 con 0x7f3a140a69e0 2023-10-06T03:15:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f3a097fa700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f39f8067080 0x7f39f8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3a04083a00 con 0x7f3a140a69e0 2023-10-06T03:15:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f3a1894c700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f39f8067080 0x7f39f8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f3a097fa700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f39f806f8b0 0x7f39f8071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 --> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39f8072370 con 0x7f39f806f8b0 2023-10-06T03:15:58.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14a0000fd0 con 0x7f14b80cbd50 2023-10-06T03:15:58.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7fbe5f7fe700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbe6006f4c0 0x7fbe60155ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:49728/0 (socket says 172.21.15.82:49728) 2023-10-06T03:15:58.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7fbe5f7fe700 1 -- 172.21.15.82:0/4267987590 learned_addr learned my addr 172.21.15.82:0/4267987590 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:58.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7fbe5e7fc700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe600abb40 0x7fbe601559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b1fe4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4ac0cbd50 0x7fe4ac0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b0fe2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cb980 0x7fe4ac0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b17e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0ab3b0 0x7fe4ac154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7ff8aa7fc700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff898067000 0x7ff8980694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7ff8ab7fe700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7ff89806f830 0x7ff898071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f13f4e32700 1 -- 172.21.15.82:0/4236020252 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8010070 con 0x7f13f00cb980 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f13f4e32700 1 -- 172.21.15.82:0/4236020252 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e800dd00 con 0x7f13f00cb980 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.268+0000 7f13f4e32700 1 -- 172.21.15.82:0/4236020252 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8016650 con 0x7f13f00cb980 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f13f8098700 1 -- 172.21.15.82:0/4236020252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 msgr2=0x7f13f00ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f13f8098700 1 --2- 172.21.15.82:0/4236020252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 0x7f13f00ae400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13e800d1f0 tx=0x7f13e800ba50 comp rx=0 tx=0).stop 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f13f8098700 1 -- 172.21.15.82:0/4236020252 shutdown_connections 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f13f8098700 1 --2- 172.21.15.82:0/4236020252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 0x7f13f00ae400 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f13f8098700 1 -- 172.21.15.82:0/4236020252 >> 172.21.15.82:0/4236020252 conn(0x7f13f0068b90 msgr2=0x7f13f00694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f13f8098700 1 -- 172.21.15.82:0/4236020252 shutdown_connections 2023-10-06T03:15:58.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f13f8098700 1 -- 172.21.15.82:0/4236020252 wait complete. 2023-10-06T03:15:58.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b0fe2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cb980 0x7fe4ac0b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42290/0 (socket says 172.21.15.82:42290) 2023-10-06T03:15:58.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fe4b0fe2700 1 -- 172.21.15.82:0/1193766751 learned_addr learned my addr 172.21.15.82:0/1193766751 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094201210 0 0) 0x7fbe600ac3c0 con 0x7fbe6006f4c0 2023-10-06T03:15:58.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe48003570 con 0x7fbe6006f4c0 2023-10-06T03:15:58.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.269+0000 7f3a1994e700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f39f806f8b0 0x7f39f8071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7ff8aa7fc700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff898067000 0x7ff8980694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009ab0 tx=0x7ff8a0009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 83166949 0 0) 0x7fbe48003570 con 0x7fbe6006f4c0 2023-10-06T03:15:58.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe600abb40 msgr2=0x7fbe601559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe600abb40 0x7fbe601559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 >> v1:172.21.15.82:6789/0 conn(0x7fbe6006f0f0 legacy=0x7fbe600afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600ac980 con 0x7fbe6006f4c0 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fbe54001470 con 0x7fbe6006f4c0 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 >> v1:172.21.15.134:6789/0 conn(0x7fbe6006f4c0 legacy=0x7fbe60155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe48003ae0 0x7fbe48003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48004810 0x7fbe48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe480051c0 0x7fbe4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600ac6a0 con 0x7fbe48004810 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4800c130 con 0x7fbe480051c0 2023-10-06T03:15:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4800c2c0 con 0x7fbe48003ae0 2023-10-06T03:15:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f3a1894c700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f39f8067080 0x7f39f8069530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a140b09d0 tx=0x7f3a10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4b0fe2700 1 -- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4ac0cbd50 msgr2=0x7fe4ac0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4b0fe2700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4ac0cbd50 0x7fe4ac0b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4b0fe2700 1 -- 172.21.15.82:0/1193766751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0ab3b0 msgr2=0x7fe4ac154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4b0fe2700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0ab3b0 0x7fe4ac154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4b0fe2700 1 -- 172.21.15.82:0/1193766751 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a800f880 con 0x7fe4ac0cb980 2023-10-06T03:15:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4b0fe2700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cb980 0x7fe4ac0b15d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00c7b0 tx=0x7fe49c007140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f899b03f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89940ab3b0 0x7f8994168200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f899b03f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940cb980 0x7f8994156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f899b03f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89940cbd50 0x7f89940a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f899b03f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8994158480 con 0x7f89940cbd50 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f899b03f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8994157870 con 0x7f89940ab3b0 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f899b03f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8994157b50 con 0x7f89940cb980 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f8993fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940cb980 0x7f8994156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f8998ddb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89940ab3b0 0x7f8994168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f8993fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940cb980 0x7f8994156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42302/0 (socket says 172.21.15.82:42302) 2023-10-06T03:15:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f8993fff700 1 -- 172.21.15.82:0/894776515 learned_addr learned my addr 172.21.15.82:0/894776515 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f89995dc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89940cbd50 0x7f89940a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f3a1994e700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f39f806f8b0 0x7f39f8071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c011070 con 0x7fe4ac0cb980 2023-10-06T03:15:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c00a4e0 con 0x7fe4ac0cb980 2023-10-06T03:15:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00a880 con 0x7fe4ac0cb980 2023-10-06T03:15:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f89995dc700 1 -- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940cb980 msgr2=0x7f8994156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f89995dc700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89940cb980 0x7f8994156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f89995dc700 1 -- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89940ab3b0 msgr2=0x7f8994168200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f89995dc700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89940ab3b0 0x7f8994168200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f89995dc700 1 -- 172.21.15.82:0/894776515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898800d040 con 0x7f89940cbd50 2023-10-06T03:15:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac1583b0 con 0x7fe4ac0cb980 2023-10-06T03:15:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7ff8ab7fe700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7ff89806f830 0x7ff898071c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5f7fe700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe480051c0 0x7fbe4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7fbe5effd700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe48003ae0 0x7fbe48003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.270+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14b4013470 con 0x7f14b80cbd50 2023-10-06T03:15:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a04050ba0 con 0x7f3a140a69e0 2023-10-06T03:15:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7fbe5effd700 1 -- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe480051c0 msgr2=0x7fbe4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7fbe5effd700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe480051c0 0x7fbe4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7fbe5effd700 1 -- 172.21.15.82:0/4267987590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48004810 msgr2=0x7fbe48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7fbe5e7fc700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48004810 0x7fbe48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7fbe5effd700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48004810 0x7fbe48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7fbe5effd700 1 -- 172.21.15.82:0/4267987590 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600ac980 con 0x7fbe48003ae0 2023-10-06T03:15:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7fbe5e7fc700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48004810 0x7fbe48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:15:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f13f8098700 1 Processor -- start 2023-10-06T03:15:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f13f8098700 1 -- start start 2023-10-06T03:15:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac158970 con 0x7fe4ac0cb980 2023-10-06T03:15:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 <== osd.4 v2:172.21.15.134:6800/90846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f39f8072370 con 0x7f39f806f8b0 2023-10-06T03:15:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f89995dc700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89940cbd50 0x7f89940a7880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f898c009e50 tx=0x7f898c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f14ae7fc700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f149c066fb0 0x7f149c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f14b4084cf0 con 0x7f14b80cbd50 2023-10-06T03:15:58.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f14ae7fc700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f149c06f860 0x7f149c071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 --> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f149c072320 con 0x7f149c06f860 2023-10-06T03:15:58.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14b4085020 con 0x7f14b80cbd50 2023-10-06T03:15:58.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.271+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00caa0 con 0x7f89940cbd50 2023-10-06T03:15:58.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00f040 con 0x7f89940cbd50 2023-10-06T03:15:58.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00ce50 con 0x7f89940cbd50 2023-10-06T03:15:58.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8994157e30 con 0x7f89940cbd50 2023-10-06T03:15:58.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f14be0f7700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f149c066fb0 0x7f149c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89940a85c0 con 0x7f89940cbd50 2023-10-06T03:15:58.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7fbe5effd700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe48003ae0 0x7fbe48003ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbe58002f00 tx=0x7fbe58002530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89e68c685680270e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 <== osd.1 v2:172.21.15.82:6808/90633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff8980722f0 con 0x7ff89806f830 2023-10-06T03:15:58.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58016070 con 0x7fbe48003ae0 2023-10-06T03:15:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58006ba0 con 0x7fbe48003ae0 2023-10-06T03:15:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7fbe5dffb700 1 -- 172.21.15.82:0/4267987590 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58002840 con 0x7fbe48003ae0 2023-10-06T03:15:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f14bd8f6700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f149c06f860 0x7f149c071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f8098700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13f00ab3b0 0x7f13f01446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f8098700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 0x7f13f00a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f8098700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13f0156930 0x7f13f00a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f8098700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f00a9920 con 0x7f13f00cb980 2023-10-06T03:15:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f8098700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f016a050 con 0x7f13f0156930 2023-10-06T03:15:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f8098700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f00ab1a0 con 0x7f13f00ab3b0 2023-10-06T03:15:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fbe65795700 1 -- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe48003ae0 msgr2=0x7fbe48003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fbe65795700 1 --2- 172.21.15.82:0/4267987590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe48003ae0 0x7fbe48003ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbe58002f00 tx=0x7fbe58002530 comp rx=0 tx=0).stop 2023-10-06T03:15:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f5633700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 0x7f13f00a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f5633700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 0x7f13f00a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43584/0 (socket says 172.21.15.82:43584) 2023-10-06T03:15:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f5633700 1 -- 172.21.15.82:0/54733566 learned_addr learned my addr 172.21.15.82:0/54733566 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.272+0000 7f13f5e34700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13f00ab3b0 0x7f13f01446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4ac064050 con 0x7fe4ac0cb980 2023-10-06T03:15:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f13f5e34700 1 -- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13f0156930 msgr2=0x7f13f00a92f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:15:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f13f5e34700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13f0156930 0x7f13f00a92f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f13f5e34700 1 -- 172.21.15.82:0/54733566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 msgr2=0x7f13f00a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f13f5e34700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13f00cb980 0x7f13f00a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f13f5e34700 1 -- 172.21.15.82:0/54733566 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e800bcf0 con 0x7f13f00ab3b0 2023-10-06T03:15:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fbe5f7fe700 1 -- 172.21.15.82:0/4267987590 reap_dead start 2023-10-06T03:15:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f13f5e34700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13f00ab3b0 0x7f13f01446f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13e8019000 tx=0x7f13e801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fbe65795700 1 -- 172.21.15.82:0/4267987590 shutdown_connections 2023-10-06T03:15:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fbe65795700 1 -- 172.21.15.82:0/4267987590 >> 172.21.15.82:0/4267987590 conn(0x7fbe600680b0 msgr2=0x7fbe600684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f14bd8f6700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f149c06f860 0x7f149c071c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fbe65795700 1 -- 172.21.15.82:0/4267987590 shutdown_connections 2023-10-06T03:15:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fbe65795700 1 -- 172.21.15.82:0/4267987590 wait complete. 2023-10-06T03:15:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e80165c0 con 0x7f13f00ab3b0 2023-10-06T03:15:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e801f640 con 0x7f13f00ab3b0 2023-10-06T03:15:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e801fa00 con 0x7f13f00ab3b0 2023-10-06T03:15:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.273+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe49c015070 con 0x7fe4ac0cb980 2023-10-06T03:15:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7fe4a17fa700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe490067080 0x7fe490069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe49c084040 con 0x7fe4ac0cb980 2023-10-06T03:15:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7fe4b17e3700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe490067080 0x7fe490069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7fe4a17fa700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fe49006f8b0 0x7fe490071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 --> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe490072370 con 0x7fe49006f8b0 2023-10-06T03:15:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe49c0511e0 con 0x7fe4ac0cb980 2023-10-06T03:15:58.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f00a7230 con 0x7f13f00ab3b0 2023-10-06T03:15:58.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.275+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8974000fd0 con 0x7f89940cbd50 2023-10-06T03:15:58.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.275+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 <== osd.0 v2:172.21.15.82:6813/90632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f149c072320 con 0x7f149c06f860 2023-10-06T03:15:58.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.275+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f016a540 con 0x7f13f00ab3b0 2023-10-06T03:15:58.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.274+0000 7fe4b1fe4700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fe49006f8b0 0x7fe490071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.275+0000 7f14be0f7700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f149c066fb0 0x7f149c069460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009b40 tx=0x7f14a80090f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7fbe65795700 1 Processor -- start 2023-10-06T03:15:58.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13f0064050 con 0x7f13f00ab3b0 2023-10-06T03:15:58.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f898c014690 con 0x7f89940cbd50 2023-10-06T03:15:58.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7f8990ff9700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8980067080 0x7f8980069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f898c085210 con 0x7f89940cbd50 2023-10-06T03:15:58.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7f8990ff9700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7f898006f8b0 0x7f8980071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 --> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8980072370 con 0x7f898006f8b0 2023-10-06T03:15:58.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f8998ddb700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8980067080 0x7f8980069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f898c052300 con 0x7f89940cbd50 2023-10-06T03:15:58.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7fe4b17e3700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe490067080 0x7fe490069530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4007fd0 tx=0x7fe4a4002690 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f8993fff700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7f898006f8b0 0x7f8980071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f8998ddb700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8980067080 0x7f8980069530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8984001130 tx=0x7f8984007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.276+0000 7fbe65795700 1 -- start start 2023-10-06T03:15:58.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe65795700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe6014c800 0x7fbe600cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe65795700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe6014cbd0 0x7fbe60153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe65795700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe601539d0 0x7fbe60157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe65795700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6009a4e0 con 0x7fbe601539d0 2023-10-06T03:15:58.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe65795700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60153e40 con 0x7fbe6014c800 2023-10-06T03:15:58.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe65795700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600cb230 con 0x7fbe6014cbd0 2023-10-06T03:15:58.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe5f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe601539d0 0x7fbe60157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe5f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe601539d0 0x7fbe60157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43590/0 (socket says 172.21.15.82:43590) 2023-10-06T03:15:58.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe5f7fe700 1 -- 172.21.15.82:0/46194088 learned_addr learned my addr 172.21.15.82:0/46194088 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fbe5effd700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe6014c800 0x7fbe600cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13e8025030 con 0x7f13f00ab3b0 2023-10-06T03:15:58.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f13e5ffb700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13dc067140 0x7f13dc0695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13e8023070 con 0x7f13f00ab3b0 2023-10-06T03:15:58.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f13e5ffb700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f13dc06f9f0 0x7f13dc071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 --> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13dc0724b0 con 0x7f13dc06f9f0 2023-10-06T03:15:58.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13e808b220 con 0x7f13f00ab3b0 2023-10-06T03:15:58.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.277+0000 7fe4b1fe4700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fe49006f8b0 0x7fe490071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe5f7fe700 1 -- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe6014cbd0 msgr2=0x7fbe60153490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:15:58.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe5f7fe700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe6014cbd0 0x7fbe60153490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe5f7fe700 1 -- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe6014c800 msgr2=0x7fbe600cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe5f7fe700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe6014c800 0x7fbe600cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe5f7fe700 1 -- 172.21.15.82:0/46194088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600ca620 con 0x7fbe601539d0 2023-10-06T03:15:58.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe5effd700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe6014c800 0x7fbe600cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:58.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7f13f6635700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f13dc06f9f0 0x7f13dc071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7f13f5633700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13dc067140 0x7f13dc0695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe5f7fe700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe601539d0 0x7fbe60157880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe600ab8a0 tx=0x7fbe54009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7f13f6635700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f13dc06f9f0 0x7f13dc071e00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe46ffd700 1 -- 172.21.15.82:0/46194088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54004b00 con 0x7fbe601539d0 2023-10-06T03:15:58.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe46ffd700 1 -- 172.21.15.82:0/46194088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5400d040 con 0x7fbe601539d0 2023-10-06T03:15:58.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe46ffd700 1 -- 172.21.15.82:0/46194088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54004e70 con 0x7fbe601539d0 2023-10-06T03:15:58.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe600ca900 con 0x7fbe601539d0 2023-10-06T03:15:58.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe600caec0 con 0x7fbe601539d0 2023-10-06T03:15:58.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.278+0000 7f13f5633700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13dc067140 0x7f13dc0695f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13f006a9c0 tx=0x7f13e0007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.279+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 <== osd.5 v2:172.21.15.134:6816/90874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f13dc0724b0 con 0x7f13dc06f9f0 2023-10-06T03:15:58.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.279+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 <== osd.6 v2:172.21.15.134:6808/90847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe490072370 con 0x7fe49006f8b0 2023-10-06T03:15:58.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.283+0000 7f8993fff700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7f898006f8b0 0x7f8980071cc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.284+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 <== osd.7 v2:172.21.15.134:6824/90877 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8980072370 con 0x7f898006f8b0 2023-10-06T03:15:58.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.281+0000 7fbe46ffd700 1 -- 172.21.15.82:0/46194088 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe54007380 con 0x7fbe601539d0 2023-10-06T03:15:58.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.281+0000 7fbe46ffd700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe4c066f30 0x7fbe4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.281+0000 7fbe46ffd700 1 -- 172.21.15.82:0/46194088 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbe54083f80 con 0x7fbe601539d0 2023-10-06T03:15:58.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.282+0000 7fbe5effd700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe4c066f30 0x7fbe4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.282+0000 7fbe5effd700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe4c066f30 0x7fbe4c0693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe58002f00 tx=0x7fbe58016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.291+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 --> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a1406bbe0 con 0x7f39f806f8b0 2023-10-06T03:15:58.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.292+0000 7f3a097fa700 1 -- 172.21.15.82:0/2057891170 <== osd.4 v2:172.21.15.134:6800/90846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a1406bbe0 con 0x7f39f806f8b0 2023-10-06T03:15:58.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.292+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f39f806f8b0 msgr2=0x7f39f8071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.292+0000 7f3a1b3b1700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f39f806f8b0 0x7f39f8071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f39f8067080 msgr2=0x7f39f8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1b3b1700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f39f8067080 0x7f39f8069530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a140b09d0 tx=0x7f3a10008040 comp rx=0 tx=0).stop 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a140a69e0 msgr2=0x7f3a1413f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1b3b1700 1 --2- 172.21.15.82:0/2057891170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a140a69e0 0x7f3a1413f580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c590 tx=0x7f3a04007d40 comp rx=0 tx=0).stop 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1994e700 1 -- 172.21.15.82:0/2057891170 reap_dead start 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 shutdown_connections 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 >> 172.21.15.82:0/2057891170 conn(0x7f3a14068b90 msgr2=0x7f3a1406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 shutdown_connections 2023-10-06T03:15:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f3a1b3b1700 1 -- 172.21.15.82:0/2057891170 wait complete. 2023-10-06T03:15:58.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.293+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 --> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79d8005c80 con 0x7f79d80015f0 2023-10-06T03:15:58.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.295+0000 7fbe65795700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7fbe60157dc0 0x7fbe60158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.295+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 --> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe601586d0 con 0x7fbe60157dc0 2023-10-06T03:15:58.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.295+0000 7fbe5e7fc700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7fbe60157dc0 0x7fbe60158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.295+0000 7fbe5e7fc700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7fbe60157dc0 0x7fbe60158190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.298+0000 7f79ed7fa700 1 -- 172.21.15.82:0/1144851288 <== osd.2 v2:172.21.15.82:6824/90644 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f79d8005c80 con 0x7f79d80015f0 2023-10-06T03:15:58.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.300+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f79d80015f0 msgr2=0x7f79d8003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.300+0000 7f79ff377700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f79d80015f0 0x7f79d8003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f79dc066f60 msgr2=0x7f79dc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79ff377700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f79dc066f60 0x7f79dc069410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79f815b150 tx=0x7f79f0001ad0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f806f610 msgr2=0x7f79f80cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79ff377700 1 --2- 172.21.15.82:0/1144851288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79f806f610 0x7f79f80cb080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79f80b2350 tx=0x7f79f401a000 comp rx=0 tx=0).stop 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79fd914700 1 -- 172.21.15.82:0/1144851288 reap_dead start 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 shutdown_connections 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 >> 172.21.15.82:0/1144851288 conn(0x7f79f8068b90 msgr2=0x7f79f8096a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 shutdown_connections 2023-10-06T03:15:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f79ff377700 1 -- 172.21.15.82:0/1144851288 wait complete. 2023-10-06T03:15:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.301+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 --> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14a0002d30 con 0x7f149c06f860 2023-10-06T03:15:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.302+0000 7f14ae7fc700 1 -- 172.21.15.82:0/2879101684 <== osd.0 v2:172.21.15.82:6813/90632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14a0002d30 con 0x7f149c06f860 2023-10-06T03:15:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.303+0000 7fbe46ffd700 1 -- 172.21.15.82:0/46194088 <== osd.3 v2:172.21.15.82:6800/90631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbe601586d0 con 0x7fbe60157dc0 2023-10-06T03:15:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.303+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 --> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8ac0ac470 con 0x7ff89806f830 2023-10-06T03:15:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.303+0000 7ff892ffd700 1 -- 172.21.15.82:0/2721201031 <== osd.1 v2:172.21.15.82:6808/90633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff8ac0ac470 con 0x7ff89806f830 2023-10-06T03:15:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7ff89806f830 msgr2=0x7ff898071c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7ff89806f830 0x7ff898071c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff898067000 msgr2=0x7ff8980694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff898067000 0x7ff8980694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009ab0 tx=0x7ff8a0009060 comp rx=0 tx=0).stop 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8ac06ed20 msgr2=0x7ff8ac0990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 --2- 172.21.15.82:0/2721201031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8ac06ed20 0x7ff8ac0990a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00ec80 tx=0x7ff89c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8ab7fe700 1 -- 172.21.15.82:0/2721201031 reap_dead start 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 shutdown_connections 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 >> 172.21.15.82:0/2721201031 conn(0x7ff8ac0680b0 msgr2=0x7ff8ac0af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 shutdown_connections 2023-10-06T03:15:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.304+0000 7ff8b17c8700 1 -- 172.21.15.82:0/2721201031 wait complete. 2023-10-06T03:15:58.347 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:15:58.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:15:58.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.303+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 --> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe4ac063880 con 0x7fe49006f8b0 2023-10-06T03:15:58.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f149c06f860 msgr2=0x7f149c071c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f149c06f860 0x7f149c071c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f149c066fb0 msgr2=0x7f149c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f149c066fb0 0x7f149c069460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009b40 tx=0x7f14a80090f0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b80cbd50 msgr2=0x7f14b8154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 --2- 172.21.15.82:0/2879101684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b80cbd50 0x7f14b8154c50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14b400ea50 tx=0x7f14b40091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14be8f8700 1 -- 172.21.15.82:0/2879101684 reap_dead start 2023-10-06T03:15:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 --> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13d0000f90 con 0x7f13dc06f9f0 2023-10-06T03:15:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 shutdown_connections 2023-10-06T03:15:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 >> 172.21.15.82:0/2879101684 conn(0x7f14b8068b90 msgr2=0x7f14b80b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 shutdown_connections 2023-10-06T03:15:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f14c035b700 1 -- 172.21.15.82:0/2879101684 wait complete. 2023-10-06T03:15:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.309+0000 7f13e5ffb700 1 -- 172.21.15.82:0/54733566 <== osd.5 v2:172.21.15.134:6816/90874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f13d0000f90 con 0x7f13dc06f9f0 2023-10-06T03:15:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.310+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f13dc06f9f0 msgr2=0x7f13dc071e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.310+0000 7f13f8098700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f13dc06f9f0 0x7f13dc071e00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.310+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13dc067140 msgr2=0x7f13dc0695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.310+0000 7f13f8098700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13dc067140 0x7f13dc0695f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13f006a9c0 tx=0x7f13e0007da0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.310+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13f00ab3b0 msgr2=0x7f13f01446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.310+0000 7f13f8098700 1 --2- 172.21.15.82:0/54733566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13f00ab3b0 0x7f13f01446f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13e8019000 tx=0x7f13e801c000 comp rx=0 tx=0).stop 2023-10-06T03:15:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.310+0000 7f13f6635700 1 -- 172.21.15.82:0/54733566 reap_dead start 2023-10-06T03:15:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.310+0000 7fe4a17fa700 1 -- 172.21.15.82:0/1193766751 <== osd.6 v2:172.21.15.134:6808/90847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe4ac063880 con 0x7fe49006f8b0 2023-10-06T03:15:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.311+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 shutdown_connections 2023-10-06T03:15:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.311+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 >> 172.21.15.82:0/54733566 conn(0x7f13f0068b90 msgr2=0x7f13f0098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.311+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fe49006f8b0 msgr2=0x7fe490071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.311+0000 7fe4b3a47700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fe49006f8b0 0x7fe490071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.312+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 shutdown_connections 2023-10-06T03:15:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.312+0000 7f13f8098700 1 -- 172.21.15.82:0/54733566 wait complete. 2023-10-06T03:15:58.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.313+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 --> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8974002d30 con 0x7f898006f8b0 2023-10-06T03:15:58.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.314+0000 7f8990ff9700 1 -- 172.21.15.82:0/894776515 <== osd.7 v2:172.21.15.134:6824/90877 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8974002d30 con 0x7f898006f8b0 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.314+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7f898006f8b0 msgr2=0x7f8980071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.314+0000 7f899b03f700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7f898006f8b0 0x7f8980071cc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.314+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8980067080 msgr2=0x7f8980069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.314+0000 7f899b03f700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8980067080 0x7f8980069530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8984001130 tx=0x7f8984007cb0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.314+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89940cbd50 msgr2=0x7f89940a7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.314+0000 7f899b03f700 1 --2- 172.21.15.82:0/894776515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89940cbd50 0x7f89940a7880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f898c009e50 tx=0x7f898c00b040 comp rx=0 tx=0).stop 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.314+0000 7f89995dc700 1 -- 172.21.15.82:0/894776515 reap_dead start 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.315+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 shutdown_connections 2023-10-06T03:15:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.315+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 >> 172.21.15.82:0/894776515 conn(0x7f8994068b90 msgr2=0x7f89940b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.316+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe490067080 msgr2=0x7fe490069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.316+0000 7fe4b3a47700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe490067080 0x7fe490069530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4007fd0 tx=0x7fe4a4002690 comp rx=0 tx=0).stop 2023-10-06T03:15:58.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.316+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cb980 msgr2=0x7fe4ac0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.316+0000 7fe4b3a47700 1 --2- 172.21.15.82:0/1193766751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4ac0cb980 0x7fe4ac0b15d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00c7b0 tx=0x7fe49c007140 comp rx=0 tx=0).stop 2023-10-06T03:15:58.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.316+0000 7fe4b1fe4700 1 -- 172.21.15.82:0/1193766751 reap_dead start 2023-10-06T03:15:58.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.316+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 shutdown_connections 2023-10-06T03:15:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.316+0000 7f899b03f700 1 -- 172.21.15.82:0/894776515 wait complete. 2023-10-06T03:15:58.360 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-10-06T03:15:58.361 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:15:58.361 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-10-06T03:15:58.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:15:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.323+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 shutdown_connections 2023-10-06T03:15:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.323+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 >> 172.21.15.82:0/1193766751 conn(0x7fe4ac068b90 msgr2=0x7fe4ac0694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.323+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 shutdown_connections 2023-10-06T03:15:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.323+0000 7fe4b3a47700 1 -- 172.21.15.82:0/1193766751 wait complete. 2023-10-06T03:15:58.363 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2023-10-06T03:15:58.364 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:15:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.330+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 --> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe600acdc0 con 0x7fbe60157dc0 2023-10-06T03:15:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.330+0000 7fbe46ffd700 1 -- 172.21.15.82:0/46194088 <== osd.3 v2:172.21.15.82:6800/90631 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe600acdc0 con 0x7fbe60157dc0 2023-10-06T03:15:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.331+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7fbe60157dc0 msgr2=0x7fbe60158190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.331+0000 7fbe65795700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7fbe60157dc0 0x7fbe60158190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.366 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:15:58.366 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe4c066f30 msgr2=0x7fbe4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe65795700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe4c066f30 0x7fbe4c0693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe58002f00 tx=0x7fbe58016000 comp rx=0 tx=0).stop 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe601539d0 msgr2=0x7fbe60157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe65795700 1 --2- 172.21.15.82:0/46194088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe601539d0 0x7fbe60157880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe600ab8a0 tx=0x7fbe54009040 comp rx=0 tx=0).stop 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe5f7fe700 1 -- 172.21.15.82:0/46194088 reap_dead start 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 shutdown_connections 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 >> 172.21.15.82:0/46194088 conn(0x7fbe600680b0 msgr2=0x7fbe60069a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 shutdown_connections 2023-10-06T03:15:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.332+0000 7fbe65795700 1 -- 172.21.15.82:0/46194088 wait complete. 2023-10-06T03:15:58.368 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:15:58.368 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:15:58.369 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-10-06T03:15:58.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:15:58.370 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-10-06T03:15:58.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:15:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.595+0000 7f8af3040700 1 Processor -- start 2023-10-06T03:15:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.597+0000 7fdfaa833700 1 Processor -- start 2023-10-06T03:15:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.598+0000 7fdfaa833700 1 -- start start 2023-10-06T03:15:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.598+0000 7fb64460b700 1 Processor -- start 2023-10-06T03:15:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fb8fad51700 1 Processor -- start 2023-10-06T03:15:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fb8fad51700 1 -- start start 2023-10-06T03:15:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.597+0000 7f8af3040700 1 -- start start 2023-10-06T03:15:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f8af3040700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8aec15dad0 0x7f8aec06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f8af3040700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec06efb0 con 0x7f8aec15dea0 2023-10-06T03:15:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f8af3040700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec0ac7f0 con 0x7f8aec06eb50 2023-10-06T03:15:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f8af3040700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec0abbe0 con 0x7f8aec15dad0 2023-10-06T03:15:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.598+0000 7fb64460b700 1 -- start start 2023-10-06T03:15:58.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfaa833700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdfa406b470 0x7fdfa415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f9ed8481700 1 Processor -- start 2023-10-06T03:15:58.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfaa833700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfa406f270 0x7fdfa40c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfaa833700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa40c7f00 0x7fdfa40aea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfaa833700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa415e290 con 0x7fdfa406f270 2023-10-06T03:15:58.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfaa833700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa40c8870 con 0x7fdfa406b470 2023-10-06T03:15:58.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfaa833700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40ae340 con 0x7fdfa40c7f00 2023-10-06T03:15:58.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f9ed8481700 1 -- start start 2023-10-06T03:15:58.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fb64460b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb63c0cc480 0x7fb63c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb64460b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb63c15f160 0x7fb63c069410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb64460b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c15ecd0 con 0x7fb63c15bc70 2023-10-06T03:15:58.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb64460b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c0b0840 con 0x7fb63c15f160 2023-10-06T03:15:58.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb64460b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c0cbbd0 con 0x7fb63c0cc480 2023-10-06T03:15:58.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb6423a7700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb63c15bc70 0x7fb63c0afbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53856/0 (socket says 172.21.15.82:53856) 2023-10-06T03:15:58.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb6423a7700 1 -- 172.21.15.82:0/2393310437 learned_addr learned my addr 172.21.15.82:0/2393310437 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:58.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f8af15dd700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8aec06eb50 0x7f8aec0acc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:49744/0 (socket says 172.21.15.82:49744) 2023-10-06T03:15:58.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f8af15dd700 1 -- 172.21.15.82:0/2378428089 learned_addr learned my addr 172.21.15.82:0/2378428089 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:15:58.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7f8af0ddc700 1 --2- 172.21.15.82:0/2378428089 >> v2:172.21.15.134:3300/0 conn(0x7f8aec15dad0 0x7f8aec06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb8fad51700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f4069120 0x7fb8f40af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb8fad51700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8f40afe00 0x7fb8f41561e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb8fad51700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb8f40694f0 0x7fb8f4156720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb8fad51700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40c9730 con 0x7fb8f40afe00 2023-10-06T03:15:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb8fad51700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40ad9c0 con 0x7fb8f40694f0 2023-10-06T03:15:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb8fad51700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4156c60 con 0x7fb8f4069120 2023-10-06T03:15:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfa37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfa406f270 0x7fdfa40c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfa37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfa406f270 0x7fdfa40c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43596/0 (socket says 172.21.15.82:43596) 2023-10-06T03:15:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfa3fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdfa406b470 0x7fdfa415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.599+0000 7fdfa37fe700 1 -- 172.21.15.82:0/1154085565 learned_addr learned my addr 172.21.15.82:0/1154085565 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fdfa37fe700 1 -- 172.21.15.82:0/1154085565 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa40c7f00 msgr2=0x7fdfa40aea90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:15:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fdfa37fe700 1 --2- 172.21.15.82:0/1154085565 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa40c7f00 0x7fdfa40aea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fdfa37fe700 1 -- 172.21.15.82:0/1154085565 >> v2:172.21.15.134:3300/0 conn(0x7fdfa406b470 msgr2=0x7fdfa415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fdfa37fe700 1 --2- 172.21.15.82:0/1154085565 >> v2:172.21.15.134:3300/0 conn(0x7fdfa406b470 0x7fdfa415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fdfa37fe700 1 -- 172.21.15.82:0/1154085565 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40c8310 con 0x7fdfa406f270 2023-10-06T03:15:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb642ba8700 1 --2- 172.21.15.82:0/2393310437 >> v2:172.21.15.82:3300/0 conn(0x7fb63c15f160 0x7fb63c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414877670 0 0) 0x7f8ae4001490 con 0x7f8aec15dea0 2023-10-06T03:15:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad4003570 con 0x7f8aec15dea0 2023-10-06T03:15:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fdfa37fe700 1 --2- 172.21.15.82:0/1154085565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa406f270 0x7fdfa40c79c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdfa406e560 tx=0x7fdf98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8bb8f8540b0251 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb6413a5700 1 -- 172.21.15.82:0/2393310437 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119029767 0 0) 0x7fb63c15ecd0 con 0x7fb63c15bc70 2023-10-06T03:15:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb641ba6700 1 --2- 172.21.15.82:0/2393310437 >> v2:172.21.15.134:3300/0 conn(0x7fb63c0cc480 0x7fb63c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb6413a5700 1 -- 172.21.15.82:0/2393310437 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb628003570 con 0x7fb63c15bc70 2023-10-06T03:15:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665011506 0 0) 0x7f8aec0ac7f0 con 0x7f8aec06eb50 2023-10-06T03:15:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae4001490 con 0x7f8aec06eb50 2023-10-06T03:15:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb642ba8700 1 -- 172.21.15.82:0/2393310437 >> v2:172.21.15.134:3300/0 conn(0x7fb63c0cc480 msgr2=0x7fb63c068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb642ba8700 1 --2- 172.21.15.82:0/2393310437 >> v2:172.21.15.134:3300/0 conn(0x7fb63c0cc480 0x7fb63c068ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb642ba8700 1 -- 172.21.15.82:0/2393310437 >> v1:172.21.15.82:6789/0 conn(0x7fb63c15bc70 legacy=0x7fb63c0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fb642ba8700 1 -- 172.21.15.82:0/2393310437 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0b0300 con 0x7fb63c15f160 2023-10-06T03:15:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2821746622 0 0) 0x7f8ad4003570 con 0x7f8aec15dea0 2023-10-06T03:15:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 >> v2:172.21.15.134:3300/0 conn(0x7f8aec15dad0 msgr2=0x7f8aec06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f8aeb7fe700 1 --2- 172.21.15.82:0/2378428089 >> v2:172.21.15.134:3300/0 conn(0x7f8aec15dad0 0x7f8aec06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 >> v1:172.21.15.134:6789/0 conn(0x7f8aec06eb50 legacy=0x7f8aec0acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0abec0 con 0x7f8aec15dea0 2023-10-06T03:15:58.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7fd62fd08700 1 Processor -- start 2023-10-06T03:15:58.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f8ae4001980 con 0x7f8aec15dea0 2023-10-06T03:15:58.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.600+0000 7f9ed8481700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9ed015bc70 0x7f9ed00afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed8481700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ed00cc480 0x7f9ed0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed8481700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed0069410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed8481700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00b0840 con 0x7f9ed00cc480 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed8481700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00cbbd0 con 0x7f9ed015bc70 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed8481700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed015ecd0 con 0x7f9ed015f160 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 >> v1:172.21.15.82:6789/0 conn(0x7f8aec15dea0 legacy=0x7f8aec0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad4003bf0 0x7f8ad4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad4004810 0x7f8ad4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad40051c0 0x7f8ad400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0abbe0 con 0x7f8ad4004810 2023-10-06T03:15:58.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad400c0b0 con 0x7f8ad4003bf0 2023-10-06T03:15:58.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad400c270 con 0x7f8ad40051c0 2023-10-06T03:15:58.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed621d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9ed015bc70 0x7f9ed00afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed621d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9ed015bc70 0x7f9ed00afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44698/0 (socket says 172.21.15.82:44698) 2023-10-06T03:15:58.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed621d700 1 -- 172.21.15.82:0/3584680007 learned_addr learned my addr 172.21.15.82:0/3584680007 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fd62fd08700 1 -- start start 2023-10-06T03:15:58.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed6a1e700 1 --2- 172.21.15.82:0/3584680007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed5a1c700 1 --2- 172.21.15.82:0/3584680007 >> v2:172.21.15.82:3300/0 conn(0x7f9ed00cc480 0x7f9ed0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f8aed700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f4069120 0x7fb8f40af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8af15dd700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad40051c0 0x7f8ad400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8aebfff700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad4004810 0x7f8ad4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f92ee700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb8f40694f0 0x7fb8f4156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8f40afe00 0x7fb8f41561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f8aed700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f4069120 0x7fb8f40af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42338/0 (socket says 172.21.15.82:42338) 2023-10-06T03:15:58.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8f40afe00 0x7fb8f41561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43618/0 (socket says 172.21.15.82:43618) 2023-10-06T03:15:58.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f8aed700 1 -- 172.21.15.82:0/3387210971 learned_addr learned my addr 172.21.15.82:0/3387210971 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f8af0ddc700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad4003bf0 0x7f8ad4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb642ba8700 1 --2- 172.21.15.82:0/2393310437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15f160 0x7fb63c069410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0abdb0 tx=0x7fb634009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5181f4870fb31e3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8af15dd700 1 -- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad4003bf0 msgr2=0x7f8ad4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8af15dd700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad4003bf0 0x7f8ad4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8af15dd700 1 -- 172.21.15.82:0/2378428089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad4004810 msgr2=0x7f8ad4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8af15dd700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad4004810 0x7f8ad4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8af15dd700 1 -- 172.21.15.82:0/2378428089 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0abec0 con 0x7f8ad40051c0 2023-10-06T03:15:58.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed6a1e700 1 -- 172.21.15.82:0/3584680007 >> v2:172.21.15.134:3300/0 conn(0x7f9ed015bc70 msgr2=0x7f9ed00afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed6a1e700 1 --2- 172.21.15.82:0/3584680007 >> v2:172.21.15.134:3300/0 conn(0x7f9ed015bc70 0x7f9ed00afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed6a1e700 1 -- 172.21.15.82:0/3584680007 >> v2:172.21.15.82:3300/0 conn(0x7f9ed00cc480 msgr2=0x7f9ed0068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed6a1e700 1 --2- 172.21.15.82:0/3584680007 >> v2:172.21.15.82:3300/0 conn(0x7f9ed00cc480 0x7f9ed0068ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7f9ed6a1e700 1 -- 172.21.15.82:0/3584680007 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed00b0560 con 0x7f9ed015f160 2023-10-06T03:15:58.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f3fff700 1 -- 172.21.15.82:0/3387210971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f4069120 msgr2=0x7fb8f40af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f3fff700 1 --2- 172.21.15.82:0/3387210971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f4069120 0x7fb8f40af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f3fff700 1 -- 172.21.15.82:0/3387210971 >> v2:172.21.15.134:3300/0 conn(0x7fb8f40694f0 msgr2=0x7fb8f4156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f3fff700 1 --2- 172.21.15.82:0/3387210971 >> v2:172.21.15.134:3300/0 conn(0x7fb8f40694f0 0x7fb8f4156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.601+0000 7fb8f3fff700 1 -- 172.21.15.82:0/3387210971 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40ad690 con 0x7fb8f40afe00 2023-10-06T03:15:58.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fdfa2ffd700 1 -- 172.21.15.82:0/1154085565 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98009ea0 con 0x7fdfa406f270 2023-10-06T03:15:58.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fdfa2ffd700 1 -- 172.21.15.82:0/1154085565 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9800b820 con 0x7fdfa406f270 2023-10-06T03:15:58.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fdfa2ffd700 1 -- 172.21.15.82:0/1154085565 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800bbc0 con 0x7fdfa406f270 2023-10-06T03:15:58.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fb6413a5700 1 -- 172.21.15.82:0/2393310437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63400e070 con 0x7fb63c15f160 2023-10-06T03:15:58.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fb6413a5700 1 -- 172.21.15.82:0/2393310437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63400bab0 con 0x7fb63c15f160 2023-10-06T03:15:58.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fb6413a5700 1 -- 172.21.15.82:0/2393310437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63400be70 con 0x7fb63c15f160 2023-10-06T03:15:58.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f9ed6a1e700 1 --2- 172.21.15.82:0/3584680007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed0069410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ed006d700 tx=0x7f9ec8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c2b0e26ccb0bcf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8af15dd700 1 -- 172.21.15.82:0/2378428089 reap_dead start 2023-10-06T03:15:58.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8af15dd700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad40051c0 0x7f8ad400ba60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8adc001af0 tx=0x7f8adc007e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7219761282c95621 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f9ed521b700 1 -- 172.21.15.82:0/3584680007 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec800e070 con 0x7f9ed015f160 2023-10-06T03:15:58.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f9ed521b700 1 -- 172.21.15.82:0/3584680007 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec800bb20 con 0x7f9ed015f160 2023-10-06T03:15:58.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f9ed521b700 1 -- 172.21.15.82:0/3584680007 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8012430 con 0x7f9ed015f160 2023-10-06T03:15:58.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0070d0 con 0x7f8ad40051c0 2023-10-06T03:15:58.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc007230 con 0x7f8ad40051c0 2023-10-06T03:15:58.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7f8aeb7fe700 1 -- 172.21.15.82:0/2378428089 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0075d0 con 0x7f8ad40051c0 2023-10-06T03:15:58.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fd62fd08700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280c8d40 0x7fd6280c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fd62fd08700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd628157a40 con 0x7fd6280ae160 2023-10-06T03:15:58.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fd62fd08700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6280c88b0 con 0x7fd6280b2d10 2023-10-06T03:15:58.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fd62fd08700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6280b30e0 con 0x7fd6280c8d40 2023-10-06T03:15:58.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fd62d2a3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280c8d40 0x7fd6280c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fd62d2a3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280c8d40 0x7fd6280c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43638/0 (socket says 172.21.15.82:43638) 2023-10-06T03:15:58.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fd62d2a3700 1 -- 172.21.15.82:0/1669899971 learned_addr learned my addr 172.21.15.82:0/1669899971 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 -- 172.21.15.82:0/1154085565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa406f270 msgr2=0x7fdfa40c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 --2- 172.21.15.82:0/1154085565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa406f270 0x7fdfa40c79c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdfa406e560 tx=0x7fdf98009250 comp rx=0 tx=0).stop 2023-10-06T03:15:58.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fb64460b700 1 -- 172.21.15.82:0/2393310437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15f160 msgr2=0x7fb63c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fb64460b700 1 --2- 172.21.15.82:0/2393310437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15f160 0x7fb63c069410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0abdb0 tx=0x7fb634009780 comp rx=0 tx=0).stop 2023-10-06T03:15:58.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fb8f3fff700 1 --2- 172.21.15.82:0/3387210971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 0x7fb8f41561e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80098e0 tx=0x7fb8e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384f77b8713cc1e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fb8f37fe700 1 -- 172.21.15.82:0/3387210971 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800b690 con 0x7fb8f40afe00 2023-10-06T03:15:58.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fb8f37fe700 1 -- 172.21.15.82:0/3387210971 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e800b7f0 con 0x7fb8f40afe00 2023-10-06T03:15:58.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.602+0000 7fb8f37fe700 1 -- 172.21.15.82:0/3387210971 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800bb90 con 0x7fb8f40afe00 2023-10-06T03:15:58.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fb64460b700 1 -- 172.21.15.82:0/2393310437 shutdown_connections 2023-10-06T03:15:58.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fb64460b700 1 --2- 172.21.15.82:0/2393310437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15f160 0x7fb63c069410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fb64460b700 1 --2- 172.21.15.82:0/2393310437 >> v2:172.21.15.134:3300/0 conn(0x7fb63c0cc480 0x7fb63c068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fb64460b700 1 -- 172.21.15.82:0/2393310437 >> 172.21.15.82:0/2393310437 conn(0x7fb63c06e910 msgr2=0x7fb63c06be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fd62caa2700 1 -- 172.21.15.82:0/1669899971 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229276383 0 0) 0x7fd628157a40 con 0x7fd6280ae160 2023-10-06T03:15:58.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fd62caa2700 1 -- 172.21.15.82:0/1669899971 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd614003570 con 0x7fd6280ae160 2023-10-06T03:15:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 -- 172.21.15.82:0/1154085565 shutdown_connections 2023-10-06T03:15:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 --2- 172.21.15.82:0/1154085565 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa40c7f00 0x7fdfa40aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 --2- 172.21.15.82:0/1154085565 >> v2:172.21.15.134:3300/0 conn(0x7fdfa406b470 0x7fdfa415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 --2- 172.21.15.82:0/1154085565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa406f270 0x7fdfa40c79c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 -- 172.21.15.82:0/1154085565 >> 172.21.15.82:0/1154085565 conn(0x7fdfa406e760 msgr2=0x7fdfa406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fd62d2a3700 1 -- 172.21.15.82:0/1669899971 >> v1:172.21.15.134:6789/0 conn(0x7fd6280b2d10 legacy=0x7fd6280ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fd62d2a3700 1 -- 172.21.15.82:0/1669899971 >> v1:172.21.15.82:6789/0 conn(0x7fd6280ae160 legacy=0x7fd6280b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fd62d2a3700 1 -- 172.21.15.82:0/1669899971 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280c79c0 con 0x7fd6280c8d40 2023-10-06T03:15:58.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 -- 172.21.15.82:0/3584680007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 msgr2=0x7f9ed0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 --2- 172.21.15.82:0/3584680007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed0069410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ed006d700 tx=0x7f9ec8009780 comp rx=0 tx=0).stop 2023-10-06T03:15:58.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 -- 172.21.15.82:0/3584680007 shutdown_connections 2023-10-06T03:15:58.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 -- 172.21.15.82:0/1154085565 shutdown_connections 2023-10-06T03:15:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fb64460b700 1 -- 172.21.15.82:0/2393310437 shutdown_connections 2023-10-06T03:15:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 --2- 172.21.15.82:0/3584680007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed0069410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 --2- 172.21.15.82:0/3584680007 >> v2:172.21.15.134:3300/0 conn(0x7f9ed015bc70 0x7f9ed00afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 --2- 172.21.15.82:0/3584680007 >> v2:172.21.15.82:3300/0 conn(0x7f9ed00cc480 0x7f9ed0068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 -- 172.21.15.82:0/3584680007 >> 172.21.15.82:0/3584680007 conn(0x7f9ed006e910 msgr2=0x7f9ed006be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fb64460b700 1 -- 172.21.15.82:0/2393310437 wait complete. 2023-10-06T03:15:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f8af3040700 1 -- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad40051c0 msgr2=0x7f8ad400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f8af3040700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad40051c0 0x7f8ad400ba60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8adc001af0 tx=0x7f8adc007e20 comp rx=0 tx=0).stop 2023-10-06T03:15:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f8af3040700 1 -- 172.21.15.82:0/2378428089 shutdown_connections 2023-10-06T03:15:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f8af3040700 1 --2- 172.21.15.82:0/2378428089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad40051c0 0x7f8ad400ba60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f8af3040700 1 -- 172.21.15.82:0/2378428089 >> 172.21.15.82:0/2378428089 conn(0x7f8aec0680b0 msgr2=0x7f8aec0684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 -- 172.21.15.82:0/3584680007 shutdown_connections 2023-10-06T03:15:58.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f8af3040700 1 -- 172.21.15.82:0/2378428089 shutdown_connections 2023-10-06T03:15:58.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7f9ed8481700 1 -- 172.21.15.82:0/3584680007 wait complete. 2023-10-06T03:15:58.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fd62d2a3700 1 --2- 172.21.15.82:0/1669899971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280c8d40 0x7fd6280c91e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd6240099b0 tx=0x7fd624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4424b777fc80bd2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fd62caa2700 1 -- 172.21.15.82:0/1669899971 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624009ea0 con 0x7fd6280c8d40 2023-10-06T03:15:58.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fd62caa2700 1 -- 172.21.15.82:0/1669899971 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400b820 con 0x7fd6280c8d40 2023-10-06T03:15:58.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fd62caa2700 1 -- 172.21.15.82:0/1669899971 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400bbc0 con 0x7fd6280c8d40 2023-10-06T03:15:58.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.603+0000 7fdfaa833700 1 -- 172.21.15.82:0/1154085565 wait complete. 2023-10-06T03:15:58.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7fdfaa833700 1 Processor -- start 2023-10-06T03:15:58.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7fb64460b700 1 Processor -- start 2023-10-06T03:15:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 -- 172.21.15.82:0/3387210971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 msgr2=0x7fb8f41561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7f9132db1700 1 Processor -- start 2023-10-06T03:15:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3387210971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 0x7fb8f41561e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80098e0 tx=0x7fb8e80091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 -- 172.21.15.82:0/3387210971 shutdown_connections 2023-10-06T03:15:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3387210971 >> v2:172.21.15.134:3300/0 conn(0x7fb8f40694f0 0x7fb8f4156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3387210971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f4069120 0x7fb8f40af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3387210971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 0x7fb8f41561e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 -- 172.21.15.82:0/3387210971 >> 172.21.15.82:0/3387210971 conn(0x7fb8f406e910 msgr2=0x7fb8f406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 -- 172.21.15.82:0/3387210971 shutdown_connections 2023-10-06T03:15:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7fb8fad51700 1 -- 172.21.15.82:0/3387210971 wait complete. 2023-10-06T03:15:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7fb64460b700 1 -- start start 2023-10-06T03:15:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7f9132db1700 1 -- start start 2023-10-06T03:15:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7fb8fad51700 1 Processor -- start 2023-10-06T03:15:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.604+0000 7f8af3040700 1 -- 172.21.15.82:0/2378428089 wait complete. 2023-10-06T03:15:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7f8af3040700 1 Processor -- start 2023-10-06T03:15:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb8fad51700 1 -- start start 2023-10-06T03:15:58.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb64460b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c0cc480 0x7fb63c147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb64460b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15bc70 0x7fb63c0ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb64460b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb63c15f160 0x7fb63c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb64460b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c149220 con 0x7fb63c15bc70 2023-10-06T03:15:58.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb64460b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c147900 con 0x7fb63c0cc480 2023-10-06T03:15:58.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb64460b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c148610 con 0x7fb63c15f160 2023-10-06T03:15:58.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7fdfaa833700 1 -- start start 2023-10-06T03:15:58.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fdfaa833700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa406b470 0x7fdfa4157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fdfaa833700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa406f270 0x7fdfa40c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fdfaa833700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40c7f00 0x7fdfa4158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fdfaa833700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40c5c90 con 0x7fdfa406b470 2023-10-06T03:15:58.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fdfaa833700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4069820 con 0x7fdfa40c7f00 2023-10-06T03:15:58.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fdfaa833700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4069b00 con 0x7fdfa406f270 2023-10-06T03:15:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fd62fd08700 1 -- 172.21.15.82:0/1669899971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280c8d40 msgr2=0x7fd6280c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fd62fd08700 1 --2- 172.21.15.82:0/1669899971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280c8d40 0x7fd6280c91e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd6240099b0 tx=0x7fd624009250 comp rx=0 tx=0).stop 2023-10-06T03:15:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb641ba6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15bc70 0x7fb63c0ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb641ba6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15bc70 0x7fb63c0ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43640/0 (socket says 172.21.15.82:43640) 2023-10-06T03:15:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb641ba6700 1 -- 172.21.15.82:0/412101586 learned_addr learned my addr 172.21.15.82:0/412101586 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb6423a7700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c0cc480 0x7fb63c147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7fb642ba8700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb63c15f160 0x7fb63c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb6423a7700 1 -- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb63c15f160 msgr2=0x7fb63c0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb6423a7700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb63c15f160 0x7fb63c0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb6423a7700 1 -- 172.21.15.82:0/412101586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15bc70 msgr2=0x7fb63c0ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb6423a7700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15bc70 0x7fb63c0ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb6423a7700 1 -- 172.21.15.82:0/412101586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009a20 con 0x7fb63c0cc480 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb642ba8700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb63c15f160 0x7fb63c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7f8af3040700 1 -- start start 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8af3040700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad40051c0 0x7f8aec0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8af3040700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec098390 0x7f8aec16e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8af3040700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec0991b0 0x7f8aec096a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8af3040700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec159580 con 0x7f8ad40051c0 2023-10-06T03:15:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8af3040700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec098a40 con 0x7f8aec0991b0 2023-10-06T03:15:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8af3040700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0ab0e0 con 0x7f8aec098390 2023-10-06T03:15:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.605+0000 7f9ed8481700 1 Processor -- start 2023-10-06T03:15:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.606+0000 7f9ed8481700 1 -- start start 2023-10-06T03:15:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f9132db1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f912c13fee0 0x7f912c0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f9132db1700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c0c87a0 con 0x7f912c06f270 2023-10-06T03:15:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f9132db1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c06adb0 con 0x7f912c13fb10 2023-10-06T03:15:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f9132db1700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c06b090 con 0x7f912c13fee0 2023-10-06T03:15:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f9123fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f912c13fee0 0x7f912c0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f9123fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f912c13fee0 0x7f912c0c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43656/0 (socket says 172.21.15.82:43656) 2023-10-06T03:15:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f9123fff700 1 -- 172.21.15.82:0/1726460571 learned_addr learned my addr 172.21.15.82:0/1726460571 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8fad51700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f4069120 0x7fb8f4162990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8fad51700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40694f0 0x7fb8f40cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8fad51700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 0x7fb8f40cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8fad51700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40abe10 con 0x7fb8f40afe00 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8fad51700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40c9f90 con 0x7fb8f4069120 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8fad51700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4177840 con 0x7fb8f40694f0 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f8aed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f4069120 0x7fb8f4162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f8aed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f4069120 0x7fb8f4162990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44736/0 (socket says 172.21.15.82:44736) 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f8aed700 1 -- 172.21.15.82:0/3904534124 learned_addr learned my addr 172.21.15.82:0/3904534124 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa406f270 0x7fdfa40c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa406f270 0x7fdfa40c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42374/0 (socket says 172.21.15.82:42374) 2023-10-06T03:15:58.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 -- 172.21.15.82:0/4113818464 learned_addr learned my addr 172.21.15.82:0/4113818464 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa8dd0700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40c7f00 0x7fdfa4158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 -- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40c7f00 msgr2=0x7fdfa4158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f3fff700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40694f0 0x7fb8f40cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40c7f00 0x7fdfa4158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 -- 172.21.15.82:0/4113818464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa406b470 msgr2=0x7fdfa4157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa406b470 0x7fdfa4157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 -- 172.21.15.82:0/4113818464 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980094f0 con 0x7fdfa406f270 2023-10-06T03:15:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8aebfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec098390 0x7f8aec16e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f92ee700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 0x7fb8f40cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8aebfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec098390 0x7f8aec16e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42384/0 (socket says 172.21.15.82:42384) 2023-10-06T03:15:58.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8aebfff700 1 -- 172.21.15.82:0/69498100 learned_addr learned my addr 172.21.15.82:0/69498100 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f21207ec700 1 Processor -- start 2023-10-06T03:15:58.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7f8af15dd700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec0991b0 0x7f8aec096a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f8aed700 1 -- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40694f0 msgr2=0x7fb8f40cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f8aed700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40694f0 0x7fb8f40cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f8aed700 1 -- 172.21.15.82:0/3904534124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 msgr2=0x7fb8f40cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f8aed700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 0x7fb8f40cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb6423a7700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c0cc480 0x7fb63c147c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c580 tx=0x7fb638007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fb8f8aed700 1 -- 172.21.15.82:0/3904534124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8009420 con 0x7fb8f4069120 2023-10-06T03:15:58.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fdfa37fe700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa406f270 0x7fdfa40c5750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009930 tx=0x7fdf98017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f21207ec700 1 -- start start 2023-10-06T03:15:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f8af0ddc700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad40051c0 0x7f8aec0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9123fff700 1 -- 172.21.15.82:0/1726460571 >> v1:172.21.15.134:6789/0 conn(0x7f912c13fb10 legacy=0x7f912c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9123fff700 1 -- 172.21.15.82:0/1726460571 >> v1:172.21.15.82:6789/0 conn(0x7f912c06f270 legacy=0x7f912c0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9123fff700 1 -- 172.21.15.82:0/1726460571 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c06b370 con 0x7f912c13fee0 2023-10-06T03:15:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7fb6327fc700 1 -- 172.21.15.82:0/412101586 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638005b30 con 0x7fb63c0cc480 2023-10-06T03:15:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7fb6327fc700 1 -- 172.21.15.82:0/412101586 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638005cb0 con 0x7fb63c0cc480 2023-10-06T03:15:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c1488f0 con 0x7fb63c0cc480 2023-10-06T03:15:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f8aebfff700 1 -- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec0991b0 msgr2=0x7f8aec096a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f8aebfff700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec0991b0 0x7f8aec096a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f8aebfff700 1 -- 172.21.15.82:0/69498100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad40051c0 msgr2=0x7f8aec0aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f8aebfff700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad40051c0 0x7f8aec0aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f8aebfff700 1 -- 172.21.15.82:0/69498100 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec16e8d0 con 0x7f8aec098390 2023-10-06T03:15:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed8481700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed00cc480 0x7f9ed00a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed8481700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed015bc70 0x7f9ed015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed8481700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed8481700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00addf0 con 0x7f9ed015bc70 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed8481700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0163300 con 0x7f9ed00cc480 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed8481700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0162d40 con 0x7f9ed015f160 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed5a1c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed015bc70 0x7f9ed015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed5a1c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed015bc70 0x7f9ed015ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43688/0 (socket says 172.21.15.82:43688) 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed5a1c700 1 -- 172.21.15.82:0/2981808963 learned_addr learned my addr 172.21.15.82:0/2981808963 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed621d700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed00cc480 0x7f9ed00a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed6a1e700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed5a1c700 1 -- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 msgr2=0x7f9ed006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9ed5a1c700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed006aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ed5a1c700 1 -- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed00cc480 msgr2=0x7f9ed00a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ed5a1c700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed00cc480 0x7f9ed00a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ed5a1c700 1 -- 172.21.15.82:0/2981808963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8009a20 con 0x7f9ed015bc70 2023-10-06T03:15:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ed5a1c700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed015bc70 0x7f9ed015ad10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000d860 tx=0x7f9ec0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f9123fff700 1 --2- 172.21.15.82:0/1726460571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c13fee0 0x7f912c0c79c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f91140099b0 tx=0x7f9114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663ec16aab1f1968 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f912bfff700 1 -- 172.21.15.82:0/1726460571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400b860 con 0x7f912c13fee0 2023-10-06T03:15:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f912bfff700 1 -- 172.21.15.82:0/1726460571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911400b9c0 con 0x7f912c13fee0 2023-10-06T03:15:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7f912bfff700 1 -- 172.21.15.82:0/1726460571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400bd60 con 0x7f912c13fee0 2023-10-06T03:15:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7fb8f8aed700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f4069120 0x7fb8f4162990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400ea50 tx=0x7fb8e4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fd62fd08700 1 -- 172.21.15.82:0/1669899971 shutdown_connections 2023-10-06T03:15:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fd62fd08700 1 --2- 172.21.15.82:0/1669899971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280c8d40 0x7fd6280c91e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.607+0000 7fd62fd08700 1 -- 172.21.15.82:0/1669899971 >> 172.21.15.82:0/1669899971 conn(0x7fd62806e760 msgr2=0x7fd62806eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7fd62fd08700 1 -- 172.21.15.82:0/1669899971 shutdown_connections 2023-10-06T03:15:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7fd62fd08700 1 -- 172.21.15.82:0/1669899971 wait complete. 2023-10-06T03:15:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7fb6327fc700 1 -- 172.21.15.82:0/412101586 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638007320 con 0x7fb63c0cc480 2023-10-06T03:15:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.608+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c148eb0 con 0x7fb63c0cc480 2023-10-06T03:15:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f21207ec700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21180cb800 0x7f21180b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f21207ec700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2118159fa0 0x7f211815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f21207ec700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21181544a0 con 0x7f21180af040 2023-10-06T03:15:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f21207ec700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21180b1600 con 0x7f21180cb800 2023-10-06T03:15:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f21207ec700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211815a930 con 0x7f2118159fa0 2023-10-06T03:15:58.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f8aebfff700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec098390 0x7f8aec16e080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40032e0 tx=0x7f8ae4007cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ec67fc700 1 -- 172.21.15.82:0/2981808963 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec00125f0 con 0x7f9ed015bc70 2023-10-06T03:15:58.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ec67fc700 1 -- 172.21.15.82:0/2981808963 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec0012750 con 0x7f9ed015bc70 2023-10-06T03:15:58.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ec67fc700 1 -- 172.21.15.82:0/2981808963 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0012af0 con 0x7f9ed015bc70 2023-10-06T03:15:58.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7fb8f0ff9700 1 -- 172.21.15.82:0/3904534124 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400c640 con 0x7fb8f4069120 2023-10-06T03:15:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7fb8f0ff9700 1 -- 172.21.15.82:0/3904534124 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400c7a0 con 0x7fb8f4069120 2023-10-06T03:15:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7fb8f0ff9700 1 -- 172.21.15.82:0/3904534124 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400cb20 con 0x7fb8f4069120 2023-10-06T03:15:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed0163020 con 0x7f9ed015bc70 2023-10-06T03:15:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed015b250 con 0x7f9ed015bc70 2023-10-06T03:15:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f211dd87700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2118159fa0 0x7f211815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f211dd87700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2118159fa0 0x7f211815a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42394/0 (socket says 172.21.15.82:42394) 2023-10-06T03:15:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f211dd87700 1 -- 172.21.15.82:0/4139779876 learned_addr learned my addr 172.21.15.82:0/4139779876 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f211ed89700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f21180af040 0x7f21180af470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53882/0 (socket says 172.21.15.82:53882) 2023-10-06T03:15:58.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f8ae8ff9700 1 -- 172.21.15.82:0/69498100 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4003ed0 con 0x7f8aec098390 2023-10-06T03:15:58.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f8ae8ff9700 1 -- 172.21.15.82:0/69498100 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4014470 con 0x7f8aec098390 2023-10-06T03:15:58.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f8ae8ff9700 1 -- 172.21.15.82:0/69498100 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4014830 con 0x7f8aec098390 2023-10-06T03:15:58.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f211dd87700 1 -- 172.21.15.82:0/4139779876 >> v2:172.21.15.82:3300/0 conn(0x7f21180cb800 msgr2=0x7f21180b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7f211dd87700 1 --2- 172.21.15.82:0/4139779876 >> v2:172.21.15.82:3300/0 conn(0x7f21180cb800 0x7f21180b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7f211dd87700 1 -- 172.21.15.82:0/4139779876 >> v1:172.21.15.82:6789/0 conn(0x7f21180af040 legacy=0x7f21180af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:15:58.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7f211dd87700 1 -- 172.21.15.82:0/4139779876 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211806be00 con 0x7f2118159fa0 2023-10-06T03:15:58.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9132db1700 1 -- 172.21.15.82:0/1726460571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c13fee0 msgr2=0x7f912c0c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7f9132db1700 1 --2- 172.21.15.82:0/1726460571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c13fee0 0x7f912c0c79c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f91140099b0 tx=0x7f9114009250 comp rx=0 tx=0).stop 2023-10-06T03:15:58.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fb6327fc700 1 -- 172.21.15.82:0/412101586 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb63801b3b0 con 0x7fb63c0cc480 2023-10-06T03:15:58.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fdf8bfff700 1 -- 172.21.15.82:0/4113818464 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800b990 con 0x7fdfa406f270 2023-10-06T03:15:58.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fdf8bfff700 1 -- 172.21.15.82:0/4113818464 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9800bb10 con 0x7fdfa406f270 2023-10-06T03:15:58.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa4068bf0 con 0x7fdfa406f270 2023-10-06T03:15:58.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40691b0 con 0x7fdfa406f270 2023-10-06T03:15:58.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fb6327fc700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb620067000 0x7fb6200694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4177560 con 0x7fb8f4069120 2023-10-06T03:15:58.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.609+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f40c9c20 con 0x7fb8f4069120 2023-10-06T03:15:58.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d40052b0 con 0x7fb8f4069120 2023-10-06T03:15:58.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fd62fd08700 1 Processor -- start 2023-10-06T03:15:58.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fd62fd08700 1 -- start start 2023-10-06T03:15:58.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fb6327fc700 1 -- 172.21.15.82:0/412101586 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb638083a80 con 0x7fb63c0cc480 2023-10-06T03:15:58.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fb641ba6700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb620067000 0x7fb6200694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62fd08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280ae160 0x7fd6280b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62fd08700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6280b2d10 0x7fd6280a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec16ebb0 con 0x7f8aec098390 2023-10-06T03:15:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fb641ba6700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb620067000 0x7fb6200694b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0b1070 tx=0x7fb62c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62fd08700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6280c8d40 0x7fd62806a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62fd08700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd628177680 con 0x7fd6280ae160 2023-10-06T03:15:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62fd08700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd628176a70 con 0x7fd6280c8d40 2023-10-06T03:15:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62fd08700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd628176d50 con 0x7fd6280b2d10 2023-10-06T03:15:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.610+0000 7fdf8bfff700 1 -- 172.21.15.82:0/4113818464 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98025670 con 0x7fdfa406f270 2023-10-06T03:15:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec098c90 con 0x7f8aec098390 2023-10-06T03:15:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7f211dd87700 1 --2- 172.21.15.82:0/4139779876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2118159fa0 0x7f211815a3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2110009f20 tx=0x7f2110009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7135a5282d06f1ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf840052b0 con 0x7fdfa406f270 2023-10-06T03:15:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62daa4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280ae160 0x7fd6280b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62daa4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280ae160 0x7fd6280b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43708/0 (socket says 172.21.15.82:43708) 2023-10-06T03:15:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62daa4700 1 -- 172.21.15.82:0/760457632 learned_addr learned my addr 172.21.15.82:0/760457632 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.611+0000 7fd62e2a5700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6280c8d40 0x7fd62806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed0064050 con 0x7f9ed015bc70 2023-10-06T03:15:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f9132db1700 1 -- 172.21.15.82:0/1726460571 shutdown_connections 2023-10-06T03:15:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f9132db1700 1 --2- 172.21.15.82:0/1726460571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c13fee0 0x7f912c0c79c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f9132db1700 1 -- 172.21.15.82:0/1726460571 >> 172.21.15.82:0/1726460571 conn(0x7f912c06e760 msgr2=0x7f912c06eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f9132db1700 1 -- 172.21.15.82:0/1726460571 shutdown_connections 2023-10-06T03:15:58.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f211d586700 1 -- 172.21.15.82:0/4139779876 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211000e070 con 0x7f2118159fa0 2023-10-06T03:15:58.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec098eb0 con 0x7f8aec098390 2023-10-06T03:15:58.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7fdf8bfff700 1 -- 172.21.15.82:0/4113818464 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf98023070 con 0x7fdfa406f270 2023-10-06T03:15:58.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f9ec67fc700 1 -- 172.21.15.82:0/2981808963 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ec0013480 con 0x7f9ed015bc70 2023-10-06T03:15:58.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7fdf8bfff700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf90067000 0x7fdf900694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f9ec67fc700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9eb4066fb0 0x7f9eb4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f9ec67fc700 1 -- 172.21.15.82:0/2981808963 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ec0084240 con 0x7f9ed015bc70 2023-10-06T03:15:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f211d586700 1 -- 172.21.15.82:0/4139779876 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211000ba40 con 0x7f2118159fa0 2023-10-06T03:15:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7f211d586700 1 -- 172.21.15.82:0/4139779876 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21100092e0 con 0x7f2118159fa0 2023-10-06T03:15:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f21207ec700 1 -- 172.21.15.82:0/4139779876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2118159fa0 msgr2=0x7f211815a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f21207ec700 1 --2- 172.21.15.82:0/4139779876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2118159fa0 0x7f211815a3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2110009f20 tx=0x7f2110009840 comp rx=0 tx=0).stop 2023-10-06T03:15:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f21207ec700 1 -- 172.21.15.82:0/4139779876 shutdown_connections 2023-10-06T03:15:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f21207ec700 1 --2- 172.21.15.82:0/4139779876 >> v2:172.21.15.82:3300/0 conn(0x7f21180cb800 0x7f21180b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f21207ec700 1 --2- 172.21.15.82:0/4139779876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2118159fa0 0x7f211815a3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f21207ec700 1 -- 172.21.15.82:0/4139779876 >> 172.21.15.82:0/4139779876 conn(0x7f2118068b90 msgr2=0x7f21180694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:58.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f8ae8ff9700 1 -- 172.21.15.82:0/69498100 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ae4014be0 con 0x7f8aec098390 2023-10-06T03:15:58.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f9ed621d700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9eb4066fb0 0x7f9eb4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7fb8f0ff9700 1 -- 172.21.15.82:0/3904534124 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8e4013470 con 0x7fb8f4069120 2023-10-06T03:15:58.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7fdf8bfff700 1 -- 172.21.15.82:0/4113818464 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf98085b70 con 0x7fdfa406f270 2023-10-06T03:15:58.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7fdfa3fff700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf90067000 0x7fdf900694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7fb8f0ff9700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb8e0067000 0x7fb8e00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7fb8f0ff9700 1 -- 172.21.15.82:0/3904534124 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8e4084e70 con 0x7fb8f4069120 2023-10-06T03:15:58.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7fb8f3fff700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb8e0067000 0x7fb8e00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f21207ec700 1 -- 172.21.15.82:0/4139779876 shutdown_connections 2023-10-06T03:15:58.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f21207ec700 1 -- 172.21.15.82:0/4139779876 wait complete. 2023-10-06T03:15:58.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7f8ae8ff9700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ad8067000 0x7f8ad80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.614+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c0cc0c0 con 0x7fb63c0cc480 2023-10-06T03:15:58.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.614+0000 7f8ae8ff9700 1 -- 172.21.15.82:0/69498100 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ae4085140 con 0x7f8aec098390 2023-10-06T03:15:58.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7fd62e2a5700 1 -- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6280b2d10 msgr2=0x7fd6280a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7fd62e2a5700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6280b2d10 0x7fd6280a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7fd62e2a5700 1 -- 172.21.15.82:0/760457632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280ae160 msgr2=0x7fd6280b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7fd62e2a5700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280ae160 0x7fd6280b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.614+0000 7f8af0ddc700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ad8067000 0x7f8ad80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.612+0000 7fd62e2a5700 1 -- 172.21.15.82:0/760457632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240094f0 con 0x7fd6280c8d40 2023-10-06T03:15:58.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.613+0000 7fd62e2a5700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6280c8d40 0x7fd62806a010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c840 tx=0x7fd620002660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.614+0000 7f9ed621d700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9eb4066fb0 0x7f9eb4069460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc006d40 tx=0x7f9ecc009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.614+0000 7f9132db1700 1 -- 172.21.15.82:0/1726460571 wait complete. 2023-10-06T03:15:58.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.614+0000 7fdfa3fff700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf90067000 0x7fdf900694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00e260 tx=0x7fdf9c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.614+0000 7fb8f3fff700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb8e0067000 0x7fb8e00694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80093f0 tx=0x7fb8e8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.614+0000 7f8af0ddc700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ad8067000 0x7f8ad80694b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0006c80 tx=0x7f8ae0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.615+0000 7f21207ec700 1 Processor -- start 2023-10-06T03:15:58.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.615+0000 7f21207ec700 1 -- start start 2023-10-06T03:15:58.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.615+0000 7f9132db1700 1 Processor -- start 2023-10-06T03:15:58.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.615+0000 7f9132db1700 1 -- start start 2023-10-06T03:15:58.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.615+0000 7f21207ec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180af040 0x7f2118152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f21207ec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2118159fa0 0x7f2118155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f21207ec700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f211816a5d0 0x7f21181561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f21207ec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118152e40 con 0x7f21180af040 2023-10-06T03:15:58.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f21207ec700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118096b90 con 0x7f2118159fa0 2023-10-06T03:15:58.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f21207ec700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2118096e70 con 0x7f211816a5d0 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9132db1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c06f270 0x7f912c1654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9132db1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f912c13fb10 0x7f912c0c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9132db1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f912c13fee0 0x7f912c0c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9132db1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0b2270 con 0x7f912c06f270 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9132db1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0c4ce0 con 0x7f912c13fb10 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9132db1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0b1660 con 0x7f912c13fee0 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c06f270 0x7f912c1654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c06f270 0x7f912c1654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43728/0 (socket says 172.21.15.82:43728) 2023-10-06T03:15:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 -- 172.21.15.82:0/2878341871 learned_addr learned my addr 172.21.15.82:0/2878341871 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180af040 0x7f2118152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180af040 0x7f2118152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43712/0 (socket says 172.21.15.82:43712) 2023-10-06T03:15:58.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211dd87700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2118159fa0 0x7f2118155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 -- 172.21.15.82:0/1524361545 learned_addr learned my addr 172.21.15.82:0/1524361545 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:15:58.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211ed89700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f211816a5d0 0x7f21181561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9123fff700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f912c13fb10 0x7f912c0c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f913134e700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f912c13fee0 0x7f912c0c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 -- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f211816a5d0 msgr2=0x7f21181561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f211816a5d0 0x7f21181561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 -- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2118159fa0 msgr2=0x7f2118155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2118159fa0 0x7f2118155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 -- 172.21.15.82:0/1524361545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110009ae0 con 0x7f21180af040 2023-10-06T03:15:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 -- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f912c13fee0 msgr2=0x7f912c0c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f912c13fee0 0x7f912c0c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 -- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f912c13fb10 msgr2=0x7f912c0c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f912c13fb10 0x7f912c0c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 -- 172.21.15.82:0/2878341871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91140094f0 con 0x7f912c06f270 2023-10-06T03:15:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9123fff700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f912c13fb10 0x7f912c0c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:15:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f211e588700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180af040 0x7f2118152900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f211400b590 tx=0x7f2114006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.616+0000 7f9130b4d700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c06f270 0x7f912c1654d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f911c00cb10 tx=0x7f911c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.617+0000 7fd61dffb700 1 -- 172.21.15.82:0/760457632 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620012630 con 0x7fd6280c8d40 2023-10-06T03:15:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.617+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd628177030 con 0x7fd6280c8d40 2023-10-06T03:15:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.617+0000 7fb8f0ff9700 1 -- 172.21.15.82:0/3904534124 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8e40520e0 con 0x7fb8f4069120 2023-10-06T03:15:58.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.617+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd628155e40 con 0x7fd6280c8d40 2023-10-06T03:15:58.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7f9ec67fc700 1 -- 172.21.15.82:0/2981808963 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ec0089060 con 0x7f9ed015bc70 2023-10-06T03:15:58.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7f91297fa700 1 -- 172.21.15.82:0/2878341871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00ce20 con 0x7f912c06f270 2023-10-06T03:15:58.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912c0b1940 con 0x7f912c06f270 2023-10-06T03:15:58.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c0b1f00 con 0x7f912c06f270 2023-10-06T03:15:58.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6281777f0 con 0x7fd6280c8d40 2023-10-06T03:15:58.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7fdf8bfff700 1 -- 172.21.15.82:0/4113818464 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf98052d00 con 0x7fdfa406f270 2023-10-06T03:15:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.619+0000 7f91297fa700 1 -- 172.21.15.82:0/2878341871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c00a7e0 con 0x7f912c06f270 2023-10-06T03:15:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.619+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912c064050 con 0x7f912c06f270 2023-10-06T03:15:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.619+0000 7f91297fa700 1 -- 172.21.15.82:0/2878341871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00aba0 con 0x7f912c06f270 2023-10-06T03:15:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.620+0000 7f91297fa700 1 -- 172.21.15.82:0/2878341871 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f911c003030 con 0x7f912c06f270 2023-10-06T03:15:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.620+0000 7f91297fa700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f910c066f30 0x7f910c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.620+0000 7f91297fa700 1 -- 172.21.15.82:0/2878341871 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f911c084620 con 0x7f912c06f270 2023-10-06T03:15:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.620+0000 7f9123fff700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f910c066f30 0x7f910c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.621+0000 7f9123fff700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f910c066f30 0x7f910c0693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f91140099b0 tx=0x7f9114017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.621+0000 7fd61dffb700 1 -- 172.21.15.82:0/760457632 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6200129a0 con 0x7fd6280c8d40 2023-10-06T03:15:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.621+0000 7fd61dffb700 1 -- 172.21.15.82:0/760457632 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620012b30 con 0x7fd6280c8d40 2023-10-06T03:15:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.621+0000 7fb6327fc700 1 -- 172.21.15.82:0/412101586 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb638017020 con 0x7fb63c0cc480 2023-10-06T03:15:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.623+0000 7fd61dffb700 1 -- 172.21.15.82:0/760457632 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd620012c90 con 0x7fd6280c8d40 2023-10-06T03:15:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.623+0000 7f8ae8ff9700 1 -- 172.21.15.82:0/69498100 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ae40522d0 con 0x7f8aec098390 2023-10-06T03:15:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.623+0000 7fd61dffb700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd60c066f30 0x7fd60c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.623+0000 7fd61dffb700 1 -- 172.21.15.82:0/760457632 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd620084d80 con 0x7fd6280c8d40 2023-10-06T03:15:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.623+0000 7fd62daa4700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd60c066f30 0x7fd60c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.624+0000 7fd62daa4700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd60c066f30 0x7fd60c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd618009b80 tx=0x7fd6180091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.626+0000 7fd61dffb700 1 -- 172.21.15.82:0/760457632 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd620051df0 con 0x7fd6280c8d40 2023-10-06T03:15:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7f210e7fc700 1 -- 172.21.15.82:0/1524361545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400f510 con 0x7f21180af040 2023-10-06T03:15:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2118097150 con 0x7f21180af040 2023-10-06T03:15:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.618+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2118097710 con 0x7f21180af040 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.619+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2118152fb0 con 0x7f21180af040 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.620+0000 7f210e7fc700 1 -- 172.21.15.82:0/1524361545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211400f670 con 0x7f21180af040 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.620+0000 7f210e7fc700 1 -- 172.21.15.82:0/1524361545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400fa30 con 0x7f21180af040 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.620+0000 7f210e7fc700 1 -- 172.21.15.82:0/1524361545 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2114024430 con 0x7f21180af040 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.621+0000 7f210e7fc700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20fc066f30 0x7f20fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.621+0000 7f210e7fc700 1 -- 172.21.15.82:0/1524361545 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2114084900 con 0x7f21180af040 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.621+0000 7f211dd87700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20fc066f30 0x7f20fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.625+0000 7f210e7fc700 1 -- 172.21.15.82:0/1524361545 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2114051c20 con 0x7f21180af040 2023-10-06T03:15:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.628+0000 7f211dd87700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20fc066f30 0x7f20fc0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2110009880 tx=0x7f2110017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:15:58.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:58.629+0000 7f91297fa700 1 -- 172.21.15.82:0/2878341871 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f911c051730 con 0x7f912c06f270 2023-10-06T03:15:59.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.005+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdf84005830 con 0x7fdfa406f270 2023-10-06T03:15:59.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.006+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb8d4005830 con 0x7fb8f4069120 2023-10-06T03:15:59.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.006+0000 7fdf8bfff700 1 -- 172.21.15.82:0/4113818464 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf98009350 con 0x7fdfa406f270 2023-10-06T03:15:59.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.007+0000 7fb8f0ff9700 1 -- 172.21.15.82:0/3904534124 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8e4055700 con 0x7fb8f4069120 2023-10-06T03:15:59.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.007+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb63c064050 con 0x7fb63c0cc480 2023-10-06T03:15:59.009 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:15:59.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.008+0000 7fb6327fc700 1 -- 172.21.15.82:0/412101586 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb638050c10 con 0x7fb63c0cc480 2023-10-06T03:15:59.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.008+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ed00adf30 con 0x7f9ed015bc70 2023-10-06T03:15:59.010 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2023-10-06T03:15:59.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.010+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf90067000 msgr2=0x7fdf900694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.010+0000 7fdfaa833700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf90067000 0x7fdf900694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00e260 tx=0x7fdf9c00b040 comp rx=0 tx=0).stop 2023-10-06T03:15:59.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.010+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa406f270 msgr2=0x7fdfa40c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.010+0000 7fdfaa833700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa406f270 0x7fdfa40c5750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009930 tx=0x7fdf98017000 comp rx=0 tx=0).stop 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb620067000 msgr2=0x7fb6200694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb620067000 0x7fb6200694b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0b1070 tx=0x7fb62c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c0cc480 msgr2=0x7fb63c147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c0cc480 0x7fb63c147c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c580 tx=0x7fb638007d50 comp rx=0 tx=0).stop 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 shutdown_connections 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb620067000 0x7fb6200694b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb63c15f160 0x7fb63c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb63c0cc480 0x7fb63c147c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 --2- 172.21.15.82:0/412101586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb63c15bc70 0x7fb63c0ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 >> 172.21.15.82:0/412101586 conn(0x7fb63c06e910 msgr2=0x7fb63c160d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:59.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 shutdown_connections 2023-10-06T03:15:59.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.011+0000 7fb64460b700 1 -- 172.21.15.82:0/412101586 wait complete. 2023-10-06T03:15:59.015 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-10-06T03:15:59.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb8e0067000 msgr2=0x7fb8e00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb8e0067000 0x7fb8e00694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80093f0 tx=0x7fb8e8017000 comp rx=0 tx=0).stop 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f4069120 msgr2=0x7fb8f4162990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f4069120 0x7fb8f4162990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400ea50 tx=0x7fb8e4009250 comp rx=0 tx=0).stop 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 shutdown_connections 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8f40afe00 0x7fb8f40cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f4069120 0x7fb8f4162990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb8e0067000 0x7fb8e00694b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 --2- 172.21.15.82:0/3904534124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40694f0 0x7fb8f40cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 >> 172.21.15.82:0/3904534124 conn(0x7fb8f406e910 msgr2=0x7fb8f40c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 shutdown_connections 2023-10-06T03:15:59.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7fb8fad51700 1 -- 172.21.15.82:0/3904534124 wait complete. 2023-10-06T03:15:59.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7f9ec67fc700 1 -- 172.21.15.82:0/2981808963 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ec0054d50 con 0x7f9ed015bc70 2023-10-06T03:15:59.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2118152f80 con 0x7f21180af040 2023-10-06T03:15:59.018 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:15:59.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.015+0000 7f210e7fc700 1 -- 172.21.15.82:0/1524361545 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2114055240 con 0x7f21180af040 2023-10-06T03:15:59.019 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20fc066f30 msgr2=0x7f20fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20fc066f30 0x7f20fc0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2110009880 tx=0x7f2110017000 comp rx=0 tx=0).stop 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180af040 msgr2=0x7f2118152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180af040 0x7f2118152900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f211400b590 tx=0x7f2114006f90 comp rx=0 tx=0).stop 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 shutdown_connections 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20fc066f30 0x7f20fc0693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f211816a5d0 0x7f21181561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180af040 0x7f2118152900 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 --2- 172.21.15.82:0/1524361545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2118159fa0 0x7f2118155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 >> 172.21.15.82:0/1524361545 conn(0x7f2118068b90 msgr2=0x7f2118158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:59.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9eb4066fb0 msgr2=0x7f9eb4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f9ed8481700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9eb4066fb0 0x7f9eb4069460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc006d40 tx=0x7f9ecc009250 comp rx=0 tx=0).stop 2023-10-06T03:15:59.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed015bc70 msgr2=0x7f9ed015ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.018+0000 7f9ed8481700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed015bc70 0x7f9ed015ad10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000d860 tx=0x7f9ec0008040 comp rx=0 tx=0).stop 2023-10-06T03:15:59.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.019+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 shutdown_connections 2023-10-06T03:15:59.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.019+0000 7f9ed8481700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9eb4066fb0 0x7f9eb4069460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.019+0000 7f9ed8481700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ed015f160 0x7f9ed006aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.019+0000 7f9ed8481700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed00cc480 0x7f9ed00a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.019+0000 7f9ed8481700 1 --2- 172.21.15.82:0/2981808963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed015bc70 0x7f9ed015ad10 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000d860 tx=0x7f9ec0008040 comp rx=0 tx=0).stop 2023-10-06T03:15:59.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.019+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 >> 172.21.15.82:0/2981808963 conn(0x7f9ed006e910 msgr2=0x7f9ed0067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:59.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 shutdown_connections 2023-10-06T03:15:59.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 shutdown_connections 2023-10-06T03:15:59.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7f9ed8481700 1 -- 172.21.15.82:0/2981808963 wait complete. 2023-10-06T03:15:59.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7f21207ec700 1 -- 172.21.15.82:0/1524361545 wait complete. 2023-10-06T03:15:59.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 shutdown_connections 2023-10-06T03:15:59.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7fdfaa833700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40c7f00 0x7fdfa4158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7fdfaa833700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa406b470 0x7fdfa4157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7fdfaa833700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf90067000 0x7fdf900694b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7fdfaa833700 1 --2- 172.21.15.82:0/4113818464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa406f270 0x7fdfa40c5750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 >> 172.21.15.82:0/4113818464 conn(0x7fdfa406e760 msgr2=0x7fdfa40cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:59.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 shutdown_connections 2023-10-06T03:15:59.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7fdfaa833700 1 -- 172.21.15.82:0/4113818464 wait complete. 2023-10-06T03:15:59.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.020+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8aec06efb0 con 0x7f8aec098390 2023-10-06T03:15:59.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.021+0000 7f8ae8ff9700 1 -- 172.21.15.82:0/69498100 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8aec06efb0 con 0x7f8aec098390 2023-10-06T03:15:59.025 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-10-06T03:15:59.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.021+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd628064050 con 0x7fd6280c8d40 2023-10-06T03:15:59.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ad8067000 msgr2=0x7f8ad80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ad8067000 0x7f8ad80694b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0006c80 tx=0x7f8ae0008040 comp rx=0 tx=0).stop 2023-10-06T03:15:59.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec098390 msgr2=0x7f8aec16e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec098390 0x7f8aec16e080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40032e0 tx=0x7f8ae4007cf0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f912c0c4f30 con 0x7f912c06f270 2023-10-06T03:15:59.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 shutdown_connections 2023-10-06T03:15:59.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8aec0991b0 0x7f8aec096a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad40051c0 0x7f8aec0aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ad8067000 0x7f8ad80694b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 --2- 172.21.15.82:0/69498100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8aec098390 0x7f8aec16e080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.024+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 >> 172.21.15.82:0/69498100 conn(0x7f8aec0680b0 msgr2=0x7f8aec15ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:59.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.025+0000 7fd61dffb700 1 -- 172.21.15.82:0/760457632 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd620016090 con 0x7fd6280c8d40 2023-10-06T03:15:59.028 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:15:59.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.028+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 shutdown_connections 2023-10-06T03:15:59.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.028+0000 7f8af3040700 1 -- 172.21.15.82:0/69498100 wait complete. 2023-10-06T03:15:59.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.029+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd60c066f30 msgr2=0x7fd60c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.029+0000 7fd62fd08700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd60c066f30 0x7fd60c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd618009b80 tx=0x7fd6180091a0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.029+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6280c8d40 msgr2=0x7fd62806a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.029+0000 7fd62fd08700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6280c8d40 0x7fd62806a010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c840 tx=0x7fd620002660 comp rx=0 tx=0).stop 2023-10-06T03:15:59.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.030+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 shutdown_connections 2023-10-06T03:15:59.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.030+0000 7fd62fd08700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6280c8d40 0x7fd62806a010 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.030+0000 7fd62fd08700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280ae160 0x7fd6280b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.030+0000 7fd62fd08700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd60c066f30 0x7fd60c0693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.030+0000 7fd62fd08700 1 --2- 172.21.15.82:0/760457632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6280b2d10 0x7fd6280a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.030+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 >> 172.21.15.82:0/760457632 conn(0x7fd62806e760 msgr2=0x7fd628156890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:59.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-06T03:15:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.033+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 shutdown_connections 2023-10-06T03:15:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.033+0000 7fd62fd08700 1 -- 172.21.15.82:0/760457632 wait complete. 2023-10-06T03:15:59.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.037+0000 7f91297fa700 1 -- 172.21.15.82:0/2878341871 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f911c054d50 con 0x7f912c06f270 2023-10-06T03:15:59.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-10-06T03:15:59.042 INFO:teuthology.orchestra.run.smithi082.stdout:55834574851 2023-10-06T03:15:59.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-10-06T03:15:59.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f910c066f30 msgr2=0x7f910c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f910c066f30 0x7f910c0693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f91140099b0 tx=0x7f9114017000 comp rx=0 tx=0).stop 2023-10-06T03:15:59.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c06f270 msgr2=0x7f912c1654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:15:59.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c06f270 0x7f912c1654d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f911c00cb10 tx=0x7f911c0017b0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 shutdown_connections 2023-10-06T03:15:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f910c066f30 0x7f910c0693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f912c13fee0 0x7f912c0c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c06f270 0x7f912c1654d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 --2- 172.21.15.82:0/2878341871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f912c13fb10 0x7f912c0c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:15:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 >> 172.21.15.82:0/2878341871 conn(0x7f912c06e760 msgr2=0x7f912c0c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:15:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 shutdown_connections 2023-10-06T03:15:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:15:59.044+0000 7f9132db1700 1 -- 172.21.15.82:0/2878341871 wait complete. 2023-10-06T03:15:59.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-06T03:15:59.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-10-06T03:15:59.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-10-06T03:15:59.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-06T03:15:59.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2023-10-06T03:16:00.035 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:16:00.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:16:00.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:16:00.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:16:00.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:16:00.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:16:00.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:16:00.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:16:00.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.224+0000 7ff133976700 1 Processor -- start 2023-10-06T03:16:00.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.224+0000 7ff133976700 1 -- start start 2023-10-06T03:16:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff133976700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff133976700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff12c15df30 0x7ff12c06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff133976700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c0b1d90 con 0x7ff12c0af040 2023-10-06T03:16:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff133976700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c0afb50 con 0x7ff12c15df30 2023-10-06T03:16:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff133976700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0b1460 con 0x7ff12c15db60 2023-10-06T03:16:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff131712700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff131712700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c06abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42438/0 (socket says 172.21.15.82:42438) 2023-10-06T03:16:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff131712700 1 -- 172.21.15.82:0/832671738 learned_addr learned my addr 172.21.15.82:0/832671738 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.226+0000 7ff130f11700 1 --2- 172.21.15.82:0/832671738 >> v2:172.21.15.82:3300/0 conn(0x7ff12c15df30 0x7ff12c06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.227+0000 7ff131712700 1 -- 172.21.15.82:0/832671738 >> v2:172.21.15.82:3300/0 conn(0x7ff12c15df30 msgr2=0x7ff12c06b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.227+0000 7ff131712700 1 --2- 172.21.15.82:0/832671738 >> v2:172.21.15.82:3300/0 conn(0x7ff12c15df30 0x7ff12c06b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.227+0000 7ff131712700 1 -- 172.21.15.82:0/832671738 >> v1:172.21.15.82:6789/0 conn(0x7ff12c0af040 legacy=0x7ff12c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.227+0000 7ff131712700 1 -- 172.21.15.82:0/832671738 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c0b1740 con 0x7ff12c15db60 2023-10-06T03:16:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.227+0000 7ff131712700 1 --2- 172.21.15.82:0/832671738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c06abd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff124009f70 tx=0x7ff124009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90cfe4a33e1a21d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.227+0000 7ff123fff700 1 -- 172.21.15.82:0/832671738 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400e070 con 0x7ff12c15db60 2023-10-06T03:16:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.227+0000 7ff123fff700 1 -- 172.21.15.82:0/832671738 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12400b9e0 con 0x7ff12c15db60 2023-10-06T03:16:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.227+0000 7ff123fff700 1 -- 172.21.15.82:0/832671738 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240092e0 con 0x7ff12c15db60 2023-10-06T03:16:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.228+0000 7ff133976700 1 -- 172.21.15.82:0/832671738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 msgr2=0x7ff12c06abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.228+0000 7ff133976700 1 --2- 172.21.15.82:0/832671738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c06abd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff124009f70 tx=0x7ff124009840 comp rx=0 tx=0).stop 2023-10-06T03:16:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.229+0000 7ff133976700 1 -- 172.21.15.82:0/832671738 shutdown_connections 2023-10-06T03:16:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.229+0000 7ff133976700 1 --2- 172.21.15.82:0/832671738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c06abd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.229+0000 7ff133976700 1 --2- 172.21.15.82:0/832671738 >> v2:172.21.15.82:3300/0 conn(0x7ff12c15df30 0x7ff12c06b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.229+0000 7ff133976700 1 -- 172.21.15.82:0/832671738 >> 172.21.15.82:0/832671738 conn(0x7ff12c068b90 msgr2=0x7ff12c0694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.229+0000 7ff133976700 1 -- 172.21.15.82:0/832671738 shutdown_connections 2023-10-06T03:16:00.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.229+0000 7ff133976700 1 -- 172.21.15.82:0/832671738 wait complete. 2023-10-06T03:16:00.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.231+0000 7ff133976700 1 Processor -- start 2023-10-06T03:16:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.231+0000 7ff133976700 1 -- start start 2023-10-06T03:16:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.232+0000 7ff133976700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c0af040 0x7ff12c1716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.232+0000 7ff133976700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c0a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.232+0000 7ff133976700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12c15df30 0x7ff12c0a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.232+0000 7ff133976700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c098bb0 con 0x7ff12c0af040 2023-10-06T03:16:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.232+0000 7ff133976700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c097fa0 con 0x7ff12c15df30 2023-10-06T03:16:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.232+0000 7ff133976700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c098280 con 0x7ff12c15db60 2023-10-06T03:16:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.233+0000 7ff131712700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c0af040 0x7ff12c1716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.233+0000 7ff131712700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c0af040 0x7ff12c1716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43752/0 (socket says 172.21.15.82:43752) 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.233+0000 7ff131712700 1 -- 172.21.15.82:0/3403656440 learned_addr learned my addr 172.21.15.82:0/3403656440 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.233+0000 7ff131f13700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12c15df30 0x7ff12c0a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.234+0000 7ff131712700 1 -- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 msgr2=0x7ff12c0a54f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.234+0000 7ff131712700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c0a54f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.234+0000 7ff131712700 1 -- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12c15df30 msgr2=0x7ff12c0a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.234+0000 7ff131712700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12c15df30 0x7ff12c0a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.234+0000 7ff131712700 1 -- 172.21.15.82:0/3403656440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009ae0 con 0x7ff12c0af040 2023-10-06T03:16:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.234+0000 7ff131712700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c0af040 0x7ff12c1716a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0cc160 tx=0x7ff124017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.235+0000 7ff1217fa700 1 -- 172.21.15.82:0/3403656440 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124012b80 con 0x7ff12c0af040 2023-10-06T03:16:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.235+0000 7ff1217fa700 1 -- 172.21.15.82:0/3403656440 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff124012ce0 con 0x7ff12c0af040 2023-10-06T03:16:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.235+0000 7ff1217fa700 1 -- 172.21.15.82:0/3403656440 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12401d670 con 0x7ff12c0af040 2023-10-06T03:16:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.235+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c098560 con 0x7ff12c0af040 2023-10-06T03:16:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.235+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c171be0 con 0x7ff12c0af040 2023-10-06T03:16:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.238+0000 7ff1217fa700 1 -- 172.21.15.82:0/3403656440 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff12401da20 con 0x7ff12c0af040 2023-10-06T03:16:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.239+0000 7ff1217fa700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff1180671e0 0x7ff118069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.239+0000 7ff1217fa700 1 -- 172.21.15.82:0/3403656440 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff124085f40 con 0x7ff12c0af040 2023-10-06T03:16:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.240+0000 7ff130f11700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff1180671e0 0x7ff118069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.241+0000 7ff130f11700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff1180671e0 0x7ff118069690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0ab8e0 tx=0x7ff11c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.245+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1080052b0 con 0x7ff12c0af040 2023-10-06T03:16:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.254+0000 7ff1217fa700 1 -- 172.21.15.82:0/3403656440 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff124053030 con 0x7ff12c0af040 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.261+0000 7f45cfb9f700 1 Processor -- start 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.261+0000 7f45cfb9f700 1 -- start start 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cfb9f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806ae20 0x7f45c80b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cfb9f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f45c806b1f0 0x7f45c80ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cfb9f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c80b1650 con 0x7f45c80acd70 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cfb9f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c80abbe0 con 0x7f45c806b1f0 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cfb9f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80aebe0 con 0x7f45c806ae20 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cd93b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806ae20 0x7f45c80b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cd13a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f45c806b1f0 0x7f45c80ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cd93b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806ae20 0x7f45c80b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42442/0 (socket says 172.21.15.82:42442) 2023-10-06T03:16:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cd93b700 1 -- 172.21.15.82:0/717709188 learned_addr learned my addr 172.21.15.82:0/717709188 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.263+0000 7f45cc939700 1 -- 172.21.15.82:0/717709188 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359001737 0 0) 0x7f45c80b1650 con 0x7f45c80acd70 2023-10-06T03:16:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.265+0000 7f45cc939700 1 -- 172.21.15.82:0/717709188 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b4003570 con 0x7f45c80acd70 2023-10-06T03:16:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.265+0000 7f45cd13a700 1 -- 172.21.15.82:0/717709188 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806ae20 msgr2=0x7f45c80b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.265+0000 7f45cd13a700 1 --2- 172.21.15.82:0/717709188 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806ae20 0x7f45c80b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.265+0000 7f45cd13a700 1 -- 172.21.15.82:0/717709188 >> v1:172.21.15.82:6789/0 conn(0x7f45c80acd70 legacy=0x7f45c80ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.265+0000 7f45cc939700 1 -- 172.21.15.82:0/717709188 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 775060755 0 0) 0x7f45b4003570 con 0x7f45c80acd70 2023-10-06T03:16:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.265+0000 7f45cd13a700 1 -- 172.21.15.82:0/717709188 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c80b1880 con 0x7f45c806b1f0 2023-10-06T03:16:00.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.266+0000 7f45cd13a700 1 --2- 172.21.15.82:0/717709188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806b1f0 0x7f45c80ae6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f45c40077d0 tx=0x7f45c4007200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2618c17fae8e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.266+0000 7f45cd93b700 1 --2- 172.21.15.82:0/717709188 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806ae20 0x7f45c80b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:00.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.266+0000 7f45cc939700 1 -- 172.21.15.82:0/717709188 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400c970 con 0x7f45c806b1f0 2023-10-06T03:16:00.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.266+0000 7f45cc939700 1 -- 172.21.15.82:0/717709188 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c400cad0 con 0x7f45c806b1f0 2023-10-06T03:16:00.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.266+0000 7f45cc939700 1 -- 172.21.15.82:0/717709188 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400ce50 con 0x7f45c806b1f0 2023-10-06T03:16:00.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.267+0000 7f45cfb9f700 1 -- 172.21.15.82:0/717709188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806b1f0 msgr2=0x7f45c80ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.267+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/717709188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806b1f0 0x7f45c80ae6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f45c40077d0 tx=0x7f45c4007200 comp rx=0 tx=0).stop 2023-10-06T03:16:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.268+0000 7f45cfb9f700 1 -- 172.21.15.82:0/717709188 shutdown_connections 2023-10-06T03:16:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.268+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/717709188 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806ae20 0x7f45c80b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.268+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/717709188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806b1f0 0x7f45c80ae6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.268+0000 7f45cfb9f700 1 -- 172.21.15.82:0/717709188 >> 172.21.15.82:0/717709188 conn(0x7f45c8068b90 msgr2=0x7f45c80694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.271+0000 7f45cfb9f700 1 -- 172.21.15.82:0/717709188 shutdown_connections 2023-10-06T03:16:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.273+0000 7f45cfb9f700 1 -- 172.21.15.82:0/717709188 wait complete. 2023-10-06T03:16:00.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.274+0000 7f45cfb9f700 1 Processor -- start 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.274+0000 7f45cfb9f700 1 -- start start 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45cfb9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806ae20 0x7f45c80c1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45cfb9f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806b1f0 0x7f45c816c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45cfb9f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c80acd70 0x7f45c816c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45cfb9f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80c93b0 con 0x7f45c80acd70 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45cfb9f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80c95c0 con 0x7f45c806ae20 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45cfb9f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c80c98a0 con 0x7f45c806b1f0 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45ce13c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c80acd70 0x7f45c816c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45ce13c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c80acd70 0x7f45c816c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43760/0 (socket says 172.21.15.82:43760) 2023-10-06T03:16:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45ce13c700 1 -- 172.21.15.82:0/1205137891 learned_addr learned my addr 172.21.15.82:0/1205137891 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45cd93b700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806ae20 0x7f45c80c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.276+0000 7f45cd13a700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806b1f0 0x7f45c816c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45ce13c700 1 -- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806b1f0 msgr2=0x7f45c816c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45ce13c700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806b1f0 0x7f45c816c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45ce13c700 1 -- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806ae20 msgr2=0x7f45c80c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45ce13c700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806ae20 0x7f45c80c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45ce13c700 1 -- 172.21.15.82:0/1205137891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c400d040 con 0x7f45c80acd70 2023-10-06T03:16:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f4ab7097700 1 Processor -- start 2023-10-06T03:16:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45ce13c700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c80acd70 0x7f45c816c970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45b800b5e0 tx=0x7f45b8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45bdffb700 1 -- 172.21.15.82:0/1205137891 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b80105b0 con 0x7f45c80acd70 2023-10-06T03:16:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45bdffb700 1 -- 172.21.15.82:0/1205137891 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8010730 con 0x7f45c80acd70 2023-10-06T03:16:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f45bdffb700 1 -- 172.21.15.82:0/1205137891 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8010af0 con 0x7f45c80acd70 2023-10-06T03:16:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c80c9b80 con 0x7f45c80acd70 2023-10-06T03:16:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c80ca140 con 0x7f45c80acd70 2023-10-06T03:16:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.277+0000 7f4ab7097700 1 -- start start 2023-10-06T03:16:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4ab7097700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ab00ab3b0 0x7f4ab0156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4ab7097700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4ab00cbd50 0x7f4ab0156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4ab7097700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab00adf70 con 0x7f4ab00cb980 2023-10-06T03:16:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4ab7097700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab00b0e00 con 0x7f4ab00ab3b0 2023-10-06T03:16:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4ab7097700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab00ad360 con 0x7f4ab00cbd50 2023-10-06T03:16:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4aaffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ab00ab3b0 0x7f4ab0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4aaffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ab00ab3b0 0x7f4ab0156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43766/0 (socket says 172.21.15.82:43766) 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4aaffff700 1 -- 172.21.15.82:0/61669242 learned_addr learned my addr 172.21.15.82:0/61669242 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4aaffff700 1 -- 172.21.15.82:0/61669242 >> v2:172.21.15.134:3300/0 conn(0x7f4ab00cbd50 msgr2=0x7f4ab0156760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4aaffff700 1 --2- 172.21.15.82:0/61669242 >> v2:172.21.15.134:3300/0 conn(0x7f4ab00cbd50 0x7f4ab0156760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.278+0000 7f4aaffff700 1 -- 172.21.15.82:0/61669242 >> v1:172.21.15.82:6789/0 conn(0x7f4ab00cb980 legacy=0x7f4ab00ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.279+0000 7f4aaffff700 1 -- 172.21.15.82:0/61669242 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00ad640 con 0x7f4ab00ab3b0 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.279+0000 7f4aaffff700 1 --2- 172.21.15.82:0/61669242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00ab3b0 0x7f4ab0156220 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0064eb0 tx=0x7f4aa800c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfff79507b12d45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.279+0000 7f4aaf7fe700 1 -- 172.21.15.82:0/61669242 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800bb90 con 0x7f4ab00ab3b0 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.279+0000 7f4aaf7fe700 1 -- 172.21.15.82:0/61669242 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa800bcf0 con 0x7f4ab00ab3b0 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.279+0000 7f4aaf7fe700 1 -- 172.21.15.82:0/61669242 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800c0b0 con 0x7f4ab00ab3b0 2023-10-06T03:16:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.280+0000 7f45bdffb700 1 -- 172.21.15.82:0/1205137891 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45b801b460 con 0x7f45c80acd70 2023-10-06T03:16:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.280+0000 7f4ab7097700 1 -- 172.21.15.82:0/61669242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00ab3b0 msgr2=0x7f4ab0156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.280+0000 7f4ab7097700 1 --2- 172.21.15.82:0/61669242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00ab3b0 0x7f4ab0156220 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0064eb0 tx=0x7f4aa800c3c0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.280+0000 7f45bdffb700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.280+0000 7f45bdffb700 1 -- 172.21.15.82:0/1205137891 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f45b8084560 con 0x7f45c80acd70 2023-10-06T03:16:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.280+0000 7f45cd93b700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.281+0000 7f45cd93b700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45ac066f30 0x7f45ac0693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45c0007fd0 tx=0x7f45c000c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.281+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c8087510 con 0x7f45c80acd70 2023-10-06T03:16:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.283+0000 7efeeda91700 1 Processor -- start 2023-10-06T03:16:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.283+0000 7efeeda91700 1 -- start start 2023-10-06T03:16:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.284+0000 7efeeda91700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efee80ab220 0x7efee815a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.284+0000 7efeeda91700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee8157250 con 0x7efee80c7930 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.284+0000 7efeeda91700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee8156980 con 0x7efee81576e0 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.284+0000 7efeeda91700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee815ae80 con 0x7efee80ab220 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee77fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efee80c7930 0x7efee80c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53916/0 (socket says 172.21.15.82:53916) 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee77fe700 1 -- 172.21.15.82:0/3587323910 learned_addr learned my addr 172.21.15.82:0/3587323910 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee6ffd700 1 --2- 172.21.15.82:0/3587323910 >> v2:172.21.15.134:3300/0 conn(0x7efee80ab220 0x7efee815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee67fc700 1 -- 172.21.15.82:0/3587323910 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829759599 0 0) 0x7efee8156980 con 0x7efee81576e0 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee67fc700 1 -- 172.21.15.82:0/3587323910 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed0003570 con 0x7efee81576e0 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee6ffd700 1 -- 172.21.15.82:0/3587323910 >> v1:172.21.15.134:6789/0 conn(0x7efee81576e0 legacy=0x7efee8150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee6ffd700 1 -- 172.21.15.82:0/3587323910 >> v1:172.21.15.82:6789/0 conn(0x7efee80c7930 legacy=0x7efee80c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee6ffd700 1 -- 172.21.15.82:0/3587323910 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee80ab6e0 con 0x7efee80ab220 2023-10-06T03:16:00.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee6ffd700 1 --2- 172.21.15.82:0/3587323910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee80ab220 0x7efee815a940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efedc0098e0 tx=0x7efedc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5687d06a831e2c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.285+0000 7efee67fc700 1 -- 172.21.15.82:0/3587323910 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00b640 con 0x7efee80ab220 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.286+0000 7efee67fc700 1 -- 172.21.15.82:0/3587323910 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc00b7a0 con 0x7efee80ab220 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.286+0000 7efee67fc700 1 -- 172.21.15.82:0/3587323910 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00bb40 con 0x7efee80ab220 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.286+0000 7efeeda91700 1 -- 172.21.15.82:0/3587323910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee80ab220 msgr2=0x7efee815a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.286+0000 7efeeda91700 1 --2- 172.21.15.82:0/3587323910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee80ab220 0x7efee815a940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efedc0098e0 tx=0x7efedc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.287+0000 7efeeda91700 1 -- 172.21.15.82:0/3587323910 shutdown_connections 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.287+0000 7efeeda91700 1 --2- 172.21.15.82:0/3587323910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee80ab220 0x7efee815a940 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.287+0000 7efeeda91700 1 -- 172.21.15.82:0/3587323910 >> 172.21.15.82:0/3587323910 conn(0x7efee80c8c50 msgr2=0x7efee80c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.287+0000 7efeeda91700 1 -- 172.21.15.82:0/3587323910 shutdown_connections 2023-10-06T03:16:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.287+0000 7efeeda91700 1 -- 172.21.15.82:0/3587323910 wait complete. 2023-10-06T03:16:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.287+0000 7f45bdffb700 1 -- 172.21.15.82:0/1205137891 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45b80515d0 con 0x7f45c80acd70 2023-10-06T03:16:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.288+0000 7f4ab7097700 1 -- 172.21.15.82:0/61669242 shutdown_connections 2023-10-06T03:16:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.288+0000 7f4ab7097700 1 --2- 172.21.15.82:0/61669242 >> v2:172.21.15.134:3300/0 conn(0x7f4ab00cbd50 0x7f4ab0156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.288+0000 7f4ab7097700 1 --2- 172.21.15.82:0/61669242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00ab3b0 0x7f4ab0156220 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.288+0000 7f4ab7097700 1 -- 172.21.15.82:0/61669242 >> 172.21.15.82:0/61669242 conn(0x7f4ab0068b90 msgr2=0x7f4ab00694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.288+0000 7f7062cf4700 1 Processor -- start 2023-10-06T03:16:00.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.288+0000 7f4ab7097700 1 -- 172.21.15.82:0/61669242 shutdown_connections 2023-10-06T03:16:00.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7efeeda91700 1 Processor -- start 2023-10-06T03:16:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7efeeda91700 1 -- start start 2023-10-06T03:16:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.288+0000 7f7062cf4700 1 -- start start 2023-10-06T03:16:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f7062cf4700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f705c0ab3b0 0x7f705c156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f7062cf4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0cbd50 0x7f705c156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f7062cf4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c0adf70 con 0x7f705c0cb980 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f7062cf4700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c0b0e00 con 0x7f705c0ab3b0 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f7062cf4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0ad360 con 0x7f705c0cbd50 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f7060a90700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f705c0cb980 0x7f705c0ae400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53926/0 (socket says 172.21.15.82:53926) 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f7060a90700 1 -- 172.21.15.82:0/3676794428 learned_addr learned my addr 172.21.15.82:0/3676794428 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f7061291700 1 --2- 172.21.15.82:0/3676794428 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0cbd50 0x7f705c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f705b7fe700 1 -- 172.21.15.82:0/3676794428 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210408564 0 0) 0x7f705c0adf70 con 0x7f705c0cb980 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f7061291700 1 -- 172.21.15.82:0/3676794428 >> v2:172.21.15.134:3300/0 conn(0x7f705c0ab3b0 msgr2=0x7f705c156220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f7061291700 1 --2- 172.21.15.82:0/3676794428 >> v2:172.21.15.134:3300/0 conn(0x7f705c0ab3b0 0x7f705c156220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f7061291700 1 -- 172.21.15.82:0/3676794428 >> v1:172.21.15.82:6789/0 conn(0x7f705c0cb980 legacy=0x7f705c0ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f7061291700 1 -- 172.21.15.82:0/3676794428 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0ad640 con 0x7f705c0cbd50 2023-10-06T03:16:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efeeda91700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efee80ab220 0x7efee814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efeeda91700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efee80c7930 0x7efee80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.289+0000 7f4ab7097700 1 -- 172.21.15.82:0/61669242 wait complete. 2023-10-06T03:16:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efeeda91700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee81576e0 0x7efee80c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efeeda91700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80af5d0 con 0x7efee80ab220 2023-10-06T03:16:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efeeda91700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee8099620 con 0x7efee81576e0 2023-10-06T03:16:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efeeda91700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee8099900 con 0x7efee80c7930 2023-10-06T03:16:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efee80ab220 0x7efee814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efee80ab220 0x7efee814ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43772/0 (socket says 172.21.15.82:43772) 2023-10-06T03:16:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee77fe700 1 -- 172.21.15.82:0/1645471802 learned_addr learned my addr 172.21.15.82:0/1645471802 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f7061291700 1 --2- 172.21.15.82:0/3676794428 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0cbd50 0x7f705c156760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7054009d50 tx=0x7f7054009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f112968a361ffa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee7fff700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee81576e0 0x7efee80c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f705b7fe700 1 -- 172.21.15.82:0/3676794428 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400bb60 con 0x7f705c0cbd50 2023-10-06T03:16:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f705b7fe700 1 -- 172.21.15.82:0/3676794428 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400bcc0 con 0x7f705c0cbd50 2023-10-06T03:16:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7f705b7fe700 1 -- 172.21.15.82:0/3676794428 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540196d0 con 0x7f705c0cbd50 2023-10-06T03:16:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7f4ab7097700 1 Processor -- start 2023-10-06T03:16:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7f7062cf4700 1 -- 172.21.15.82:0/3676794428 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0cbd50 msgr2=0x7f705c156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7f7062cf4700 1 --2- 172.21.15.82:0/3676794428 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0cbd50 0x7f705c156760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7054009d50 tx=0x7f7054009780 comp rx=0 tx=0).stop 2023-10-06T03:16:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f7062cf4700 1 -- 172.21.15.82:0/3676794428 shutdown_connections 2023-10-06T03:16:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f7062cf4700 1 --2- 172.21.15.82:0/3676794428 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0cbd50 0x7f705c156760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f7062cf4700 1 --2- 172.21.15.82:0/3676794428 >> v2:172.21.15.134:3300/0 conn(0x7f705c0ab3b0 0x7f705c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f7062cf4700 1 -- 172.21.15.82:0/3676794428 >> 172.21.15.82:0/3676794428 conn(0x7f705c068b90 msgr2=0x7f705c0694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee77fe700 1 -- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efee80c7930 msgr2=0x7efee80c6820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:16:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee77fe700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efee80c7930 0x7efee80c6820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee77fe700 1 -- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee81576e0 msgr2=0x7efee80c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee77fe700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee81576e0 0x7efee80c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.290+0000 7efee77fe700 1 -- 172.21.15.82:0/1645471802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc009420 con 0x7efee80ab220 2023-10-06T03:16:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7efee77fe700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efee80ab220 0x7efee814ac50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efed800c7c0 tx=0x7efed8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7efecf7fe700 1 -- 172.21.15.82:0/1645471802 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8005b30 con 0x7efee80ab220 2023-10-06T03:16:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7efecf7fe700 1 -- 172.21.15.82:0/1645471802 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed8005c90 con 0x7efee80ab220 2023-10-06T03:16:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee80aef80 con 0x7efee80ab220 2023-10-06T03:16:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee814b190 con 0x7efee80ab220 2023-10-06T03:16:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.291+0000 7f4ab7097700 1 -- start start 2023-10-06T03:16:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7efecf7fe700 1 -- 172.21.15.82:0/1645471802 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8004a80 con 0x7efee80ab220 2023-10-06T03:16:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f4ab7097700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ab00ab3b0 0x7f4ab0153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f4ab7097700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab00cb980 0x7f4ab015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f4ab7097700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00cbd50 0x7f4ab006a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f4ab7097700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab016e260 con 0x7f4ab00cbd50 2023-10-06T03:16:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f4ab7097700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab01541a0 con 0x7f4ab00cb980 2023-10-06T03:16:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.292+0000 7f4ab7097700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab016d650 con 0x7f4ab00ab3b0 2023-10-06T03:16:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f4ab5634700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00cbd50 0x7f4ab006a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f4ab5634700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00cbd50 0x7f4ab006a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43780/0 (socket says 172.21.15.82:43780) 2023-10-06T03:16:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f4ab5634700 1 -- 172.21.15.82:0/4064024694 learned_addr learned my addr 172.21.15.82:0/4064024694 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f4ab5634700 1 -- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ab00ab3b0 msgr2=0x7f4ab0153c60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:16:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f4ab5634700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ab00ab3b0 0x7f4ab0153c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f4ab5634700 1 -- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab00cb980 msgr2=0x7f4ab015b680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:16:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f4ab5634700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab00cb980 0x7f4ab015b680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f4ab5634700 1 -- 172.21.15.82:0/4064024694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa800c600 con 0x7f4ab00cbd50 2023-10-06T03:16:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7efecf7fe700 1 -- 172.21.15.82:0/1645471802 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efed80070d0 con 0x7efee80ab220 2023-10-06T03:16:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.293+0000 7f7062cf4700 1 -- 172.21.15.82:0/3676794428 shutdown_connections 2023-10-06T03:16:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7efecf7fe700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efed406f740 0x7efed4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7efecf7fe700 1 -- 172.21.15.82:0/1645471802 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efed8083a40 con 0x7efee80ab220 2023-10-06T03:16:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7f4ab5634700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00cbd50 0x7f4ab006a9e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000b610 tx=0x7f4aa0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7f4aacff9700 1 -- 172.21.15.82:0/4064024694 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000f510 con 0x7f4ab00cbd50 2023-10-06T03:16:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7f4aacff9700 1 -- 172.21.15.82:0/4064024694 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa000f670 con 0x7f4ab00cbd50 2023-10-06T03:16:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7f4aacff9700 1 -- 172.21.15.82:0/4064024694 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000fa30 con 0x7f4ab00cbd50 2023-10-06T03:16:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab016d930 con 0x7f4ab00cbd50 2023-10-06T03:16:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab016def0 con 0x7f4ab00cbd50 2023-10-06T03:16:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.294+0000 7f7062cf4700 1 -- 172.21.15.82:0/3676794428 wait complete. 2023-10-06T03:16:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.295+0000 7f7062cf4700 1 Processor -- start 2023-10-06T03:16:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.295+0000 7fdaf8d0c700 1 Processor -- start 2023-10-06T03:16:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.295+0000 7fdaf8d0c700 1 -- start start 2023-10-06T03:16:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf8d0c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40cb980 0x7fdaf40ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf8d0c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdaf40ab3b0 0x7fdaf4156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf8d0c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40adf70 con 0x7fdaf40cbd50 2023-10-06T03:16:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf8d0c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf40b0e00 con 0x7fdaf40ab3b0 2023-10-06T03:16:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf8d0c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40ad360 con 0x7fdaf40cb980 2023-10-06T03:16:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7efee6ffd700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efed406f740 0x7efed4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f4aacff9700 1 -- 172.21.15.82:0/4064024694 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4aa001a400 con 0x7f4ab00cbd50 2023-10-06T03:16:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf259c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40cb980 0x7fdaf40ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf259c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40cb980 0x7fdaf40ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42492/0 (socket says 172.21.15.82:42492) 2023-10-06T03:16:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf259c700 1 -- 172.21.15.82:0/1162454991 learned_addr learned my addr 172.21.15.82:0/1162454991 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f4aacff9700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a9c066f30 0x7f4a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7fdaf1d9b700 1 --2- 172.21.15.82:0/1162454991 >> v2:172.21.15.82:3300/0 conn(0x7fdaf40ab3b0 0x7fdaf4156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.296+0000 7f7062cf4700 1 -- start start 2023-10-06T03:16:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f7062cf4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0ab3b0 0x7f705c0a7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f7062cf4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f705c0cb980 0x7f705c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f7062cf4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f705c0cbd50 0x7f705c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f7062cf4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0aafb0 con 0x7f705c0cb980 2023-10-06T03:16:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f7062cf4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0c9af0 con 0x7f705c0cbd50 2023-10-06T03:16:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f7062cf4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0c9dd0 con 0x7f705c0ab3b0 2023-10-06T03:16:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f705bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f705c0cb980 0x7f705c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f705bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f705c0cb980 0x7f705c158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43798/0 (socket says 172.21.15.82:43798) 2023-10-06T03:16:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f705bfff700 1 -- 172.21.15.82:0/2463221583 learned_addr learned my addr 172.21.15.82:0/2463221583 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.297+0000 7f4aacff9700 1 -- 172.21.15.82:0/4064024694 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4aa0084060 con 0x7f4ab00cbd50 2023-10-06T03:16:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f7061291700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f705c0cbd50 0x7f705c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fbcb4ac4700 1 Processor -- start 2023-10-06T03:16:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7efee6ffd700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efed406f740 0x7efed4071bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efedc0098e0 tx=0x7efedc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f7060a90700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0ab3b0 0x7f705c0a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fdaf1d9b700 1 -- 172.21.15.82:0/1162454991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40cb980 msgr2=0x7fdaf40ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fdaf1d9b700 1 --2- 172.21.15.82:0/1162454991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40cb980 0x7fdaf40ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fdaf1d9b700 1 -- 172.21.15.82:0/1162454991 >> v1:172.21.15.134:6789/0 conn(0x7fdaf40cbd50 legacy=0x7fdaf40b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fdaf1d9b700 1 -- 172.21.15.82:0/1162454991 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40ad640 con 0x7fdaf40ab3b0 2023-10-06T03:16:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f705bfff700 1 -- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0ab3b0 msgr2=0x7f705c0a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f705bfff700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0ab3b0 0x7f705c0a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f705bfff700 1 -- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f705c0cbd50 msgr2=0x7f705c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f705bfff700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f705c0cbd50 0x7f705c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f705bfff700 1 -- 172.21.15.82:0/2463221583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705400d040 con 0x7f705c0cb980 2023-10-06T03:16:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fdaf1d9b700 1 --2- 172.21.15.82:0/1162454991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40ab3b0 0x7fdaf4156220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdae80098e0 tx=0x7fdae80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87a99032fc021ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f705bfff700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f705c0cb980 0x7f705c158ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f705000b5e0 tx=0x7f70500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fdaf159a700 1 -- 172.21.15.82:0/1162454991 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8011630 con 0x7fdaf40ab3b0 2023-10-06T03:16:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fdaf159a700 1 -- 172.21.15.82:0/1162454991 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8011790 con 0x7fdaf40ab3b0 2023-10-06T03:16:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fdaf159a700 1 -- 172.21.15.82:0/1162454991 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8011b30 con 0x7fdaf40ab3b0 2023-10-06T03:16:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f7058ff9700 1 -- 172.21.15.82:0/2463221583 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000f510 con 0x7f705c0cb980 2023-10-06T03:16:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f7058ff9700 1 -- 172.21.15.82:0/2463221583 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705000f690 con 0x7f705c0cb980 2023-10-06T03:16:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f7058ff9700 1 -- 172.21.15.82:0/2463221583 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000fa50 con 0x7f705c0cb980 2023-10-06T03:16:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c0ca0b0 con 0x7f705c0cb980 2023-10-06T03:16:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.299+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c0a7a60 con 0x7f705c0cb980 2023-10-06T03:16:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c0ca5d0 con 0x7f705c0cb980 2023-10-06T03:16:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/1162454991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40ab3b0 msgr2=0x7fdaf4156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/1162454991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40ab3b0 0x7fdaf4156220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdae80098e0 tx=0x7fdae80091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f4ab4e33700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a9c066f30 0x7f4a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7f4ab4e33700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a9c066f30 0x7f4a9c0693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009760 tx=0x7f4aa4006c70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.298+0000 7fbcb4ac4700 1 -- start start 2023-10-06T03:16:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.299+0000 7fbcb4ac4700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbcb015dad0 0x7fbcb006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.299+0000 7fbcb4ac4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006eb50 0x7fbcb00af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.299+0000 7fbcb4ac4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb00ac7f0 con 0x7fbcb015dea0 2023-10-06T03:16:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.299+0000 7fbcb4ac4700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb00afd00 con 0x7fbcb015dad0 2023-10-06T03:16:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.299+0000 7fbcb4ac4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb006efd0 con 0x7fbcb006eb50 2023-10-06T03:16:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.299+0000 7fbcadd9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbcb015dea0 0x7fbcb00af0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53930/0 (socket says 172.21.15.82:53930) 2023-10-06T03:16:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.299+0000 7fbcadd9b700 1 -- 172.21.15.82:0/2949917173 learned_addr learned my addr 172.21.15.82:0/2949917173 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/1162454991 shutdown_connections 2023-10-06T03:16:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/1162454991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40cb980 0x7fdaf40ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/1162454991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40ab3b0 0x7fdaf4156220 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/1162454991 >> 172.21.15.82:0/1162454991 conn(0x7fdaf4068b90 msgr2=0x7fdaf40694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fbcad59a700 1 -- 172.21.15.82:0/2949917173 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085196361 0 0) 0x7fbcb00ac7f0 con 0x7fbcb015dea0 2023-10-06T03:16:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fbcad59a700 1 -- 172.21.15.82:0/2949917173 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc98003570 con 0x7fbcb015dea0 2023-10-06T03:16:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/1162454991 shutdown_connections 2023-10-06T03:16:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec80052b0 con 0x7efee80ab220 2023-10-06T03:16:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.300+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/1162454991 wait complete. 2023-10-06T03:16:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.301+0000 7fbcae59c700 1 --2- 172.21.15.82:0/2949917173 >> v2:172.21.15.134:3300/0 conn(0x7fbcb015dad0 0x7fbcb006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.301+0000 7fbcaed9d700 1 --2- 172.21.15.82:0/2949917173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006eb50 0x7fbcb00af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fbcaed9d700 1 -- 172.21.15.82:0/2949917173 >> v2:172.21.15.134:3300/0 conn(0x7fbcb015dad0 msgr2=0x7fbcb006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fbcaed9d700 1 --2- 172.21.15.82:0/2949917173 >> v2:172.21.15.134:3300/0 conn(0x7fbcb015dad0 0x7fbcb006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fbcaed9d700 1 -- 172.21.15.82:0/2949917173 >> v1:172.21.15.82:6789/0 conn(0x7fbcb015dea0 legacy=0x7fbcb00af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fbcaed9d700 1 -- 172.21.15.82:0/2949917173 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00abbe0 con 0x7fbcb006eb50 2023-10-06T03:16:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fbcaed9d700 1 --2- 172.21.15.82:0/2949917173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006eb50 0x7fbcb00af7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009e60 tx=0x7fbca8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=986fbcc7bde951b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a900052b0 con 0x7f4ab00cbd50 2023-10-06T03:16:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fbcad59a700 1 -- 172.21.15.82:0/2949917173 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800e070 con 0x7fbcb006eb50 2023-10-06T03:16:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fdaf8d0c700 1 Processor -- start 2023-10-06T03:16:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fdaf8d0c700 1 -- start start 2023-10-06T03:16:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fbcad59a700 1 -- 172.21.15.82:0/2949917173 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca800bab0 con 0x7fbcb006eb50 2023-10-06T03:16:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7fbcad59a700 1 -- 172.21.15.82:0/2949917173 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800be70 con 0x7fbcb006eb50 2023-10-06T03:16:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/2949917173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006eb50 msgr2=0x7fbcb00af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/2949917173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006eb50 0x7fbcb00af7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009e60 tx=0x7fbca8009780 comp rx=0 tx=0).stop 2023-10-06T03:16:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/2949917173 shutdown_connections 2023-10-06T03:16:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/2949917173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006eb50 0x7fbcb00af7c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/2949917173 >> v2:172.21.15.134:3300/0 conn(0x7fbcb015dad0 0x7fbcb006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/2949917173 >> 172.21.15.82:0/2949917173 conn(0x7fbcb00680b0 msgr2=0x7fbcb00684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fdaf8d0c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40ab3b0 0x7fdaf414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fdaf8d0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40cb980 0x7fdaf4146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fdaf8d0c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf40cbd50 0x7fdaf406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fdaf8d0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40aaf30 con 0x7fdaf40cb980 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fdaf8d0c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40aa0c0 con 0x7fdaf40cbd50 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.303+0000 7fdaf8d0c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf406f8e0 con 0x7fdaf40ab3b0 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40cb980 0x7fdaf4146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40cb980 0x7fdaf4146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43812/0 (socket says 172.21.15.82:43812) 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 -- 172.21.15.82:0/930515279 learned_addr learned my addr 172.21.15.82:0/930515279 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf259c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40ab3b0 0x7fdaf414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf2d9d700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf40cbd50 0x7fdaf406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 -- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40ab3b0 msgr2=0x7fdaf414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40ab3b0 0x7fdaf414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 -- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf40cbd50 msgr2=0x7fdaf406e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf40cbd50 0x7fdaf406e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 -- 172.21.15.82:0/930515279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8009420 con 0x7fdaf40cb980 2023-10-06T03:16:00.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf2d9d700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf40cbd50 0x7fdaf406e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:00.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.304+0000 7fdaf1d9b700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40cb980 0x7fdaf4146e30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdae80030c0 tx=0x7fdae8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.301+0000 7f7058ff9700 1 -- 172.21.15.82:0/2463221583 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f705001a400 con 0x7f705c0cb980 2023-10-06T03:16:00.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.301+0000 7f7058ff9700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7040067000 0x7f70400694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.301+0000 7f7060a90700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0ab3b0 0x7f705c0a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:00.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.301+0000 7f7058ff9700 1 -- 172.21.15.82:0/2463221583 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7050083fa0 con 0x7f705c0cb980 2023-10-06T03:16:00.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7f7060a90700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7040067000 0x7f70400694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.302+0000 7f7060a90700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7040067000 0x7f70400694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7048001bf0 tx=0x7f7048009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.305+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/2949917173 shutdown_connections 2023-10-06T03:16:00.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.305+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/2949917173 wait complete. 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.306+0000 7fbcb4ac4700 1 Processor -- start 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.306+0000 7fbcb4ac4700 1 -- start start 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcb4ac4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb006eb50 0x7fbcb0099690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcb4ac4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb015dad0 0x7fbcb00975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcb4ac4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb015bb10 0x7fbcb015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcb4ac4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb015f740 con 0x7fbcb006eb50 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcb4ac4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb0097e30 con 0x7fbcb015dad0 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcb4ac4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb015f9e0 con 0x7fbcb015bb10 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb015bb10 0x7fbcb015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcadd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb015dad0 0x7fbcb00975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb015bb10 0x7fbcb015e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42532/0 (socket says 172.21.15.82:42532) 2023-10-06T03:16:00.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 -- 172.21.15.82:0/3048771032 learned_addr learned my addr 172.21.15.82:0/3048771032 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 -- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb015dad0 msgr2=0x7fbcb00975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb015dad0 0x7fbcb00975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 -- 172.21.15.82:0/3048771032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb006eb50 msgr2=0x7fbcb0099690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb006eb50 0x7fbcb0099690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 -- 172.21.15.82:0/3048771032 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8009a20 con 0x7fbcb015bb10 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcadd9b700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb015dad0 0x7fbcb00975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.308+0000 7fbcaed9d700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb015bb10 0x7fbcb015e2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00aedc0 tx=0x7fbca8019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.309+0000 7fbc9e7fc700 1 -- 172.21.15.82:0/3048771032 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8027470 con 0x7fbcb015bb10 2023-10-06T03:16:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.309+0000 7efecf7fe700 1 -- 172.21.15.82:0/1645471802 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efed804b5a0 con 0x7efee80ab220 2023-10-06T03:16:00.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.309+0000 7fbc9e7fc700 1 -- 172.21.15.82:0/3048771032 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca80275f0 con 0x7fbcb015bb10 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.309+0000 7fbc9e7fc700 1 -- 172.21.15.82:0/3048771032 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca80279b0 con 0x7fbcb015bb10 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.309+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb015fcc0 con 0x7fbcb015bb10 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.309+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb00a85b0 con 0x7fbcb015bb10 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.310+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb015fe50 con 0x7fbcb015bb10 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.311+0000 7fbc9e7fc700 1 -- 172.21.15.82:0/3048771032 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbca8024070 con 0x7fbcb015bb10 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.311+0000 7fbc9e7fc700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc90066f30 0x7fbc900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.311+0000 7fbc9e7fc700 1 -- 172.21.15.82:0/3048771032 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbca80873f0 con 0x7fbcb015bb10 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.311+0000 7fbcae59c700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc90066f30 0x7fbc900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.312+0000 7fbcae59c700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc90066f30 0x7fbc900693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009b10 tx=0x7fbca00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.315+0000 7fbc9e7fc700 1 -- 172.21.15.82:0/3048771032 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbca8054580 con 0x7fbcb015bb10 2023-10-06T03:16:00.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.316+0000 7f4aacff9700 1 -- 172.21.15.82:0/4064024694 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4aa00511f0 con 0x7f4ab00cbd50 2023-10-06T03:16:00.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.319+0000 7fb351551700 1 Processor -- start 2023-10-06T03:16:00.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.319+0000 7fb351551700 1 -- start start 2023-10-06T03:16:00.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.320+0000 7fb351551700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb34c069120 0x7fb34c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.320+0000 7fb351551700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb34c0694f0 0x7fb34c0aa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.320+0000 7fb351551700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c159540 0x7fb34c1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.320+0000 7fb351551700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0aaeb0 con 0x7fb34c0694f0 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.320+0000 7fb351551700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c159f00 con 0x7fb34c069120 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.320+0000 7fb351551700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0ab0c0 con 0x7fb34c159540 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.320+0000 7fb34a7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb34c0694f0 0x7fb34c0aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34a7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb34c0694f0 0x7fb34c0aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43832/0 (socket says 172.21.15.82:43832) 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34a7fc700 1 -- 172.21.15.82:0/588383777 learned_addr learned my addr 172.21.15.82:0/588383777 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34affd700 1 --2- 172.21.15.82:0/588383777 >> v2:172.21.15.134:3300/0 conn(0x7fb34c069120 0x7fb34c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34a7fc700 1 -- 172.21.15.82:0/588383777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c159540 msgr2=0x7fb34c1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34a7fc700 1 --2- 172.21.15.82:0/588383777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c159540 0x7fb34c1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34a7fc700 1 -- 172.21.15.82:0/588383777 >> v2:172.21.15.134:3300/0 conn(0x7fb34c069120 msgr2=0x7fb34c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34a7fc700 1 --2- 172.21.15.82:0/588383777 >> v2:172.21.15.134:3300/0 conn(0x7fb34c069120 0x7fb34c15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34a7fc700 1 -- 172.21.15.82:0/588383777 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0ab3a0 con 0x7fb34c0694f0 2023-10-06T03:16:00.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.321+0000 7fb34a7fc700 1 --2- 172.21.15.82:0/588383777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb34c0694f0 0x7fb34c0aa970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb3400099b0 tx=0x7fb340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d047aee0e5fff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.324+0000 7fdae27fc700 1 -- 172.21.15.82:0/930515279 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae801be60 con 0x7fdaf40cb980 2023-10-06T03:16:00.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.325+0000 7fb349ffb700 1 -- 172.21.15.82:0/588383777 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340009ea0 con 0x7fb34c0694f0 2023-10-06T03:16:00.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.325+0000 7fb349ffb700 1 -- 172.21.15.82:0/588383777 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000b820 con 0x7fb34c0694f0 2023-10-06T03:16:00.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.325+0000 7fb349ffb700 1 -- 172.21.15.82:0/588383777 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000bba0 con 0x7fb34c0694f0 2023-10-06T03:16:00.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.326+0000 7f7058ff9700 1 -- 172.21.15.82:0/2463221583 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f705c0ca5d0 con 0x7f705c0cb980 2023-10-06T03:16:00.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.325+0000 7fdae27fc700 1 -- 172.21.15.82:0/930515279 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae801c450 con 0x7fdaf40cb980 2023-10-06T03:16:00.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.325+0000 7fdae27fc700 1 -- 172.21.15.82:0/930515279 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae801c810 con 0x7fdaf40cb980 2023-10-06T03:16:00.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.326+0000 7fb351551700 1 -- 172.21.15.82:0/588383777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb34c0694f0 msgr2=0x7fb34c0aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.326+0000 7fb351551700 1 --2- 172.21.15.82:0/588383777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb34c0694f0 0x7fb34c0aa970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb3400099b0 tx=0x7fb340009250 comp rx=0 tx=0).stop 2023-10-06T03:16:00.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.326+0000 7fb351551700 1 -- 172.21.15.82:0/588383777 shutdown_connections 2023-10-06T03:16:00.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.326+0000 7fb351551700 1 --2- 172.21.15.82:0/588383777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c159540 0x7fb34c1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.326+0000 7fb351551700 1 --2- 172.21.15.82:0/588383777 >> v2:172.21.15.134:3300/0 conn(0x7fb34c069120 0x7fb34c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.326+0000 7fb351551700 1 --2- 172.21.15.82:0/588383777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb34c0694f0 0x7fb34c0aa970 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.326+0000 7fb351551700 1 -- 172.21.15.82:0/588383777 >> 172.21.15.82:0/588383777 conn(0x7fb34c06e910 msgr2=0x7fb34c06be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.327+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf40aa320 con 0x7fdaf40cb980 2023-10-06T03:16:00.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.327+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf40aa8e0 con 0x7fdaf40cb980 2023-10-06T03:16:00.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.336+0000 7fb351551700 1 -- 172.21.15.82:0/588383777 shutdown_connections 2023-10-06T03:16:00.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.336+0000 7fb351551700 1 -- 172.21.15.82:0/588383777 wait complete. 2023-10-06T03:16:00.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.338+0000 7fb351551700 1 Processor -- start 2023-10-06T03:16:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.338+0000 7fb351551700 1 -- start start 2023-10-06T03:16:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.339+0000 7fb351551700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb34c069120 0x7fb34c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.339+0000 7fb351551700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c0694f0 0x7fb34c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.339+0000 7fb351551700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34c159540 0x7fb34c0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.339+0000 7fb351551700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c1415d0 con 0x7fb34c069120 2023-10-06T03:16:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.339+0000 7fb351551700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c142430 con 0x7fb34c159540 2023-10-06T03:16:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.339+0000 7fb351551700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c154fc0 con 0x7fb34c0694f0 2023-10-06T03:16:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34a7fc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c0694f0 0x7fb34c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34a7fc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c0694f0 0x7fb34c156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42546/0 (socket says 172.21.15.82:42546) 2023-10-06T03:16:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34a7fc700 1 -- 172.21.15.82:0/3423019545 learned_addr learned my addr 172.21.15.82:0/3423019545 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34b7fe700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34c159540 0x7fb34c0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34a7fc700 1 -- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34c159540 msgr2=0x7fb34c0b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34a7fc700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34c159540 0x7fb34c0b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34a7fc700 1 -- 172.21.15.82:0/3423019545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb34c069120 msgr2=0x7fb34c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34a7fc700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb34c069120 0x7fb34c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.340+0000 7fb34a7fc700 1 -- 172.21.15.82:0/3423019545 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400094f0 con 0x7fb34c0694f0 2023-10-06T03:16:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.341+0000 7fb34a7fc700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c0694f0 0x7fb34c156d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb340009290 tx=0x7fb340017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.341+0000 7fb332ffd700 1 -- 172.21.15.82:0/3423019545 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000b990 con 0x7fb34c0694f0 2023-10-06T03:16:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.341+0000 7fb332ffd700 1 -- 172.21.15.82:0/3423019545 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000bb10 con 0x7fb34c0694f0 2023-10-06T03:16:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.341+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c154a80 con 0x7fb34c0694f0 2023-10-06T03:16:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.341+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c141b00 con 0x7fb34c0694f0 2023-10-06T03:16:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.342+0000 7fb332ffd700 1 -- 172.21.15.82:0/3423019545 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34001a6a0 con 0x7fb34c0694f0 2023-10-06T03:16:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.338+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf40ab0e0 con 0x7fdaf40cb980 2023-10-06T03:16:00.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.344+0000 7fb332ffd700 1 -- 172.21.15.82:0/3423019545 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb34001aa50 con 0x7fb34c0694f0 2023-10-06T03:16:00.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.345+0000 7fb332ffd700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb338067000 0x7fb3380694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.345+0000 7fb332ffd700 1 -- 172.21.15.82:0/3423019545 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb340085ba0 con 0x7fb34c0694f0 2023-10-06T03:16:00.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.345+0000 7fb34affd700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb338067000 0x7fb3380694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.346+0000 7fb34affd700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb338067000 0x7fb3380694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb34c068670 tx=0x7fb33c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.348+0000 7fdae27fc700 1 -- 172.21.15.82:0/930515279 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdae801cc00 con 0x7fdaf40cb980 2023-10-06T03:16:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.348+0000 7fdae27fc700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdad4066fb0 0x7fdad4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.348+0000 7fdae27fc700 1 -- 172.21.15.82:0/930515279 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdae8085ac0 con 0x7fdaf40cb980 2023-10-06T03:16:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.348+0000 7fdae27fc700 1 -- 172.21.15.82:0/930515279 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaf40ab0e0 con 0x7fdaf40cb980 2023-10-06T03:16:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.349+0000 7fdaf259c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdad4066fb0 0x7fdad4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.349+0000 7fdaf259c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdad4066fb0 0x7fdad4069460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdae400a820 tx=0x7fdae400c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.358+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c0052b0 con 0x7fb34c0694f0 2023-10-06T03:16:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.369+0000 7fb332ffd700 1 -- 172.21.15.82:0/3423019545 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb340052c10 con 0x7fb34c0694f0 2023-10-06T03:16:00.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.586+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff108005560 con 0x7ff12c0af040 2023-10-06T03:16:00.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.587+0000 7ff1217fa700 1 -- 172.21.15.82:0/3403656440 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff124056650 con 0x7ff12c0af040 2023-10-06T03:16:00.591 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:16:00.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.590+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff1180671e0 msgr2=0x7ff118069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.590+0000 7ff133976700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff1180671e0 0x7ff118069690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0ab8e0 tx=0x7ff11c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.590+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c0af040 msgr2=0x7ff12c1716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.590+0000 7ff133976700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c0af040 0x7ff12c1716a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0cc160 tx=0x7ff124017000 comp rx=0 tx=0).stop 2023-10-06T03:16:00.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.591+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 shutdown_connections 2023-10-06T03:16:00.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.591+0000 7ff133976700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12c15df30 0x7ff12c0a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.591+0000 7ff133976700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c0af040 0x7ff12c1716a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.591+0000 7ff133976700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff1180671e0 0x7ff118069690 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.591+0000 7ff133976700 1 --2- 172.21.15.82:0/3403656440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff12c15db60 0x7ff12c0a54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.591+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 >> 172.21.15.82:0/3403656440 conn(0x7ff12c068b90 msgr2=0x7ff12c1633b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.591+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 shutdown_connections 2023-10-06T03:16:00.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.591+0000 7ff133976700 1 -- 172.21.15.82:0/3403656440 wait complete. 2023-10-06T03:16:00.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-06T03:16:00.610 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:00.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.672+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f45c80b01f0 con 0x7f45c80acd70 2023-10-06T03:16:00.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.673+0000 7f45bdffb700 1 -- 172.21.15.82:0/1205137891 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45b8054bf0 con 0x7f45c80acd70 2023-10-06T03:16:00.674 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-10-06T03:16:00.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.676+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45ac066f30 msgr2=0x7f45ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.676+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45ac066f30 0x7f45ac0693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45c0007fd0 tx=0x7f45c000c040 comp rx=0 tx=0).stop 2023-10-06T03:16:00.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.676+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c80acd70 msgr2=0x7f45c816c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.676+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c80acd70 0x7f45c816c970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45b800b5e0 tx=0x7f45b8009120 comp rx=0 tx=0).stop 2023-10-06T03:16:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.677+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 shutdown_connections 2023-10-06T03:16:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.677+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c80acd70 0x7f45c816c970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.677+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c806ae20 0x7f45c80c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.677+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.677+0000 7f45cfb9f700 1 --2- 172.21.15.82:0/1205137891 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c806b1f0 0x7f45c816c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.677+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 >> 172.21.15.82:0/1205137891 conn(0x7f45c8068b90 msgr2=0x7f45c806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.679+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 shutdown_connections 2023-10-06T03:16:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.679+0000 7f45cfb9f700 1 -- 172.21.15.82:0/1205137891 wait complete. 2023-10-06T03:16:00.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.687+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb32c005560 con 0x7fb34c0694f0 2023-10-06T03:16:00.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.688+0000 7fb332ffd700 1 -- 172.21.15.82:0/3423019545 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb34002a020 con 0x7fb34c0694f0 2023-10-06T03:16:00.690 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2023-10-06T03:16:00.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.690+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb338067000 msgr2=0x7fb3380694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.690+0000 7fb351551700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb338067000 0x7fb3380694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb34c068670 tx=0x7fb33c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.690+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c0694f0 msgr2=0x7fb34c156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.690+0000 7fb351551700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c0694f0 0x7fb34c156d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb340009290 tx=0x7fb340017000 comp rx=0 tx=0).stop 2023-10-06T03:16:00.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 shutdown_connections 2023-10-06T03:16:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7fb351551700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34c159540 0x7fb34c0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7fb351551700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb34c069120 0x7fb34c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7fb351551700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb338067000 0x7fb3380694b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7fb351551700 1 --2- 172.21.15.82:0/3423019545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb34c0694f0 0x7fb34c156d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 >> 172.21.15.82:0/3423019545 conn(0x7fb34c06e910 msgr2=0x7fb34c0aa720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efec8005830 con 0x7efee80ab220 2023-10-06T03:16:00.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 shutdown_connections 2023-10-06T03:16:00.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.691+0000 7fb351551700 1 -- 172.21.15.82:0/3423019545 wait complete. 2023-10-06T03:16:00.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.692+0000 7efecf7fe700 1 -- 172.21.15.82:0/1645471802 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efed8050b50 con 0x7efee80ab220 2023-10-06T03:16:00.694 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:16:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.696+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efed406f740 msgr2=0x7efed4071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.696+0000 7efeeda91700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efed406f740 0x7efed4071bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efedc0098e0 tx=0x7efedc017000 comp rx=0 tx=0).stop 2023-10-06T03:16:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.696+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efee80ab220 msgr2=0x7efee814ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.696+0000 7efeeda91700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efee80ab220 0x7efee814ac50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efed800c7c0 tx=0x7efed8007f70 comp rx=0 tx=0).stop 2023-10-06T03:16:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.697+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 shutdown_connections 2023-10-06T03:16:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.697+0000 7efeeda91700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efee81576e0 0x7efee80c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.697+0000 7efeeda91700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efee80ab220 0x7efee814ac50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.697+0000 7efeeda91700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efed406f740 0x7efed4071bf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.697+0000 7efeeda91700 1 --2- 172.21.15.82:0/1645471802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efee80c7930 0x7efee80c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.697+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 >> 172.21.15.82:0/1645471802 conn(0x7efee80c8c50 msgr2=0x7efee80caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-06T03:16:00.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.698+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 shutdown_connections 2023-10-06T03:16:00.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.698+0000 7efeeda91700 1 -- 172.21.15.82:0/1645471802 wait complete. 2023-10-06T03:16:00.700 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.704+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f705c0ca5d0 con 0x7f705c0cb980 2023-10-06T03:16:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.704+0000 7f7058ff9700 1 -- 172.21.15.82:0/2463221583 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f705c0ca5d0 con 0x7f705c0cb980 2023-10-06T03:16:00.706 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-10-06T03:16:00.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2023-10-06T03:16:00.707 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.707+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7040067000 msgr2=0x7f70400694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.707+0000 7f7062cf4700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7040067000 0x7f70400694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7048001bf0 tx=0x7f7048009040 comp rx=0 tx=0).stop 2023-10-06T03:16:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.707+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f705c0cb980 msgr2=0x7f705c158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.707+0000 7f7062cf4700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f705c0cb980 0x7f705c158ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f705000b5e0 tx=0x7f70500090f0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 shutdown_connections 2023-10-06T03:16:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7f7062cf4700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f705c0cbd50 0x7f705c0ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7f7062cf4700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7040067000 0x7f70400694b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7f7062cf4700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f705c0ab3b0 0x7f705c0a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7f7062cf4700 1 --2- 172.21.15.82:0/2463221583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f705c0cb980 0x7f705c158ca0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 >> 172.21.15.82:0/2463221583 conn(0x7f705c068b90 msgr2=0x7f705c0695b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 shutdown_connections 2023-10-06T03:16:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7f7062cf4700 1 -- 172.21.15.82:0/2463221583 wait complete. 2023-10-06T03:16:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.708+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbcb0064050 con 0x7fbcb015bb10 2023-10-06T03:16:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.709+0000 7fbc9e7fc700 1 -- 172.21.15.82:0/3048771032 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbca802c090 con 0x7fbcb015bb10 2023-10-06T03:16:00.711 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-10-06T03:16:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.711+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4a90005830 con 0x7f4ab00cbd50 2023-10-06T03:16:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.711+0000 7f4aacff9700 1 -- 172.21.15.82:0/4064024694 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4aa0054810 con 0x7f4ab00cbd50 2023-10-06T03:16:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-10-06T03:16:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc90066f30 msgr2=0x7fbc900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc90066f30 0x7fbc900693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009b10 tx=0x7fbca00091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb015bb10 msgr2=0x7fbcb015e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb015bb10 0x7fbcb015e2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00aedc0 tx=0x7fbca8019000 comp rx=0 tx=0).stop 2023-10-06T03:16:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 shutdown_connections 2023-10-06T03:16:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc90066f30 0x7fbc900693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb015bb10 0x7fbcb015e2c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb006eb50 0x7fbcb0099690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 --2- 172.21.15.82:0/3048771032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb015dad0 0x7fbcb00975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 >> 172.21.15.82:0/3048771032 conn(0x7fbcb00680b0 msgr2=0x7fbcb006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 shutdown_connections 2023-10-06T03:16:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.712+0000 7fbcb4ac4700 1 -- 172.21.15.82:0/3048771032 wait complete. 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a9c066f30 msgr2=0x7f4a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a9c066f30 0x7f4a9c0693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009760 tx=0x7f4aa4006c70 comp rx=0 tx=0).stop 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00cbd50 msgr2=0x7f4ab006a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00cbd50 0x7f4ab006a9e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000b610 tx=0x7f4aa0009120 comp rx=0 tx=0).stop 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 shutdown_connections 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab00cbd50 0x7f4ab006a9e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4a9c066f30 0x7f4a9c0693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ab00ab3b0 0x7f4ab0153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 --2- 172.21.15.82:0/4064024694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab00cb980 0x7f4ab015b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 >> 172.21.15.82:0/4064024694 conn(0x7f4ab0068b90 msgr2=0x7f4ab0155a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 shutdown_connections 2023-10-06T03:16:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.714+0000 7f4ab7097700 1 -- 172.21.15.82:0/4064024694 wait complete. 2023-10-06T03:16:00.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-06T03:16:00.719 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.726+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdaf40ab0e0 con 0x7fdaf40cb980 2023-10-06T03:16:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.726+0000 7fdae27fc700 1 -- 172.21.15.82:0/930515279 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdaf40ab0e0 con 0x7fdaf40cb980 2023-10-06T03:16:00.728 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-10-06T03:16:00.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-10-06T03:16:00.731 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdad4066fb0 msgr2=0x7fdad4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdad4066fb0 0x7fdad4069460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdae400a820 tx=0x7fdae400c040 comp rx=0 tx=0).stop 2023-10-06T03:16:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40cb980 msgr2=0x7fdaf4146e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40cb980 0x7fdaf4146e30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdae80030c0 tx=0x7fdae8016000 comp rx=0 tx=0).stop 2023-10-06T03:16:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 shutdown_connections 2023-10-06T03:16:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf40cbd50 0x7fdaf406e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdad4066fb0 0x7fdad4069460 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdaf40ab3b0 0x7fdaf414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 --2- 172.21.15.82:0/930515279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40cb980 0x7fdaf4146e30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 >> 172.21.15.82:0/930515279 conn(0x7fdaf4068b90 msgr2=0x7fdaf40af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-10-06T03:16:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 shutdown_connections 2023-10-06T03:16:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.728+0000 7fdaf8d0c700 1 -- 172.21.15.82:0/930515279 wait complete. 2023-10-06T03:16:00.733 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:00.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-06T03:16:00.734 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:00.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-06T03:16:00.742 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:00.743 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:16:00.743 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:16:00.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.894+0000 7f21e0cda700 1 Processor -- start 2023-10-06T03:16:00.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.894+0000 7f21e0cda700 1 -- start start 2023-10-06T03:16:00.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21e0cda700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 0x7f21dc0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21e0cda700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21dc1591b0 0x7f21dc159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21e0cda700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21dc0b2ad0 con 0x7f21dc15d560 2023-10-06T03:16:00.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21e0cda700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21dc0b4160 con 0x7f21dc1591b0 2023-10-06T03:16:00.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21e0cda700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc159b70 con 0x7f21dc15d930 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21dad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21dc1591b0 0x7f21dc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21dad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21dc1591b0 0x7f21dc159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43844/0 (socket says 172.21.15.82:43844) 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21dad9d700 1 -- 172.21.15.82:0/1223650222 learned_addr learned my addr 172.21.15.82:0/1223650222 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.895+0000 7f21d9d9b700 1 --2- 172.21.15.82:0/1223650222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 0x7f21dc0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21dad9d700 1 -- 172.21.15.82:0/1223650222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 msgr2=0x7f21dc0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21dad9d700 1 --2- 172.21.15.82:0/1223650222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 0x7f21dc0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21dad9d700 1 -- 172.21.15.82:0/1223650222 >> v1:172.21.15.134:6789/0 conn(0x7f21dc15d560 legacy=0x7f21dc0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21dad9d700 1 -- 172.21.15.82:0/1223650222 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0b2230 con 0x7f21dc1591b0 2023-10-06T03:16:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21dad9d700 1 --2- 172.21.15.82:0/1223650222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc1591b0 0x7f21dc159630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f21d40099b0 tx=0x7f21d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b40cc74895ce06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21d959a700 1 -- 172.21.15.82:0/1223650222 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d400b860 con 0x7f21dc1591b0 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21d959a700 1 -- 172.21.15.82:0/1223650222 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d400b9c0 con 0x7f21dc1591b0 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21d959a700 1 -- 172.21.15.82:0/1223650222 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d400bd60 con 0x7f21dc1591b0 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21e0cda700 1 -- 172.21.15.82:0/1223650222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc1591b0 msgr2=0x7f21dc159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1223650222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc1591b0 0x7f21dc159630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f21d40099b0 tx=0x7f21d4009250 comp rx=0 tx=0).stop 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21e0cda700 1 -- 172.21.15.82:0/1223650222 shutdown_connections 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1223650222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc1591b0 0x7f21dc159630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1223650222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 0x7f21dc0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21e0cda700 1 -- 172.21.15.82:0/1223650222 >> 172.21.15.82:0/1223650222 conn(0x7f21dc0d1180 msgr2=0x7f21dc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:00.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21e0cda700 1 -- 172.21.15.82:0/1223650222 shutdown_connections 2023-10-06T03:16:00.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.896+0000 7f21e0cda700 1 -- 172.21.15.82:0/1223650222 wait complete. 2023-10-06T03:16:00.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.897+0000 7f21e0cda700 1 Processor -- start 2023-10-06T03:16:00.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21e0cda700 1 -- start start 2023-10-06T03:16:00.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21e0cda700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21dc1591b0 0x7f21dc159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21e0cda700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc15d560 0x7f21dc154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21e0cda700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 0x7f21dc144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21e0cda700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc15a320 con 0x7f21dc15d560 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21e0cda700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc15a600 con 0x7f21dc1591b0 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21e0cda700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc15a8e0 con 0x7f21dc15d930 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21d9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc15d560 0x7f21dc154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21d9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc15d560 0x7f21dc154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43850/0 (socket says 172.21.15.82:43850) 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21d9d9b700 1 -- 172.21.15.82:0/1534810864 learned_addr learned my addr 172.21.15.82:0/1534810864 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21dad9d700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 0x7f21dc144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.898+0000 7f21da59c700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21dc1591b0 0x7f21dc159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d9d9b700 1 -- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 msgr2=0x7f21dc144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d9d9b700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 0x7f21dc144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d9d9b700 1 -- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21dc1591b0 msgr2=0x7f21dc159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d9d9b700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21dc1591b0 0x7f21dc159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d9d9b700 1 -- 172.21.15.82:0/1534810864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d40094f0 con 0x7f21dc15d560 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d9d9b700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc15d560 0x7f21dc154780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d860 tx=0x7f21c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d27fc700 1 -- 172.21.15.82:0/1534810864 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40125f0 con 0x7f21dc15d560 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d27fc700 1 -- 172.21.15.82:0/1534810864 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4012750 con 0x7f21dc15d560 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc15abc0 con 0x7f21dc15d560 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21d27fc700 1 -- 172.21.15.82:0/1534810864 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4012b10 con 0x7f21dc15d560 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.899+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc1454a0 con 0x7f21dc15d560 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.900+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc1456c0 con 0x7f21dc15d560 2023-10-06T03:16:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.900+0000 7f21d27fc700 1 -- 172.21.15.82:0/1534810864 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21c401e460 con 0x7f21dc15d560 2023-10-06T03:16:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.900+0000 7f21d27fc700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21bc066f30 0x7f21bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.901+0000 7f21d27fc700 1 -- 172.21.15.82:0/1534810864 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21c4084bc0 con 0x7f21dc15d560 2023-10-06T03:16:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.901+0000 7f21da59c700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21bc066f30 0x7f21bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.901+0000 7f21da59c700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21bc066f30 0x7f21bc0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f21cc007fd0 tx=0x7f21cc0016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:00.905+0000 7f21d27fc700 1 -- 172.21.15.82:0/1534810864 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21c4051cd0 con 0x7f21dc15d560 2023-10-06T03:16:01.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.085+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21dc064050 con 0x7f21bc066f30 2023-10-06T03:16:01.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.093+0000 7f21d27fc700 1 -- 172.21.15.82:0/1534810864 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286775 (secure 0 0 0) 0x7f21dc064050 con 0x7f21bc066f30 2023-10-06T03:16:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21bc066f30 msgr2=0x7f21bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21bc066f30 0x7f21bc0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f21cc007fd0 tx=0x7f21cc0016f0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc15d560 msgr2=0x7f21dc154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc15d560 0x7f21dc154780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d860 tx=0x7f21c4008040 comp rx=0 tx=0).stop 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 shutdown_connections 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21bc066f30 0x7f21bc0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21dc15d930 0x7f21dc144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21dc1591b0 0x7f21dc159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 --2- 172.21.15.82:0/1534810864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21dc15d560 0x7f21dc154780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 >> 172.21.15.82:0/1534810864 conn(0x7f21dc0d1180 msgr2=0x7f21dc067630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:01.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 shutdown_connections 2023-10-06T03:16:01.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.096+0000 7f21e0cda700 1 -- 172.21.15.82:0/1534810864 wait complete. 2023-10-06T03:16:01.101 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:16:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-06T03:15:59.149700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381108,"kb_used_data":2804,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593612,"statfs":{"total":773094113280,"available":770655858688,"internally_reserved":0,"allocated":2871296,"data_stored":1772055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.768769"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405704+0000","last_change":"2023-10-06T03:15:52.401448+0000","last_active":"2023-10-06T03:15:52.405704+0000","last_peered":"2023-10-06T03:15:52.405704+0000","last_clean":"2023-10-06T03:15:52.405704+0000","last_became_active":"2023-10-06T03:15:52.401163+0000","last_became_peered":"2023-10-06T03:15:52.401163+0000","last_unstale":"2023-10-06T03:15:52.405704+0000","last_undegraded":"2023-10-06T03:15:52.405704+0000","last_fullsized":"2023-10-06T03:15:52.405704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:12.727676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407826+0000","last_change":"2023-10-06T03:15:52.400840+0000","last_active":"2023-10-06T03:15:52.407826+0000","last_peered":"2023-10-06T03:15:52.407826+0000","last_clean":"2023-10-06T03:15:52.407826+0000","last_became_active":"2023-10-06T03:15:52.400551+0000","last_became_peered":"2023-10-06T03:15:52.400551+0000","last_unstale":"2023-10-06T03:15:52.407826+0000","last_undegraded":"2023-10-06T03:15:52.407826+0000","last_fullsized":"2023-10-06T03:15:52.407826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403045+0000","last_change":"2023-10-06T03:15:52.397230+0000","last_active":"2023-10-06T03:15:52.403045+0000","last_peered":"2023-10-06T03:15:52.403045+0000","last_clean":"2023-10-06T03:15:52.403045+0000","last_became_active":"2023-10-06T03:15:52.396958+0000","last_became_peered":"2023-10-06T03:15:52.396958+0000","last_unstale":"2023-10-06T03:15:52.403045+0000","last_undegraded":"2023-10-06T03:15:52.403045+0000","last_fullsized":"2023-10-06T03:15:52.403045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:36.699116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408300+0000","last_change":"2023-10-06T03:15:52.402222+0000","last_active":"2023-10-06T03:15:52.408300+0000","last_peered":"2023-10-06T03:15:52.408300+0000","last_clean":"2023-10-06T03:15:52.408300+0000","last_became_active":"2023-10-06T03:15:52.401929+0000","last_became_peered":"2023-10-06T03:15:52.401929+0000","last_unstale":"2023-10-06T03:15:52.408300+0000","last_undegraded":"2023-10-06T03:15:52.408300+0000","last_fullsized":"2023-10-06T03:15:52.408300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:27.381001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409687+0000","last_change":"2023-10-06T03:15:52.402998+0000","last_active":"2023-10-06T03:15:52.409687+0000","last_peered":"2023-10-06T03:15:52.409687+0000","last_clean":"2023-10-06T03:15:52.409687+0000","last_became_active":"2023-10-06T03:15:52.402744+0000","last_became_peered":"2023-10-06T03:15:52.402744+0000","last_unstale":"2023-10-06T03:15:52.409687+0000","last_undegraded":"2023-10-06T03:15:52.409687+0000","last_fullsized":"2023-10-06T03:15:52.409687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407765+0000","last_change":"2023-10-06T03:15:52.400543+0000","last_active":"2023-10-06T03:15:52.407765+0000","last_peered":"2023-10-06T03:15:52.407765+0000","last_clean":"2023-10-06T03:15:52.407765+0000","last_became_active":"2023-10-06T03:15:52.400234+0000","last_became_peered":"2023-10-06T03:15:52.400234+0000","last_unstale":"2023-10-06T03:15:52.407765+0000","last_undegraded":"2023-10-06T03:15:52.407765+0000","last_fullsized":"2023-10-06T03:15:52.407765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:22.091211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415196+0000","last_change":"2023-10-06T03:15:52.411636+0000","last_active":"2023-10-06T03:15:52.415196+0000","last_peered":"2023-10-06T03:15:52.415196+0000","last_clean":"2023-10-06T03:15:52.415196+0000","last_became_active":"2023-10-06T03:15:52.410475+0000","last_became_peered":"2023-10-06T03:15:52.410475+0000","last_unstale":"2023-10-06T03:15:52.415196+0000","last_undegraded":"2023-10-06T03:15:52.415196+0000","last_fullsized":"2023-10-06T03:15:52.415196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395701+0000","last_change":"2023-10-06T03:15:52.391661+0000","last_active":"2023-10-06T03:15:52.395701+0000","last_peered":"2023-10-06T03:15:52.395701+0000","last_clean":"2023-10-06T03:15:52.395701+0000","last_became_active":"2023-10-06T03:15:52.390749+0000","last_became_peered":"2023-10-06T03:15:52.390749+0000","last_unstale":"2023-10-06T03:15:52.395701+0000","last_undegraded":"2023-10-06T03:15:52.395701+0000","last_fullsized":"2023-10-06T03:15:52.395701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409753+0000","last_change":"2023-10-06T03:15:52.403195+0000","last_active":"2023-10-06T03:15:52.409753+0000","last_peered":"2023-10-06T03:15:52.409753+0000","last_clean":"2023-10-06T03:15:52.409753+0000","last_became_active":"2023-10-06T03:15:52.402869+0000","last_became_peered":"2023-10-06T03:15:52.402869+0000","last_unstale":"2023-10-06T03:15:52.409753+0000","last_undegraded":"2023-10-06T03:15:52.409753+0000","last_fullsized":"2023-10-06T03:15:52.409753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:35.985027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.401152+0000","last_change":"2023-10-06T03:15:52.395407+0000","last_active":"2023-10-06T03:15:52.401152+0000","last_peered":"2023-10-06T03:15:52.401152+0000","last_clean":"2023-10-06T03:15:52.401152+0000","last_became_active":"2023-10-06T03:15:52.395152+0000","last_became_peered":"2023-10-06T03:15:52.395152+0000","last_unstale":"2023-10-06T03:15:52.401152+0000","last_undegraded":"2023-10-06T03:15:52.401152+0000","last_fullsized":"2023-10-06T03:15:52.401152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407807+0000","last_change":"2023-10-06T03:15:52.399379+0000","last_active":"2023-10-06T03:15:52.407807+0000","last_peered":"2023-10-06T03:15:52.407807+0000","last_clean":"2023-10-06T03:15:52.407807+0000","last_became_active":"2023-10-06T03:15:52.399116+0000","last_became_peered":"2023-10-06T03:15:52.399116+0000","last_unstale":"2023-10-06T03:15:52.407807+0000","last_undegraded":"2023-10-06T03:15:52.407807+0000","last_fullsized":"2023-10-06T03:15:52.407807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:24.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404234+0000","last_change":"2023-10-06T03:15:52.398110+0000","last_active":"2023-10-06T03:15:52.404234+0000","last_peered":"2023-10-06T03:15:52.404234+0000","last_clean":"2023-10-06T03:15:52.404234+0000","last_became_active":"2023-10-06T03:15:52.397691+0000","last_became_peered":"2023-10-06T03:15:52.397691+0000","last_unstale":"2023-10-06T03:15:52.404234+0000","last_undegraded":"2023-10-06T03:15:52.404234+0000","last_fullsized":"2023-10-06T03:15:52.404234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:20.541949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405781+0000","last_change":"2023-10-06T03:15:52.401787+0000","last_active":"2023-10-06T03:15:52.405781+0000","last_peered":"2023-10-06T03:15:52.405781+0000","last_clean":"2023-10-06T03:15:52.405781+0000","last_became_active":"2023-10-06T03:15:52.400804+0000","last_became_peered":"2023-10-06T03:15:52.400804+0000","last_unstale":"2023-10-06T03:15:52.405781+0000","last_undegraded":"2023-10-06T03:15:52.405781+0000","last_fullsized":"2023-10-06T03:15:52.405781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:00.679276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402120+0000","last_change":"2023-10-06T03:15:52.396439+0000","last_active":"2023-10-06T03:15:52.402120+0000","last_peered":"2023-10-06T03:15:52.402120+0000","last_clean":"2023-10-06T03:15:52.402120+0000","last_became_active":"2023-10-06T03:15:52.396218+0000","last_became_peered":"2023-10-06T03:15:52.396218+0000","last_unstale":"2023-10-06T03:15:52.402120+0000","last_undegraded":"2023-10-06T03:15:52.402120+0000","last_fullsized":"2023-10-06T03:15:52.402120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413375+0000","last_change":"2023-10-06T03:15:52.401847+0000","last_active":"2023-10-06T03:15:52.413375+0000","last_peered":"2023-10-06T03:15:52.413375+0000","last_clean":"2023-10-06T03:15:52.413375+0000","last_became_active":"2023-10-06T03:15:52.401531+0000","last_became_peered":"2023-10-06T03:15:52.401531+0000","last_unstale":"2023-10-06T03:15:52.413375+0000","last_undegraded":"2023-10-06T03:15:52.413375+0000","last_fullsized":"2023-10-06T03:15:52.413375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.398194+0000","last_change":"2023-10-06T03:15:52.394021+0000","last_active":"2023-10-06T03:15:52.398194+0000","last_peered":"2023-10-06T03:15:52.398194+0000","last_clean":"2023-10-06T03:15:52.398194+0000","last_became_active":"2023-10-06T03:15:52.393712+0000","last_became_peered":"2023-10-06T03:15:52.393712+0000","last_unstale":"2023-10-06T03:15:52.398194+0000","last_undegraded":"2023-10-06T03:15:52.398194+0000","last_fullsized":"2023-10-06T03:15:52.398194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:10.769614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409766+0000","last_change":"2023-10-06T03:15:52.404215+0000","last_active":"2023-10-06T03:15:52.409766+0000","last_peered":"2023-10-06T03:15:52.409766+0000","last_clean":"2023-10-06T03:15:52.409766+0000","last_became_active":"2023-10-06T03:15:52.403876+0000","last_became_peered":"2023-10-06T03:15:52.403876+0000","last_unstale":"2023-10-06T03:15:52.409766+0000","last_undegraded":"2023-10-06T03:15:52.409766+0000","last_fullsized":"2023-10-06T03:15:52.409766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407690+0000","last_change":"2023-10-06T03:15:52.397291+0000","last_active":"2023-10-06T03:15:52.407690+0000","last_peered":"2023-10-06T03:15:52.407690+0000","last_clean":"2023-10-06T03:15:52.407690+0000","last_became_active":"2023-10-06T03:15:52.397010+0000","last_became_peered":"2023-10-06T03:15:52.397010+0000","last_unstale":"2023-10-06T03:15:52.407690+0000","last_undegraded":"2023-10-06T03:15:52.407690+0000","last_fullsized":"2023-10-06T03:15:52.407690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409687+0000","last_change":"2023-10-06T03:15:52.403844+0000","last_active":"2023-10-06T03:15:52.409687+0000","last_peered":"2023-10-06T03:15:52.409687+0000","last_clean":"2023-10-06T03:15:52.409687+0000","last_became_active":"2023-10-06T03:15:52.403593+0000","last_became_peered":"2023-10-06T03:15:52.403593+0000","last_unstale":"2023-10-06T03:15:52.409687+0000","last_undegraded":"2023-10-06T03:15:52.409687+0000","last_fullsized":"2023-10-06T03:15:52.409687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:23.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408446+0000","last_change":"2023-10-06T03:15:52.404280+0000","last_active":"2023-10-06T03:15:52.408446+0000","last_peered":"2023-10-06T03:15:52.408446+0000","last_clean":"2023-10-06T03:15:52.408446+0000","last_became_active":"2023-10-06T03:15:52.403932+0000","last_became_peered":"2023-10-06T03:15:52.403932+0000","last_unstale":"2023-10-06T03:15:52.408446+0000","last_undegraded":"2023-10-06T03:15:52.408446+0000","last_fullsized":"2023-10-06T03:15:52.408446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415370+0000","last_change":"2023-10-06T03:15:52.412076+0000","last_active":"2023-10-06T03:15:52.415370+0000","last_peered":"2023-10-06T03:15:52.415370+0000","last_clean":"2023-10-06T03:15:52.415370+0000","last_became_active":"2023-10-06T03:15:52.410526+0000","last_became_peered":"2023-10-06T03:15:52.410526+0000","last_unstale":"2023-10-06T03:15:52.415370+0000","last_undegraded":"2023-10-06T03:15:52.415370+0000","last_fullsized":"2023-10-06T03:15:52.415370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404668+0000","last_change":"2023-10-06T03:15:52.399635+0000","last_active":"2023-10-06T03:15:52.404668+0000","last_peered":"2023-10-06T03:15:52.404668+0000","last_clean":"2023-10-06T03:15:52.404668+0000","last_became_active":"2023-10-06T03:15:52.399371+0000","last_became_peered":"2023-10-06T03:15:52.399371+0000","last_unstale":"2023-10-06T03:15:52.404668+0000","last_undegraded":"2023-10-06T03:15:52.404668+0000","last_fullsized":"2023-10-06T03:15:52.404668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404276+0000","last_change":"2023-10-06T03:15:52.401220+0000","last_active":"2023-10-06T03:15:52.404276+0000","last_peered":"2023-10-06T03:15:52.404276+0000","last_clean":"2023-10-06T03:15:52.404276+0000","last_became_active":"2023-10-06T03:15:52.400120+0000","last_became_peered":"2023-10-06T03:15:52.400120+0000","last_unstale":"2023-10-06T03:15:52.404276+0000","last_undegraded":"2023-10-06T03:15:52.404276+0000","last_fullsized":"2023-10-06T03:15:52.404276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413306+0000","last_change":"2023-10-06T03:15:52.401474+0000","last_active":"2023-10-06T03:15:52.413306+0000","last_peered":"2023-10-06T03:15:52.413306+0000","last_clean":"2023-10-06T03:15:52.413306+0000","last_became_active":"2023-10-06T03:15:52.401210+0000","last_became_peered":"2023-10-06T03:15:52.401210+0000","last_unstale":"2023-10-06T03:15:52.413306+0000","last_undegraded":"2023-10-06T03:15:52.413306+0000","last_fullsized":"2023-10-06T03:15:52.413306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409165+0000","last_change":"2023-10-06T03:15:52.402928+0000","last_active":"2023-10-06T03:15:52.409165+0000","last_peered":"2023-10-06T03:15:52.409165+0000","last_clean":"2023-10-06T03:15:52.409165+0000","last_became_active":"2023-10-06T03:15:52.402659+0000","last_became_peered":"2023-10-06T03:15:52.402659+0000","last_unstale":"2023-10-06T03:15:52.409165+0000","last_undegraded":"2023-10-06T03:15:52.409165+0000","last_fullsized":"2023-10-06T03:15:52.409165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:27.381001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405592+0000","last_change":"2023-10-06T03:15:52.398134+0000","last_active":"2023-10-06T03:15:52.405592+0000","last_peered":"2023-10-06T03:15:52.405592+0000","last_clean":"2023-10-06T03:15:52.405592+0000","last_became_active":"2023-10-06T03:15:52.397881+0000","last_became_peered":"2023-10-06T03:15:52.397881+0000","last_unstale":"2023-10-06T03:15:52.405592+0000","last_undegraded":"2023-10-06T03:15:52.405592+0000","last_fullsized":"2023-10-06T03:15:52.405592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:30.488004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412503+0000","last_change":"2023-10-06T03:15:52.403876+0000","last_active":"2023-10-06T03:15:52.412503+0000","last_peered":"2023-10-06T03:15:52.412503+0000","last_clean":"2023-10-06T03:15:52.412503+0000","last_became_active":"2023-10-06T03:15:52.403598+0000","last_became_peered":"2023-10-06T03:15:52.403598+0000","last_unstale":"2023-10-06T03:15:52.412503+0000","last_undegraded":"2023-10-06T03:15:52.412503+0000","last_fullsized":"2023-10-06T03:15:52.412503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413297+0000","last_change":"2023-10-06T03:15:51.399470+0000","last_active":"2023-10-06T03:15:52.413297+0000","last_peered":"2023-10-06T03:15:52.413297+0000","last_clean":"2023-10-06T03:15:52.413297+0000","last_became_active":"2023-10-06T03:15:51.399099+0000","last_became_peered":"2023-10-06T03:15:51.399099+0000","last_unstale":"2023-10-06T03:15:52.413297+0000","last_undegraded":"2023-10-06T03:15:52.413297+0000","last_fullsized":"2023-10-06T03:15:52.413297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403880+0000","last_change":"2023-10-06T03:15:52.400465+0000","last_active":"2023-10-06T03:15:52.403880+0000","last_peered":"2023-10-06T03:15:52.403880+0000","last_clean":"2023-10-06T03:15:52.403880+0000","last_became_active":"2023-10-06T03:15:52.400175+0000","last_became_peered":"2023-10-06T03:15:52.400175+0000","last_unstale":"2023-10-06T03:15:52.403880+0000","last_undegraded":"2023-10-06T03:15:52.403880+0000","last_fullsized":"2023-10-06T03:15:52.403880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:35.985027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396234+0000","last_change":"2023-10-06T03:15:51.401117+0000","last_active":"2023-10-06T03:15:52.396234+0000","last_peered":"2023-10-06T03:15:52.396234+0000","last_clean":"2023-10-06T03:15:52.396234+0000","last_became_active":"2023-10-06T03:15:51.400839+0000","last_became_peered":"2023-10-06T03:15:51.400839+0000","last_unstale":"2023-10-06T03:15:52.396234+0000","last_undegraded":"2023-10-06T03:15:52.396234+0000","last_fullsized":"2023-10-06T03:15:52.396234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:36.643445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404590+0000","last_change":"2023-10-06T03:15:52.398565+0000","last_active":"2023-10-06T03:15:52.404590+0000","last_peered":"2023-10-06T03:15:52.404590+0000","last_clean":"2023-10-06T03:15:52.404590+0000","last_became_active":"2023-10-06T03:15:52.398307+0000","last_became_peered":"2023-10-06T03:15:52.398307+0000","last_unstale":"2023-10-06T03:15:52.404590+0000","last_undegraded":"2023-10-06T03:15:52.404590+0000","last_fullsized":"2023-10-06T03:15:52.404590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.391829+0000","last_change":"2023-10-06T03:15:51.398624+0000","last_active":"2023-10-06T03:15:52.391829+0000","last_peered":"2023-10-06T03:15:52.391829+0000","last_clean":"2023-10-06T03:15:52.391829+0000","last_became_active":"2023-10-06T03:15:51.398391+0000","last_became_peered":"2023-10-06T03:15:51.398391+0000","last_unstale":"2023-10-06T03:15:52.391829+0000","last_undegraded":"2023-10-06T03:15:52.391829+0000","last_fullsized":"2023-10-06T03:15:52.391829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407778+0000","last_change":"2023-10-06T03:15:52.401764+0000","last_active":"2023-10-06T03:15:52.407778+0000","last_peered":"2023-10-06T03:15:52.407778+0000","last_clean":"2023-10-06T03:15:52.407778+0000","last_became_active":"2023-10-06T03:15:52.401456+0000","last_became_peered":"2023-10-06T03:15:52.401456+0000","last_unstale":"2023-10-06T03:15:52.407778+0000","last_undegraded":"2023-10-06T03:15:52.407778+0000","last_fullsized":"2023-10-06T03:15:52.407778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:31.512733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.386122+0000","last_change":"2023-10-06T03:15:51.397770+0000","last_active":"2023-10-06T03:15:52.386122+0000","last_peered":"2023-10-06T03:15:52.386122+0000","last_clean":"2023-10-06T03:15:52.386122+0000","last_became_active":"2023-10-06T03:15:51.396623+0000","last_became_peered":"2023-10-06T03:15:51.396623+0000","last_unstale":"2023-10-06T03:15:52.386122+0000","last_undegraded":"2023-10-06T03:15:52.386122+0000","last_fullsized":"2023-10-06T03:15:52.386122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.401114+0000","last_change":"2023-10-06T03:15:52.399019+0000","last_active":"2023-10-06T03:15:52.401114+0000","last_peered":"2023-10-06T03:15:52.401114+0000","last_clean":"2023-10-06T03:15:52.401114+0000","last_became_active":"2023-10-06T03:15:52.398286+0000","last_became_peered":"2023-10-06T03:15:52.398286+0000","last_unstale":"2023-10-06T03:15:52.401114+0000","last_undegraded":"2023-10-06T03:15:52.401114+0000","last_fullsized":"2023-10-06T03:15:52.401114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:48.612711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388731+0000","last_change":"2023-10-06T03:15:51.397296+0000","last_active":"2023-10-06T03:15:52.388731+0000","last_peered":"2023-10-06T03:15:52.388731+0000","last_clean":"2023-10-06T03:15:52.388731+0000","last_became_active":"2023-10-06T03:15:51.397042+0000","last_became_peered":"2023-10-06T03:15:51.397042+0000","last_unstale":"2023-10-06T03:15:52.388731+0000","last_undegraded":"2023-10-06T03:15:52.388731+0000","last_fullsized":"2023-10-06T03:15:52.388731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412296+0000","last_change":"2023-10-06T03:15:52.407501+0000","last_active":"2023-10-06T03:15:52.412296+0000","last_peered":"2023-10-06T03:15:52.412296+0000","last_clean":"2023-10-06T03:15:52.412296+0000","last_became_active":"2023-10-06T03:15:52.407276+0000","last_became_peered":"2023-10-06T03:15:52.407276+0000","last_unstale":"2023-10-06T03:15:52.412296+0000","last_undegraded":"2023-10-06T03:15:52.412296+0000","last_fullsized":"2023-10-06T03:15:52.412296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418342+0000","last_change":"2023-10-06T03:15:51.401981+0000","last_active":"2023-10-06T03:15:52.418342+0000","last_peered":"2023-10-06T03:15:52.418342+0000","last_clean":"2023-10-06T03:15:52.418342+0000","last_became_active":"2023-10-06T03:15:51.401737+0000","last_became_peered":"2023-10-06T03:15:51.401737+0000","last_unstale":"2023-10-06T03:15:52.418342+0000","last_undegraded":"2023-10-06T03:15:52.418342+0000","last_fullsized":"2023-10-06T03:15:52.418342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409103+0000","last_change":"2023-10-06T03:15:52.402215+0000","last_active":"2023-10-06T03:15:52.409103+0000","last_peered":"2023-10-06T03:15:52.409103+0000","last_clean":"2023-10-06T03:15:52.409103+0000","last_became_active":"2023-10-06T03:15:52.401984+0000","last_became_peered":"2023-10-06T03:15:52.401984+0000","last_unstale":"2023-10-06T03:15:52.409103+0000","last_undegraded":"2023-10-06T03:15:52.409103+0000","last_fullsized":"2023-10-06T03:15:52.409103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.420512+0000","last_change":"2023-10-06T03:15:51.398687+0000","last_active":"2023-10-06T03:15:52.420512+0000","last_peered":"2023-10-06T03:15:52.420512+0000","last_clean":"2023-10-06T03:15:52.420512+0000","last_became_active":"2023-10-06T03:15:51.398419+0000","last_became_peered":"2023-10-06T03:15:51.398419+0000","last_unstale":"2023-10-06T03:15:52.420512+0000","last_undegraded":"2023-10-06T03:15:52.420512+0000","last_fullsized":"2023-10-06T03:15:52.420512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408183+0000","last_change":"2023-10-06T03:15:52.404174+0000","last_active":"2023-10-06T03:15:52.408183+0000","last_peered":"2023-10-06T03:15:52.408183+0000","last_clean":"2023-10-06T03:15:52.408183+0000","last_became_active":"2023-10-06T03:15:52.403892+0000","last_became_peered":"2023-10-06T03:15:52.403892+0000","last_unstale":"2023-10-06T03:15:52.408183+0000","last_undegraded":"2023-10-06T03:15:52.408183+0000","last_fullsized":"2023-10-06T03:15:52.408183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:48.612711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418455+0000","last_change":"2023-10-06T03:15:51.399272+0000","last_active":"2023-10-06T03:15:52.418455+0000","last_peered":"2023-10-06T03:15:52.418455+0000","last_clean":"2023-10-06T03:15:52.418455+0000","last_became_active":"2023-10-06T03:15:51.398980+0000","last_became_peered":"2023-10-06T03:15:51.398980+0000","last_unstale":"2023-10-06T03:15:52.418455+0000","last_undegraded":"2023-10-06T03:15:52.418455+0000","last_fullsized":"2023-10-06T03:15:52.418455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:30.507247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403724+0000","last_change":"2023-10-06T03:15:52.400547+0000","last_active":"2023-10-06T03:15:52.403724+0000","last_peered":"2023-10-06T03:15:52.403724+0000","last_clean":"2023-10-06T03:15:52.403724+0000","last_became_active":"2023-10-06T03:15:52.400318+0000","last_became_peered":"2023-10-06T03:15:52.400318+0000","last_unstale":"2023-10-06T03:15:52.403724+0000","last_undegraded":"2023-10-06T03:15:52.403724+0000","last_fullsized":"2023-10-06T03:15:52.403724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:04.891285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385392+0000","last_change":"2023-10-06T03:15:51.397316+0000","last_active":"2023-10-06T03:15:52.385392+0000","last_peered":"2023-10-06T03:15:52.385392+0000","last_clean":"2023-10-06T03:15:52.385392+0000","last_became_active":"2023-10-06T03:15:51.397057+0000","last_became_peered":"2023-10-06T03:15:51.397057+0000","last_unstale":"2023-10-06T03:15:52.385392+0000","last_undegraded":"2023-10-06T03:15:52.385392+0000","last_fullsized":"2023-10-06T03:15:52.385392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412525+0000","last_change":"2023-10-06T03:15:52.404046+0000","last_active":"2023-10-06T03:15:52.412525+0000","last_peered":"2023-10-06T03:15:52.412525+0000","last_clean":"2023-10-06T03:15:52.412525+0000","last_became_active":"2023-10-06T03:15:52.403608+0000","last_became_peered":"2023-10-06T03:15:52.403608+0000","last_unstale":"2023-10-06T03:15:52.412525+0000","last_undegraded":"2023-10-06T03:15:52.412525+0000","last_fullsized":"2023-10-06T03:15:52.412525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.393335+0000","last_change":"2023-10-06T03:15:51.400696+0000","last_active":"2023-10-06T03:15:52.393335+0000","last_peered":"2023-10-06T03:15:52.393335+0000","last_clean":"2023-10-06T03:15:52.393335+0000","last_became_active":"2023-10-06T03:15:51.400423+0000","last_became_peered":"2023-10-06T03:15:51.400423+0000","last_unstale":"2023-10-06T03:15:52.393335+0000","last_undegraded":"2023-10-06T03:15:52.393335+0000","last_fullsized":"2023-10-06T03:15:52.393335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:47.458357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409679+0000","last_change":"2023-10-06T03:15:52.402973+0000","last_active":"2023-10-06T03:15:52.409679+0000","last_peered":"2023-10-06T03:15:52.409679+0000","last_clean":"2023-10-06T03:15:52.409679+0000","last_became_active":"2023-10-06T03:15:52.402707+0000","last_became_peered":"2023-10-06T03:15:52.402707+0000","last_unstale":"2023-10-06T03:15:52.409679+0000","last_undegraded":"2023-10-06T03:15:52.409679+0000","last_fullsized":"2023-10-06T03:15:52.409679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418712+0000","last_change":"2023-10-06T03:15:51.398207+0000","last_active":"2023-10-06T03:15:52.418712+0000","last_peered":"2023-10-06T03:15:52.418712+0000","last_clean":"2023-10-06T03:15:52.418712+0000","last_became_active":"2023-10-06T03:15:51.397903+0000","last_became_peered":"2023-10-06T03:15:51.397903+0000","last_unstale":"2023-10-06T03:15:52.418712+0000","last_undegraded":"2023-10-06T03:15:52.418712+0000","last_fullsized":"2023-10-06T03:15:52.418712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415171+0000","last_change":"2023-10-06T03:15:52.411310+0000","last_active":"2023-10-06T03:15:52.415171+0000","last_peered":"2023-10-06T03:15:52.415171+0000","last_clean":"2023-10-06T03:15:52.415171+0000","last_became_active":"2023-10-06T03:15:52.411060+0000","last_became_peered":"2023-10-06T03:15:52.411060+0000","last_unstale":"2023-10-06T03:15:52.415171+0000","last_undegraded":"2023-10-06T03:15:52.415171+0000","last_fullsized":"2023-10-06T03:15:52.415171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418008+0000","last_change":"2023-10-06T03:15:51.399461+0000","last_active":"2023-10-06T03:15:52.418008+0000","last_peered":"2023-10-06T03:15:52.418008+0000","last_clean":"2023-10-06T03:15:52.418008+0000","last_became_active":"2023-10-06T03:15:51.398657+0000","last_became_peered":"2023-10-06T03:15:51.398657+0000","last_unstale":"2023-10-06T03:15:52.418008+0000","last_undegraded":"2023-10-06T03:15:52.418008+0000","last_fullsized":"2023-10-06T03:15:52.418008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.595391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412382+0000","last_change":"2023-10-06T03:15:52.401919+0000","last_active":"2023-10-06T03:15:52.412382+0000","last_peered":"2023-10-06T03:15:52.412382+0000","last_clean":"2023-10-06T03:15:52.412382+0000","last_became_active":"2023-10-06T03:15:52.401624+0000","last_became_peered":"2023-10-06T03:15:52.401624+0000","last_unstale":"2023-10-06T03:15:52.412382+0000","last_undegraded":"2023-10-06T03:15:52.412382+0000","last_fullsized":"2023-10-06T03:15:52.412382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418041+0000","last_change":"2023-10-06T03:15:51.399919+0000","last_active":"2023-10-06T03:15:52.418041+0000","last_peered":"2023-10-06T03:15:52.418041+0000","last_clean":"2023-10-06T03:15:52.418041+0000","last_became_active":"2023-10-06T03:15:51.399678+0000","last_became_peered":"2023-10-06T03:15:51.399678+0000","last_unstale":"2023-10-06T03:15:52.418041+0000","last_undegraded":"2023-10-06T03:15:52.418041+0000","last_fullsized":"2023-10-06T03:15:52.418041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:57.295789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.406812+0000","last_change":"2023-10-06T03:15:52.397998+0000","last_active":"2023-10-06T03:15:52.406812+0000","last_peered":"2023-10-06T03:15:52.406812+0000","last_clean":"2023-10-06T03:15:52.406812+0000","last_became_active":"2023-10-06T03:15:52.397706+0000","last_became_peered":"2023-10-06T03:15:52.397706+0000","last_unstale":"2023-10-06T03:15:52.406812+0000","last_undegraded":"2023-10-06T03:15:52.406812+0000","last_fullsized":"2023-10-06T03:15:52.406812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:32.121745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.417854+0000","last_change":"2023-10-06T03:15:51.401427+0000","last_active":"2023-10-06T03:15:52.417854+0000","last_peered":"2023-10-06T03:15:52.417854+0000","last_clean":"2023-10-06T03:15:52.417854+0000","last_became_active":"2023-10-06T03:15:51.401124+0000","last_became_peered":"2023-10-06T03:15:51.401124+0000","last_unstale":"2023-10-06T03:15:52.417854+0000","last_undegraded":"2023-10-06T03:15:52.417854+0000","last_fullsized":"2023-10-06T03:15:52.417854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:41.329304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407021+0000","last_change":"2023-10-06T03:15:52.398501+0000","last_active":"2023-10-06T03:15:52.407021+0000","last_peered":"2023-10-06T03:15:52.407021+0000","last_clean":"2023-10-06T03:15:52.407021+0000","last_became_active":"2023-10-06T03:15:52.398218+0000","last_became_peered":"2023-10-06T03:15:52.398218+0000","last_unstale":"2023-10-06T03:15:52.407021+0000","last_undegraded":"2023-10-06T03:15:52.407021+0000","last_fullsized":"2023-10-06T03:15:52.407021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:58.301276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.389184+0000","last_change":"2023-10-06T03:15:51.398288+0000","last_active":"2023-10-06T03:15:52.389184+0000","last_peered":"2023-10-06T03:15:52.389184+0000","last_clean":"2023-10-06T03:15:52.389184+0000","last_became_active":"2023-10-06T03:15:51.398015+0000","last_became_peered":"2023-10-06T03:15:51.398015+0000","last_unstale":"2023-10-06T03:15:52.389184+0000","last_undegraded":"2023-10-06T03:15:52.389184+0000","last_fullsized":"2023-10-06T03:15:52.389184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404625+0000","last_change":"2023-10-06T03:15:52.398846+0000","last_active":"2023-10-06T03:15:52.404625+0000","last_peered":"2023-10-06T03:15:52.404625+0000","last_clean":"2023-10-06T03:15:52.404625+0000","last_became_active":"2023-10-06T03:15:52.398603+0000","last_became_peered":"2023-10-06T03:15:52.398603+0000","last_unstale":"2023-10-06T03:15:52.404625+0000","last_undegraded":"2023-10-06T03:15:52.404625+0000","last_fullsized":"2023-10-06T03:15:52.404625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412777+0000","last_change":"2023-10-06T03:15:51.407297+0000","last_active":"2023-10-06T03:15:52.412777+0000","last_peered":"2023-10-06T03:15:52.412777+0000","last_clean":"2023-10-06T03:15:52.412777+0000","last_became_active":"2023-10-06T03:15:51.407027+0000","last_became_peered":"2023-10-06T03:15:51.407027+0000","last_unstale":"2023-10-06T03:15:52.412777+0000","last_undegraded":"2023-10-06T03:15:52.412777+0000","last_fullsized":"2023-10-06T03:15:52.412777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.595391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408429+0000","last_change":"2023-10-06T03:15:52.401694+0000","last_active":"2023-10-06T03:15:52.408429+0000","last_peered":"2023-10-06T03:15:52.408429+0000","last_clean":"2023-10-06T03:15:52.408429+0000","last_became_active":"2023-10-06T03:15:52.401416+0000","last_became_peered":"2023-10-06T03:15:52.401416+0000","last_unstale":"2023-10-06T03:15:52.408429+0000","last_undegraded":"2023-10-06T03:15:52.408429+0000","last_fullsized":"2023-10-06T03:15:52.408429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:01.423050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395011+0000","last_change":"2023-10-06T03:15:51.396237+0000","last_active":"2023-10-06T03:15:52.395011+0000","last_peered":"2023-10-06T03:15:52.395011+0000","last_clean":"2023-10-06T03:15:52.395011+0000","last_became_active":"2023-10-06T03:15:51.395961+0000","last_became_peered":"2023-10-06T03:15:51.395961+0000","last_unstale":"2023-10-06T03:15:52.395011+0000","last_undegraded":"2023-10-06T03:15:52.395011+0000","last_fullsized":"2023-10-06T03:15:52.395011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403024+0000","last_change":"2023-10-06T03:15:52.397196+0000","last_active":"2023-10-06T03:15:52.403024+0000","last_peered":"2023-10-06T03:15:52.403024+0000","last_clean":"2023-10-06T03:15:52.403024+0000","last_became_active":"2023-10-06T03:15:52.396909+0000","last_became_peered":"2023-10-06T03:15:52.396909+0000","last_unstale":"2023-10-06T03:15:52.403024+0000","last_undegraded":"2023-10-06T03:15:52.403024+0000","last_fullsized":"2023-10-06T03:15:52.403024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:04.891285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388015+0000","last_change":"2023-10-06T03:15:51.397413+0000","last_active":"2023-10-06T03:15:52.388015+0000","last_peered":"2023-10-06T03:15:52.388015+0000","last_clean":"2023-10-06T03:15:52.388015+0000","last_became_active":"2023-10-06T03:15:51.397074+0000","last_became_peered":"2023-10-06T03:15:51.397074+0000","last_unstale":"2023-10-06T03:15:52.388015+0000","last_undegraded":"2023-10-06T03:15:52.388015+0000","last_fullsized":"2023-10-06T03:15:52.388015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408667+0000","last_change":"2023-10-06T03:15:52.405384+0000","last_active":"2023-10-06T03:15:52.408667+0000","last_peered":"2023-10-06T03:15:52.408667+0000","last_clean":"2023-10-06T03:15:52.408667+0000","last_became_active":"2023-10-06T03:15:52.405148+0000","last_became_peered":"2023-10-06T03:15:52.405148+0000","last_unstale":"2023-10-06T03:15:52.408667+0000","last_undegraded":"2023-10-06T03:15:52.408667+0000","last_fullsized":"2023-10-06T03:15:52.408667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395105+0000","last_change":"2023-10-06T03:15:51.401070+0000","last_active":"2023-10-06T03:15:52.395105+0000","last_peered":"2023-10-06T03:15:52.395105+0000","last_clean":"2023-10-06T03:15:52.395105+0000","last_became_active":"2023-10-06T03:15:51.400536+0000","last_became_peered":"2023-10-06T03:15:51.400536+0000","last_unstale":"2023-10-06T03:15:52.395105+0000","last_undegraded":"2023-10-06T03:15:52.395105+0000","last_fullsized":"2023-10-06T03:15:52.395105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405811+0000","last_change":"2023-10-06T03:15:52.401281+0000","last_active":"2023-10-06T03:15:52.405811+0000","last_peered":"2023-10-06T03:15:52.405811+0000","last_clean":"2023-10-06T03:15:52.405811+0000","last_became_active":"2023-10-06T03:15:52.401028+0000","last_became_peered":"2023-10-06T03:15:52.401028+0000","last_unstale":"2023-10-06T03:15:52.405811+0000","last_undegraded":"2023-10-06T03:15:52.405811+0000","last_fullsized":"2023-10-06T03:15:52.405811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415300+0000","last_change":"2023-10-06T03:15:51.398105+0000","last_active":"2023-10-06T03:15:52.415300+0000","last_peered":"2023-10-06T03:15:52.415300+0000","last_clean":"2023-10-06T03:15:52.415300+0000","last_became_active":"2023-10-06T03:15:51.397877+0000","last_became_peered":"2023-10-06T03:15:51.397877+0000","last_unstale":"2023-10-06T03:15:52.415300+0000","last_undegraded":"2023-10-06T03:15:52.415300+0000","last_fullsized":"2023-10-06T03:15:52.415300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388474+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:15:52.388474+0000","last_peered":"2023-10-06T03:15:52.388474+0000","last_clean":"2023-10-06T03:15:52.388474+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:15:52.388474+0000","last_undegraded":"2023-10-06T03:15:52.388474+0000","last_fullsized":"2023-10-06T03:15:52.388474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412308+0000","last_change":"2023-10-06T03:15:52.407538+0000","last_active":"2023-10-06T03:15:52.412308+0000","last_peered":"2023-10-06T03:15:52.412308+0000","last_clean":"2023-10-06T03:15:52.412308+0000","last_became_active":"2023-10-06T03:15:52.407273+0000","last_became_peered":"2023-10-06T03:15:52.407273+0000","last_unstale":"2023-10-06T03:15:52.412308+0000","last_undegraded":"2023-10-06T03:15:52.412308+0000","last_fullsized":"2023-10-06T03:15:52.412308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:24.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392479+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:15:52.392479+0000","last_peered":"2023-10-06T03:15:52.392479+0000","last_clean":"2023-10-06T03:15:52.392479+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:15:52.392479+0000","last_undegraded":"2023-10-06T03:15:52.392479+0000","last_fullsized":"2023-10-06T03:15:52.392479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T03:15:53.835919+0000","last_change":"2023-10-06T03:15:51.399935+0000","last_active":"2023-10-06T03:15:53.835919+0000","last_peered":"2023-10-06T03:15:53.835919+0000","last_clean":"2023-10-06T03:15:53.835919+0000","last_became_active":"2023-10-06T03:15:51.399621+0000","last_became_peered":"2023-10-06T03:15:51.399621+0000","last_unstale":"2023-10-06T03:15:53.835919+0000","last_undegraded":"2023-10-06T03:15:53.835919+0000","last_fullsized":"2023-10-06T03:15:53.835919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396231+0000","last_change":"2023-10-06T03:15:52.390913+0000","last_active":"2023-10-06T03:15:52.396231+0000","last_peered":"2023-10-06T03:15:52.396231+0000","last_clean":"2023-10-06T03:15:52.396231+0000","last_became_active":"2023-10-06T03:15:52.390637+0000","last_became_peered":"2023-10-06T03:15:52.390637+0000","last_unstale":"2023-10-06T03:15:52.396231+0000","last_undegraded":"2023-10-06T03:15:52.396231+0000","last_fullsized":"2023-10-06T03:15:52.396231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:52.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396289+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:15:52.396289+0000","last_peered":"2023-10-06T03:15:52.396289+0000","last_clean":"2023-10-06T03:15:52.396289+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:15:52.396289+0000","last_undegraded":"2023-10-06T03:15:52.396289+0000","last_fullsized":"2023-10-06T03:15:52.396289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392848+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:15:52.392848+0000","last_peered":"2023-10-06T03:15:52.392848+0000","last_clean":"2023-10-06T03:15:52.392848+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:15:52.392848+0000","last_undegraded":"2023-10-06T03:15:52.392848+0000","last_fullsized":"2023-10-06T03:15:52.392848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385325+0000","last_change":"2023-10-06T03:15:51.396703+0000","last_active":"2023-10-06T03:15:52.385325+0000","last_peered":"2023-10-06T03:15:52.385325+0000","last_clean":"2023-10-06T03:15:52.385325+0000","last_became_active":"2023-10-06T03:15:51.396436+0000","last_became_peered":"2023-10-06T03:15:51.396436+0000","last_unstale":"2023-10-06T03:15:52.385325+0000","last_undegraded":"2023-10-06T03:15:52.385325+0000","last_fullsized":"2023-10-06T03:15:52.385325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404610+0000","last_change":"2023-10-06T03:15:52.399034+0000","last_active":"2023-10-06T03:15:52.404610+0000","last_peered":"2023-10-06T03:15:52.404610+0000","last_clean":"2023-10-06T03:15:52.404610+0000","last_became_active":"2023-10-06T03:15:52.398801+0000","last_became_peered":"2023-10-06T03:15:52.398801+0000","last_unstale":"2023-10-06T03:15:52.404610+0000","last_undegraded":"2023-10-06T03:15:52.404610+0000","last_fullsized":"2023-10-06T03:15:52.404610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.393310+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:15:52.393310+0000","last_peered":"2023-10-06T03:15:52.393310+0000","last_clean":"2023-10-06T03:15:52.393310+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:15:52.393310+0000","last_undegraded":"2023-10-06T03:15:52.393310+0000","last_fullsized":"2023-10-06T03:15:52.393310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395966+0000","last_change":"2023-10-06T03:15:51.397023+0000","last_active":"2023-10-06T03:15:52.395966+0000","last_peered":"2023-10-06T03:15:52.395966+0000","last_clean":"2023-10-06T03:15:52.395966+0000","last_became_active":"2023-10-06T03:15:51.396769+0000","last_became_peered":"2023-10-06T03:15:51.396769+0000","last_unstale":"2023-10-06T03:15:52.395966+0000","last_undegraded":"2023-10-06T03:15:52.395966+0000","last_fullsized":"2023-10-06T03:15:52.395966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402231+0000","last_change":"2023-10-06T03:15:52.397382+0000","last_active":"2023-10-06T03:15:52.402231+0000","last_peered":"2023-10-06T03:15:52.402231+0000","last_clean":"2023-10-06T03:15:52.402231+0000","last_became_active":"2023-10-06T03:15:52.397128+0000","last_became_peered":"2023-10-06T03:15:52.397128+0000","last_unstale":"2023-10-06T03:15:52.402231+0000","last_undegraded":"2023-10-06T03:15:52.402231+0000","last_fullsized":"2023-10-06T03:15:52.402231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392559+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:15:52.392559+0000","last_peered":"2023-10-06T03:15:52.392559+0000","last_clean":"2023-10-06T03:15:52.392559+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:15:52.392559+0000","last_undegraded":"2023-10-06T03:15:52.392559+0000","last_fullsized":"2023-10-06T03:15:52.392559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.394632+0000","last_change":"2023-10-06T03:15:51.401653+0000","last_active":"2023-10-06T03:15:52.394632+0000","last_peered":"2023-10-06T03:15:52.394632+0000","last_clean":"2023-10-06T03:15:52.394632+0000","last_became_active":"2023-10-06T03:15:51.401467+0000","last_became_peered":"2023-10-06T03:15:51.401467+0000","last_unstale":"2023-10-06T03:15:52.394632+0000","last_undegraded":"2023-10-06T03:15:52.394632+0000","last_fullsized":"2023-10-06T03:15:52.394632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407029+0000","last_change":"2023-10-06T03:15:52.399597+0000","last_active":"2023-10-06T03:15:52.407029+0000","last_peered":"2023-10-06T03:15:52.407029+0000","last_clean":"2023-10-06T03:15:52.407029+0000","last_became_active":"2023-10-06T03:15:52.399333+0000","last_became_peered":"2023-10-06T03:15:52.399333+0000","last_unstale":"2023-10-06T03:15:52.407029+0000","last_undegraded":"2023-10-06T03:15:52.407029+0000","last_fullsized":"2023-10-06T03:15:52.407029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:42.334791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388470+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:15:52.388470+0000","last_peered":"2023-10-06T03:15:52.388470+0000","last_clean":"2023-10-06T03:15:52.388470+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:15:52.388470+0000","last_undegraded":"2023-10-06T03:15:52.388470+0000","last_fullsized":"2023-10-06T03:15:52.388470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.387909+0000","last_change":"2023-10-06T03:15:51.397390+0000","last_active":"2023-10-06T03:15:52.387909+0000","last_peered":"2023-10-06T03:15:52.387909+0000","last_clean":"2023-10-06T03:15:52.387909+0000","last_became_active":"2023-10-06T03:15:51.397066+0000","last_became_peered":"2023-10-06T03:15:51.397066+0000","last_unstale":"2023-10-06T03:15:52.387909+0000","last_undegraded":"2023-10-06T03:15:52.387909+0000","last_fullsized":"2023-10-06T03:15:52.387909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402326+0000","last_change":"2023-10-06T03:15:52.397246+0000","last_active":"2023-10-06T03:15:52.402326+0000","last_peered":"2023-10-06T03:15:52.402326+0000","last_clean":"2023-10-06T03:15:52.402326+0000","last_became_active":"2023-10-06T03:15:52.396967+0000","last_became_peered":"2023-10-06T03:15:52.396967+0000","last_unstale":"2023-10-06T03:15:52.402326+0000","last_undegraded":"2023-10-06T03:15:52.402326+0000","last_fullsized":"2023-10-06T03:15:52.402326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:38.322802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.394796+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:15:52.394796+0000","last_peered":"2023-10-06T03:15:52.394796+0000","last_clean":"2023-10-06T03:15:52.394796+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:15:52.394796+0000","last_undegraded":"2023-10-06T03:15:52.394796+0000","last_fullsized":"2023-10-06T03:15:52.394796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396400+0000","last_change":"2023-10-06T03:15:51.398607+0000","last_active":"2023-10-06T03:15:52.396400+0000","last_peered":"2023-10-06T03:15:52.396400+0000","last_clean":"2023-10-06T03:15:52.396400+0000","last_became_active":"2023-10-06T03:15:51.398350+0000","last_became_peered":"2023-10-06T03:15:51.398350+0000","last_unstale":"2023-10-06T03:15:52.396400+0000","last_undegraded":"2023-10-06T03:15:52.396400+0000","last_fullsized":"2023-10-06T03:15:52.396400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396430+0000","last_change":"2023-10-06T03:15:52.390631+0000","last_active":"2023-10-06T03:15:52.396430+0000","last_peered":"2023-10-06T03:15:52.396430+0000","last_clean":"2023-10-06T03:15:52.396430+0000","last_became_active":"2023-10-06T03:15:52.390376+0000","last_became_peered":"2023-10-06T03:15:52.390376+0000","last_unstale":"2023-10-06T03:15:52.396430+0000","last_undegraded":"2023-10-06T03:15:52.396430+0000","last_fullsized":"2023-10-06T03:15:52.396430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:38.322802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395054+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:15:52.395054+0000","last_peered":"2023-10-06T03:15:52.395054+0000","last_clean":"2023-10-06T03:15:52.395054+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:15:52.395054+0000","last_undegraded":"2023-10-06T03:15:52.395054+0000","last_fullsized":"2023-10-06T03:15:52.395054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.389055+0000","last_change":"2023-10-06T03:15:51.398658+0000","last_active":"2023-10-06T03:15:52.389055+0000","last_peered":"2023-10-06T03:15:52.389055+0000","last_clean":"2023-10-06T03:15:52.389055+0000","last_became_active":"2023-10-06T03:15:51.397983+0000","last_became_peered":"2023-10-06T03:15:51.397983+0000","last_unstale":"2023-10-06T03:15:52.389055+0000","last_undegraded":"2023-10-06T03:15:52.389055+0000","last_fullsized":"2023-10-06T03:15:52.389055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402303+0000","last_change":"2023-10-06T03:15:52.397235+0000","last_active":"2023-10-06T03:15:52.402303+0000","last_peered":"2023-10-06T03:15:52.402303+0000","last_clean":"2023-10-06T03:15:52.402303+0000","last_became_active":"2023-10-06T03:15:52.396993+0000","last_became_peered":"2023-10-06T03:15:52.396993+0000","last_unstale":"2023-10-06T03:15:52.402303+0000","last_undegraded":"2023-10-06T03:15:52.402303+0000","last_fullsized":"2023-10-06T03:15:52.402303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418401+0000","last_change":"2023-10-06T03:15:51.396724+0000","last_active":"2023-10-06T03:15:52.418401+0000","last_peered":"2023-10-06T03:15:52.418401+0000","last_clean":"2023-10-06T03:15:52.418401+0000","last_became_active":"2023-10-06T03:15:51.396495+0000","last_became_peered":"2023-10-06T03:15:51.396495+0000","last_unstale":"2023-10-06T03:15:52.418401+0000","last_undegraded":"2023-10-06T03:15:52.418401+0000","last_fullsized":"2023-10-06T03:15:52.418401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404335+0000","last_change":"2023-10-06T03:15:52.399707+0000","last_active":"2023-10-06T03:15:52.404335+0000","last_peered":"2023-10-06T03:15:52.404335+0000","last_clean":"2023-10-06T03:15:52.404335+0000","last_became_active":"2023-10-06T03:15:52.399315+0000","last_became_peered":"2023-10-06T03:15:52.399315+0000","last_unstale":"2023-10-06T03:15:52.404335+0000","last_undegraded":"2023-10-06T03:15:52.404335+0000","last_fullsized":"2023-10-06T03:15:52.404335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:55.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412599+0000","last_change":"2023-10-06T03:15:51.394879+0000","last_active":"2023-10-06T03:15:52.412599+0000","last_peered":"2023-10-06T03:15:52.412599+0000","last_clean":"2023-10-06T03:15:52.412599+0000","last_became_active":"2023-10-06T03:15:51.394338+0000","last_became_peered":"2023-10-06T03:15:51.394338+0000","last_unstale":"2023-10-06T03:15:52.412599+0000","last_undegraded":"2023-10-06T03:15:52.412599+0000","last_fullsized":"2023-10-06T03:15:52.412599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407753+0000","last_change":"2023-10-06T03:15:52.400514+0000","last_active":"2023-10-06T03:15:52.407753+0000","last_peered":"2023-10-06T03:15:52.407753+0000","last_clean":"2023-10-06T03:15:52.407753+0000","last_became_active":"2023-10-06T03:15:52.399876+0000","last_became_peered":"2023-10-06T03:15:52.399876+0000","last_unstale":"2023-10-06T03:15:52.407753+0000","last_undegraded":"2023-10-06T03:15:52.407753+0000","last_fullsized":"2023-10-06T03:15:52.407753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:27.152523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412710+0000","last_change":"2023-10-06T03:15:51.394704+0000","last_active":"2023-10-06T03:15:52.412710+0000","last_peered":"2023-10-06T03:15:52.412710+0000","last_clean":"2023-10-06T03:15:52.412710+0000","last_became_active":"2023-10-06T03:15:51.394420+0000","last_became_peered":"2023-10-06T03:15:51.394420+0000","last_unstale":"2023-10-06T03:15:52.412710+0000","last_undegraded":"2023-10-06T03:15:52.412710+0000","last_fullsized":"2023-10-06T03:15:52.412710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408476+0000","last_change":"2023-10-06T03:15:52.401606+0000","last_active":"2023-10-06T03:15:52.408476+0000","last_peered":"2023-10-06T03:15:52.408476+0000","last_clean":"2023-10-06T03:15:52.408476+0000","last_became_active":"2023-10-06T03:15:52.401319+0000","last_became_peered":"2023-10-06T03:15:52.401319+0000","last_unstale":"2023-10-06T03:15:52.408476+0000","last_undegraded":"2023-10-06T03:15:52.408476+0000","last_fullsized":"2023-10-06T03:15:52.408476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:26.415006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.414847+0000","last_change":"2023-10-06T03:15:51.397229+0000","last_active":"2023-10-06T03:15:52.414847+0000","last_peered":"2023-10-06T03:15:52.414847+0000","last_clean":"2023-10-06T03:15:52.414847+0000","last_became_active":"2023-10-06T03:15:51.396971+0000","last_became_peered":"2023-10-06T03:15:51.396971+0000","last_unstale":"2023-10-06T03:15:52.414847+0000","last_undegraded":"2023-10-06T03:15:52.414847+0000","last_fullsized":"2023-10-06T03:15:52.414847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403707+0000","last_change":"2023-10-06T03:15:52.399759+0000","last_active":"2023-10-06T03:15:52.403707+0000","last_peered":"2023-10-06T03:15:52.403707+0000","last_clean":"2023-10-06T03:15:52.403707+0000","last_became_active":"2023-10-06T03:15:52.399459+0000","last_became_peered":"2023-10-06T03:15:52.399459+0000","last_unstale":"2023-10-06T03:15:52.403707+0000","last_undegraded":"2023-10-06T03:15:52.403707+0000","last_fullsized":"2023-10-06T03:15:52.403707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418238+0000","last_change":"2023-10-06T03:15:51.398436+0000","last_active":"2023-10-06T03:15:52.418238+0000","last_peered":"2023-10-06T03:15:52.418238+0000","last_clean":"2023-10-06T03:15:52.418238+0000","last_became_active":"2023-10-06T03:15:51.397582+0000","last_became_peered":"2023-10-06T03:15:51.397582+0000","last_unstale":"2023-10-06T03:15:52.418238+0000","last_undegraded":"2023-10-06T03:15:52.418238+0000","last_fullsized":"2023-10-06T03:15:52.418238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402534+0000","last_change":"2023-10-06T03:15:52.396983+0000","last_active":"2023-10-06T03:15:52.402534+0000","last_peered":"2023-10-06T03:15:52.402534+0000","last_clean":"2023-10-06T03:15:52.402534+0000","last_became_active":"2023-10-06T03:15:52.396686+0000","last_became_peered":"2023-10-06T03:15:52.396686+0000","last_unstale":"2023-10-06T03:15:52.402534+0000","last_undegraded":"2023-10-06T03:15:52.402534+0000","last_fullsized":"2023-10-06T03:15:52.402534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.410272+0000","last_change":"2023-10-06T03:15:52.402390+0000","last_active":"2023-10-06T03:15:52.410272+0000","last_peered":"2023-10-06T03:15:52.410272+0000","last_clean":"2023-10-06T03:15:52.410272+0000","last_became_active":"2023-10-06T03:15:52.402104+0000","last_became_peered":"2023-10-06T03:15:52.402104+0000","last_unstale":"2023-10-06T03:15:52.410272+0000","last_undegraded":"2023-10-06T03:15:52.410272+0000","last_fullsized":"2023-10-06T03:15:52.410272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403729+0000","last_change":"2023-10-06T03:15:52.400667+0000","last_active":"2023-10-06T03:15:52.403729+0000","last_peered":"2023-10-06T03:15:52.403729+0000","last_clean":"2023-10-06T03:15:52.403729+0000","last_became_active":"2023-10-06T03:15:52.399974+0000","last_became_peered":"2023-10-06T03:15:52.399974+0000","last_unstale":"2023-10-06T03:15:52.403729+0000","last_undegraded":"2023-10-06T03:15:52.403729+0000","last_fullsized":"2023-10-06T03:15:52.403729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:52.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408497+0000","last_change":"2023-10-06T03:15:52.404305+0000","last_active":"2023-10-06T03:15:52.408497+0000","last_peered":"2023-10-06T03:15:52.408497+0000","last_clean":"2023-10-06T03:15:52.408497+0000","last_became_active":"2023-10-06T03:15:52.403971+0000","last_became_peered":"2023-10-06T03:15:52.403971+0000","last_unstale":"2023-10-06T03:15:52.408497+0000","last_undegraded":"2023-10-06T03:15:52.408497+0000","last_fullsized":"2023-10-06T03:15:52.408497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.002827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412347+0000","last_change":"2023-10-06T03:15:52.407238+0000","last_active":"2023-10-06T03:15:52.412347+0000","last_peered":"2023-10-06T03:15:52.412347+0000","last_clean":"2023-10-06T03:15:52.412347+0000","last_became_active":"2023-10-06T03:15:52.406982+0000","last_became_peered":"2023-10-06T03:15:52.406982+0000","last_unstale":"2023-10-06T03:15:52.412347+0000","last_undegraded":"2023-10-06T03:15:52.412347+0000","last_fullsized":"2023-10-06T03:15:52.412347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409124+0000","last_change":"2023-10-06T03:15:52.402218+0000","last_active":"2023-10-06T03:15:52.409124+0000","last_peered":"2023-10-06T03:15:52.409124+0000","last_clean":"2023-10-06T03:15:52.409124+0000","last_became_active":"2023-10-06T03:15:52.401956+0000","last_became_peered":"2023-10-06T03:15:52.401956+0000","last_unstale":"2023-10-06T03:15:52.409124+0000","last_undegraded":"2023-10-06T03:15:52.409124+0000","last_fullsized":"2023-10-06T03:15:52.409124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":664951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:16:01.115 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:16:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.261+0000 7f630cc07700 1 Processor -- start 2023-10-06T03:16:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.261+0000 7f630cc07700 1 -- start start 2023-10-06T03:16:01.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.262+0000 7f630cc07700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63080b09a0 0x7f63080c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.262+0000 7f630cc07700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308159a90 0x7f63080c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.262+0000 7f630cc07700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630815e3a0 con 0x7f63081596c0 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.262+0000 7f630cc07700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63080cc470 con 0x7f63080b09a0 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.262+0000 7f630cc07700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630815db30 con 0x7f6308159a90 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.262+0000 7f6305d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63080b09a0 0x7f63080c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.262+0000 7f6305d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63080b09a0 0x7f63080c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43860/0 (socket says 172.21.15.82:43860) 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.262+0000 7f6305d9b700 1 -- 172.21.15.82:0/1480987696 learned_addr learned my addr 172.21.15.82:0/1480987696 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f6306d9d700 1 --2- 172.21.15.82:0/1480987696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308159a90 0x7f63080c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f6305d9b700 1 -- 172.21.15.82:0/1480987696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308159a90 msgr2=0x7f63080c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f6305d9b700 1 --2- 172.21.15.82:0/1480987696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308159a90 0x7f63080c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f6305d9b700 1 -- 172.21.15.82:0/1480987696 >> v1:172.21.15.134:6789/0 conn(0x7f63081596c0 legacy=0x7f630815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f6305d9b700 1 -- 172.21.15.82:0/1480987696 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630815dde0 con 0x7f63080b09a0 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f6306d9d700 1 --2- 172.21.15.82:0/1480987696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308159a90 0x7f63080c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f6305d9b700 1 --2- 172.21.15.82:0/1480987696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63080b09a0 0x7f63080c8a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0099b0 tx=0x7f62fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1578ce90869ffef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630559a700 1 -- 172.21.15.82:0/1480987696 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00b820 con 0x7f63080b09a0 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630559a700 1 -- 172.21.15.82:0/1480987696 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc00b980 con 0x7f63080b09a0 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630559a700 1 -- 172.21.15.82:0/1480987696 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00bd20 con 0x7f63080b09a0 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630cc07700 1 -- 172.21.15.82:0/1480987696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63080b09a0 msgr2=0x7f63080c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630cc07700 1 --2- 172.21.15.82:0/1480987696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63080b09a0 0x7f63080c8a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0099b0 tx=0x7f62fc009250 comp rx=0 tx=0).stop 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630cc07700 1 -- 172.21.15.82:0/1480987696 shutdown_connections 2023-10-06T03:16:01.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630cc07700 1 --2- 172.21.15.82:0/1480987696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308159a90 0x7f63080c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630cc07700 1 --2- 172.21.15.82:0/1480987696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63080b09a0 0x7f63080c8a40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630cc07700 1 -- 172.21.15.82:0/1480987696 >> 172.21.15.82:0/1480987696 conn(0x7f6308067630 msgr2=0x7f6308067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:01.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630cc07700 1 -- 172.21.15.82:0/1480987696 shutdown_connections 2023-10-06T03:16:01.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.263+0000 7f630cc07700 1 -- 172.21.15.82:0/1480987696 wait complete. 2023-10-06T03:16:01.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.264+0000 7f630cc07700 1 Processor -- start 2023-10-06T03:16:01.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630cc07700 1 -- start start 2023-10-06T03:16:01.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630cc07700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63081596c0 0x7f630815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630cc07700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6308159a90 0x7f63080c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630cc07700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308145900 0x7f6308145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630cc07700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63080c3b50 con 0x7f63081596c0 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630cc07700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630816d360 con 0x7f6308159a90 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630cc07700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630816d640 con 0x7f6308145900 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63081596c0 0x7f630815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63081596c0 0x7f630815a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43868/0 (socket says 172.21.15.82:43868) 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f630659c700 1 -- 172.21.15.82:0/4013389433 learned_addr learned my addr 172.21.15.82:0/4013389433 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f6305d9b700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6308159a90 0x7f63080c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.265+0000 7f6306d9d700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308145900 0x7f6308145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f630659c700 1 -- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308145900 msgr2=0x7f6308145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f630659c700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308145900 0x7f6308145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f630659c700 1 -- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6308159a90 msgr2=0x7f63080c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f630659c700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6308159a90 0x7f63080c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f630659c700 1 -- 172.21.15.82:0/4013389433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0094f0 con 0x7f63081596c0 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f630659c700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63081596c0 0x7f630815a940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f630000c950 tx=0x7f6300002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f62f67fc700 1 -- 172.21.15.82:0/4013389433 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630000a7e0 con 0x7f63081596c0 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f62f67fc700 1 -- 172.21.15.82:0/4013389433 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630000a940 con 0x7f63081596c0 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630816d920 con 0x7f63081596c0 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f62f67fc700 1 -- 172.21.15.82:0/4013389433 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630000ad00 con 0x7f63081596c0 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.266+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6308146280 con 0x7f63081596c0 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.267+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6308064050 con 0x7f63081596c0 2023-10-06T03:16:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.267+0000 7f62f67fc700 1 -- 172.21.15.82:0/4013389433 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6300012630 con 0x7f63081596c0 2023-10-06T03:16:01.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.267+0000 7f62f67fc700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f62e8066f30 0x7f62e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.268+0000 7f62f67fc700 1 -- 172.21.15.82:0/4013389433 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6300084b00 con 0x7f63081596c0 2023-10-06T03:16:01.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.268+0000 7f6305d9b700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f62e8066f30 0x7f62e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.268+0000 7f6305d9b700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f62e8066f30 0x7f62e80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63080b4580 tx=0x7f62fc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.272+0000 7f62f67fc700 1 -- 172.21.15.82:0/4013389433 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6300051c10 con 0x7f63081596c0 2023-10-06T03:16:01.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.447+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63080693e0 con 0x7f62e8066f30 2023-10-06T03:16:01.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.456+0000 7f62f67fc700 1 -- 172.21.15.82:0/4013389433 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286744 (secure 0 0 0) 0x7f63080693e0 con 0x7f62e8066f30 2023-10-06T03:16:01.461 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f62e8066f30 msgr2=0x7f62e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f62e8066f30 0x7f62e80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63080b4580 tx=0x7f62fc016000 comp rx=0 tx=0).stop 2023-10-06T03:16:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63081596c0 msgr2=0x7f630815a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63081596c0 0x7f630815a940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f630000c950 tx=0x7f6300002760 comp rx=0 tx=0).stop 2023-10-06T03:16:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 shutdown_connections 2023-10-06T03:16:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f62e8066f30 0x7f62e80693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6308145900 0x7f6308145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63081596c0 0x7f630815a940 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 --2- 172.21.15.82:0/4013389433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6308159a90 0x7f63080c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.459+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 >> 172.21.15.82:0/4013389433 conn(0x7f6308067630 msgr2=0x7f63080b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:01.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.460+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 shutdown_connections 2023-10-06T03:16:01.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.460+0000 7f630cc07700 1 -- 172.21.15.82:0/4013389433 wait complete. 2023-10-06T03:16:01.465 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:16:01.473 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-06T03:16:01.150319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381108,"kb_used_data":2804,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593612,"statfs":{"total":773094113280,"available":770655858688,"internally_reserved":0,"allocated":2871296,"data_stored":1772055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.766189"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405704+0000","last_change":"2023-10-06T03:15:52.401448+0000","last_active":"2023-10-06T03:15:52.405704+0000","last_peered":"2023-10-06T03:15:52.405704+0000","last_clean":"2023-10-06T03:15:52.405704+0000","last_became_active":"2023-10-06T03:15:52.401163+0000","last_became_peered":"2023-10-06T03:15:52.401163+0000","last_unstale":"2023-10-06T03:15:52.405704+0000","last_undegraded":"2023-10-06T03:15:52.405704+0000","last_fullsized":"2023-10-06T03:15:52.405704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:12.727676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407826+0000","last_change":"2023-10-06T03:15:52.400840+0000","last_active":"2023-10-06T03:15:52.407826+0000","last_peered":"2023-10-06T03:15:52.407826+0000","last_clean":"2023-10-06T03:15:52.407826+0000","last_became_active":"2023-10-06T03:15:52.400551+0000","last_became_peered":"2023-10-06T03:15:52.400551+0000","last_unstale":"2023-10-06T03:15:52.407826+0000","last_undegraded":"2023-10-06T03:15:52.407826+0000","last_fullsized":"2023-10-06T03:15:52.407826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403045+0000","last_change":"2023-10-06T03:15:52.397230+0000","last_active":"2023-10-06T03:15:52.403045+0000","last_peered":"2023-10-06T03:15:52.403045+0000","last_clean":"2023-10-06T03:15:52.403045+0000","last_became_active":"2023-10-06T03:15:52.396958+0000","last_became_peered":"2023-10-06T03:15:52.396958+0000","last_unstale":"2023-10-06T03:15:52.403045+0000","last_undegraded":"2023-10-06T03:15:52.403045+0000","last_fullsized":"2023-10-06T03:15:52.403045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:36.699116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408300+0000","last_change":"2023-10-06T03:15:52.402222+0000","last_active":"2023-10-06T03:15:52.408300+0000","last_peered":"2023-10-06T03:15:52.408300+0000","last_clean":"2023-10-06T03:15:52.408300+0000","last_became_active":"2023-10-06T03:15:52.401929+0000","last_became_peered":"2023-10-06T03:15:52.401929+0000","last_unstale":"2023-10-06T03:15:52.408300+0000","last_undegraded":"2023-10-06T03:15:52.408300+0000","last_fullsized":"2023-10-06T03:15:52.408300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:27.381001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409687+0000","last_change":"2023-10-06T03:15:52.402998+0000","last_active":"2023-10-06T03:15:52.409687+0000","last_peered":"2023-10-06T03:15:52.409687+0000","last_clean":"2023-10-06T03:15:52.409687+0000","last_became_active":"2023-10-06T03:15:52.402744+0000","last_became_peered":"2023-10-06T03:15:52.402744+0000","last_unstale":"2023-10-06T03:15:52.409687+0000","last_undegraded":"2023-10-06T03:15:52.409687+0000","last_fullsized":"2023-10-06T03:15:52.409687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407765+0000","last_change":"2023-10-06T03:15:52.400543+0000","last_active":"2023-10-06T03:15:52.407765+0000","last_peered":"2023-10-06T03:15:52.407765+0000","last_clean":"2023-10-06T03:15:52.407765+0000","last_became_active":"2023-10-06T03:15:52.400234+0000","last_became_peered":"2023-10-06T03:15:52.400234+0000","last_unstale":"2023-10-06T03:15:52.407765+0000","last_undegraded":"2023-10-06T03:15:52.407765+0000","last_fullsized":"2023-10-06T03:15:52.407765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:22.091211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415196+0000","last_change":"2023-10-06T03:15:52.411636+0000","last_active":"2023-10-06T03:15:52.415196+0000","last_peered":"2023-10-06T03:15:52.415196+0000","last_clean":"2023-10-06T03:15:52.415196+0000","last_became_active":"2023-10-06T03:15:52.410475+0000","last_became_peered":"2023-10-06T03:15:52.410475+0000","last_unstale":"2023-10-06T03:15:52.415196+0000","last_undegraded":"2023-10-06T03:15:52.415196+0000","last_fullsized":"2023-10-06T03:15:52.415196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395701+0000","last_change":"2023-10-06T03:15:52.391661+0000","last_active":"2023-10-06T03:15:52.395701+0000","last_peered":"2023-10-06T03:15:52.395701+0000","last_clean":"2023-10-06T03:15:52.395701+0000","last_became_active":"2023-10-06T03:15:52.390749+0000","last_became_peered":"2023-10-06T03:15:52.390749+0000","last_unstale":"2023-10-06T03:15:52.395701+0000","last_undegraded":"2023-10-06T03:15:52.395701+0000","last_fullsized":"2023-10-06T03:15:52.395701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409753+0000","last_change":"2023-10-06T03:15:52.403195+0000","last_active":"2023-10-06T03:15:52.409753+0000","last_peered":"2023-10-06T03:15:52.409753+0000","last_clean":"2023-10-06T03:15:52.409753+0000","last_became_active":"2023-10-06T03:15:52.402869+0000","last_became_peered":"2023-10-06T03:15:52.402869+0000","last_unstale":"2023-10-06T03:15:52.409753+0000","last_undegraded":"2023-10-06T03:15:52.409753+0000","last_fullsized":"2023-10-06T03:15:52.409753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:35.985027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.401152+0000","last_change":"2023-10-06T03:15:52.395407+0000","last_active":"2023-10-06T03:15:52.401152+0000","last_peered":"2023-10-06T03:15:52.401152+0000","last_clean":"2023-10-06T03:15:52.401152+0000","last_became_active":"2023-10-06T03:15:52.395152+0000","last_became_peered":"2023-10-06T03:15:52.395152+0000","last_unstale":"2023-10-06T03:15:52.401152+0000","last_undegraded":"2023-10-06T03:15:52.401152+0000","last_fullsized":"2023-10-06T03:15:52.401152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407807+0000","last_change":"2023-10-06T03:15:52.399379+0000","last_active":"2023-10-06T03:15:52.407807+0000","last_peered":"2023-10-06T03:15:52.407807+0000","last_clean":"2023-10-06T03:15:52.407807+0000","last_became_active":"2023-10-06T03:15:52.399116+0000","last_became_peered":"2023-10-06T03:15:52.399116+0000","last_unstale":"2023-10-06T03:15:52.407807+0000","last_undegraded":"2023-10-06T03:15:52.407807+0000","last_fullsized":"2023-10-06T03:15:52.407807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:24.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404234+0000","last_change":"2023-10-06T03:15:52.398110+0000","last_active":"2023-10-06T03:15:52.404234+0000","last_peered":"2023-10-06T03:15:52.404234+0000","last_clean":"2023-10-06T03:15:52.404234+0000","last_became_active":"2023-10-06T03:15:52.397691+0000","last_became_peered":"2023-10-06T03:15:52.397691+0000","last_unstale":"2023-10-06T03:15:52.404234+0000","last_undegraded":"2023-10-06T03:15:52.404234+0000","last_fullsized":"2023-10-06T03:15:52.404234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:20.541949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405781+0000","last_change":"2023-10-06T03:15:52.401787+0000","last_active":"2023-10-06T03:15:52.405781+0000","last_peered":"2023-10-06T03:15:52.405781+0000","last_clean":"2023-10-06T03:15:52.405781+0000","last_became_active":"2023-10-06T03:15:52.400804+0000","last_became_peered":"2023-10-06T03:15:52.400804+0000","last_unstale":"2023-10-06T03:15:52.405781+0000","last_undegraded":"2023-10-06T03:15:52.405781+0000","last_fullsized":"2023-10-06T03:15:52.405781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:00.679276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402120+0000","last_change":"2023-10-06T03:15:52.396439+0000","last_active":"2023-10-06T03:15:52.402120+0000","last_peered":"2023-10-06T03:15:52.402120+0000","last_clean":"2023-10-06T03:15:52.402120+0000","last_became_active":"2023-10-06T03:15:52.396218+0000","last_became_peered":"2023-10-06T03:15:52.396218+0000","last_unstale":"2023-10-06T03:15:52.402120+0000","last_undegraded":"2023-10-06T03:15:52.402120+0000","last_fullsized":"2023-10-06T03:15:52.402120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413375+0000","last_change":"2023-10-06T03:15:52.401847+0000","last_active":"2023-10-06T03:15:52.413375+0000","last_peered":"2023-10-06T03:15:52.413375+0000","last_clean":"2023-10-06T03:15:52.413375+0000","last_became_active":"2023-10-06T03:15:52.401531+0000","last_became_peered":"2023-10-06T03:15:52.401531+0000","last_unstale":"2023-10-06T03:15:52.413375+0000","last_undegraded":"2023-10-06T03:15:52.413375+0000","last_fullsized":"2023-10-06T03:15:52.413375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.398194+0000","last_change":"2023-10-06T03:15:52.394021+0000","last_active":"2023-10-06T03:15:52.398194+0000","last_peered":"2023-10-06T03:15:52.398194+0000","last_clean":"2023-10-06T03:15:52.398194+0000","last_became_active":"2023-10-06T03:15:52.393712+0000","last_became_peered":"2023-10-06T03:15:52.393712+0000","last_unstale":"2023-10-06T03:15:52.398194+0000","last_undegraded":"2023-10-06T03:15:52.398194+0000","last_fullsized":"2023-10-06T03:15:52.398194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:10.769614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409766+0000","last_change":"2023-10-06T03:15:52.404215+0000","last_active":"2023-10-06T03:15:52.409766+0000","last_peered":"2023-10-06T03:15:52.409766+0000","last_clean":"2023-10-06T03:15:52.409766+0000","last_became_active":"2023-10-06T03:15:52.403876+0000","last_became_peered":"2023-10-06T03:15:52.403876+0000","last_unstale":"2023-10-06T03:15:52.409766+0000","last_undegraded":"2023-10-06T03:15:52.409766+0000","last_fullsized":"2023-10-06T03:15:52.409766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407690+0000","last_change":"2023-10-06T03:15:52.397291+0000","last_active":"2023-10-06T03:15:52.407690+0000","last_peered":"2023-10-06T03:15:52.407690+0000","last_clean":"2023-10-06T03:15:52.407690+0000","last_became_active":"2023-10-06T03:15:52.397010+0000","last_became_peered":"2023-10-06T03:15:52.397010+0000","last_unstale":"2023-10-06T03:15:52.407690+0000","last_undegraded":"2023-10-06T03:15:52.407690+0000","last_fullsized":"2023-10-06T03:15:52.407690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409687+0000","last_change":"2023-10-06T03:15:52.403844+0000","last_active":"2023-10-06T03:15:52.409687+0000","last_peered":"2023-10-06T03:15:52.409687+0000","last_clean":"2023-10-06T03:15:52.409687+0000","last_became_active":"2023-10-06T03:15:52.403593+0000","last_became_peered":"2023-10-06T03:15:52.403593+0000","last_unstale":"2023-10-06T03:15:52.409687+0000","last_undegraded":"2023-10-06T03:15:52.409687+0000","last_fullsized":"2023-10-06T03:15:52.409687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:23.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408446+0000","last_change":"2023-10-06T03:15:52.404280+0000","last_active":"2023-10-06T03:15:52.408446+0000","last_peered":"2023-10-06T03:15:52.408446+0000","last_clean":"2023-10-06T03:15:52.408446+0000","last_became_active":"2023-10-06T03:15:52.403932+0000","last_became_peered":"2023-10-06T03:15:52.403932+0000","last_unstale":"2023-10-06T03:15:52.408446+0000","last_undegraded":"2023-10-06T03:15:52.408446+0000","last_fullsized":"2023-10-06T03:15:52.408446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415370+0000","last_change":"2023-10-06T03:15:52.412076+0000","last_active":"2023-10-06T03:15:52.415370+0000","last_peered":"2023-10-06T03:15:52.415370+0000","last_clean":"2023-10-06T03:15:52.415370+0000","last_became_active":"2023-10-06T03:15:52.410526+0000","last_became_peered":"2023-10-06T03:15:52.410526+0000","last_unstale":"2023-10-06T03:15:52.415370+0000","last_undegraded":"2023-10-06T03:15:52.415370+0000","last_fullsized":"2023-10-06T03:15:52.415370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404668+0000","last_change":"2023-10-06T03:15:52.399635+0000","last_active":"2023-10-06T03:15:52.404668+0000","last_peered":"2023-10-06T03:15:52.404668+0000","last_clean":"2023-10-06T03:15:52.404668+0000","last_became_active":"2023-10-06T03:15:52.399371+0000","last_became_peered":"2023-10-06T03:15:52.399371+0000","last_unstale":"2023-10-06T03:15:52.404668+0000","last_undegraded":"2023-10-06T03:15:52.404668+0000","last_fullsized":"2023-10-06T03:15:52.404668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404276+0000","last_change":"2023-10-06T03:15:52.401220+0000","last_active":"2023-10-06T03:15:52.404276+0000","last_peered":"2023-10-06T03:15:52.404276+0000","last_clean":"2023-10-06T03:15:52.404276+0000","last_became_active":"2023-10-06T03:15:52.400120+0000","last_became_peered":"2023-10-06T03:15:52.400120+0000","last_unstale":"2023-10-06T03:15:52.404276+0000","last_undegraded":"2023-10-06T03:15:52.404276+0000","last_fullsized":"2023-10-06T03:15:52.404276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413306+0000","last_change":"2023-10-06T03:15:52.401474+0000","last_active":"2023-10-06T03:15:52.413306+0000","last_peered":"2023-10-06T03:15:52.413306+0000","last_clean":"2023-10-06T03:15:52.413306+0000","last_became_active":"2023-10-06T03:15:52.401210+0000","last_became_peered":"2023-10-06T03:15:52.401210+0000","last_unstale":"2023-10-06T03:15:52.413306+0000","last_undegraded":"2023-10-06T03:15:52.413306+0000","last_fullsized":"2023-10-06T03:15:52.413306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409165+0000","last_change":"2023-10-06T03:15:52.402928+0000","last_active":"2023-10-06T03:15:52.409165+0000","last_peered":"2023-10-06T03:15:52.409165+0000","last_clean":"2023-10-06T03:15:52.409165+0000","last_became_active":"2023-10-06T03:15:52.402659+0000","last_became_peered":"2023-10-06T03:15:52.402659+0000","last_unstale":"2023-10-06T03:15:52.409165+0000","last_undegraded":"2023-10-06T03:15:52.409165+0000","last_fullsized":"2023-10-06T03:15:52.409165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:27.381001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405592+0000","last_change":"2023-10-06T03:15:52.398134+0000","last_active":"2023-10-06T03:15:52.405592+0000","last_peered":"2023-10-06T03:15:52.405592+0000","last_clean":"2023-10-06T03:15:52.405592+0000","last_became_active":"2023-10-06T03:15:52.397881+0000","last_became_peered":"2023-10-06T03:15:52.397881+0000","last_unstale":"2023-10-06T03:15:52.405592+0000","last_undegraded":"2023-10-06T03:15:52.405592+0000","last_fullsized":"2023-10-06T03:15:52.405592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:30.488004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412503+0000","last_change":"2023-10-06T03:15:52.403876+0000","last_active":"2023-10-06T03:15:52.412503+0000","last_peered":"2023-10-06T03:15:52.412503+0000","last_clean":"2023-10-06T03:15:52.412503+0000","last_became_active":"2023-10-06T03:15:52.403598+0000","last_became_peered":"2023-10-06T03:15:52.403598+0000","last_unstale":"2023-10-06T03:15:52.412503+0000","last_undegraded":"2023-10-06T03:15:52.412503+0000","last_fullsized":"2023-10-06T03:15:52.412503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.413297+0000","last_change":"2023-10-06T03:15:51.399470+0000","last_active":"2023-10-06T03:15:52.413297+0000","last_peered":"2023-10-06T03:15:52.413297+0000","last_clean":"2023-10-06T03:15:52.413297+0000","last_became_active":"2023-10-06T03:15:51.399099+0000","last_became_peered":"2023-10-06T03:15:51.399099+0000","last_unstale":"2023-10-06T03:15:52.413297+0000","last_undegraded":"2023-10-06T03:15:52.413297+0000","last_fullsized":"2023-10-06T03:15:52.413297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403880+0000","last_change":"2023-10-06T03:15:52.400465+0000","last_active":"2023-10-06T03:15:52.403880+0000","last_peered":"2023-10-06T03:15:52.403880+0000","last_clean":"2023-10-06T03:15:52.403880+0000","last_became_active":"2023-10-06T03:15:52.400175+0000","last_became_peered":"2023-10-06T03:15:52.400175+0000","last_unstale":"2023-10-06T03:15:52.403880+0000","last_undegraded":"2023-10-06T03:15:52.403880+0000","last_fullsized":"2023-10-06T03:15:52.403880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:35.985027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396234+0000","last_change":"2023-10-06T03:15:51.401117+0000","last_active":"2023-10-06T03:15:52.396234+0000","last_peered":"2023-10-06T03:15:52.396234+0000","last_clean":"2023-10-06T03:15:52.396234+0000","last_became_active":"2023-10-06T03:15:51.400839+0000","last_became_peered":"2023-10-06T03:15:51.400839+0000","last_unstale":"2023-10-06T03:15:52.396234+0000","last_undegraded":"2023-10-06T03:15:52.396234+0000","last_fullsized":"2023-10-06T03:15:52.396234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:36.643445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404590+0000","last_change":"2023-10-06T03:15:52.398565+0000","last_active":"2023-10-06T03:15:52.404590+0000","last_peered":"2023-10-06T03:15:52.404590+0000","last_clean":"2023-10-06T03:15:52.404590+0000","last_became_active":"2023-10-06T03:15:52.398307+0000","last_became_peered":"2023-10-06T03:15:52.398307+0000","last_unstale":"2023-10-06T03:15:52.404590+0000","last_undegraded":"2023-10-06T03:15:52.404590+0000","last_fullsized":"2023-10-06T03:15:52.404590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.391829+0000","last_change":"2023-10-06T03:15:51.398624+0000","last_active":"2023-10-06T03:15:52.391829+0000","last_peered":"2023-10-06T03:15:52.391829+0000","last_clean":"2023-10-06T03:15:52.391829+0000","last_became_active":"2023-10-06T03:15:51.398391+0000","last_became_peered":"2023-10-06T03:15:51.398391+0000","last_unstale":"2023-10-06T03:15:52.391829+0000","last_undegraded":"2023-10-06T03:15:52.391829+0000","last_fullsized":"2023-10-06T03:15:52.391829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407778+0000","last_change":"2023-10-06T03:15:52.401764+0000","last_active":"2023-10-06T03:15:52.407778+0000","last_peered":"2023-10-06T03:15:52.407778+0000","last_clean":"2023-10-06T03:15:52.407778+0000","last_became_active":"2023-10-06T03:15:52.401456+0000","last_became_peered":"2023-10-06T03:15:52.401456+0000","last_unstale":"2023-10-06T03:15:52.407778+0000","last_undegraded":"2023-10-06T03:15:52.407778+0000","last_fullsized":"2023-10-06T03:15:52.407778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:31.512733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.386122+0000","last_change":"2023-10-06T03:15:51.397770+0000","last_active":"2023-10-06T03:15:52.386122+0000","last_peered":"2023-10-06T03:15:52.386122+0000","last_clean":"2023-10-06T03:15:52.386122+0000","last_became_active":"2023-10-06T03:15:51.396623+0000","last_became_peered":"2023-10-06T03:15:51.396623+0000","last_unstale":"2023-10-06T03:15:52.386122+0000","last_undegraded":"2023-10-06T03:15:52.386122+0000","last_fullsized":"2023-10-06T03:15:52.386122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.401114+0000","last_change":"2023-10-06T03:15:52.399019+0000","last_active":"2023-10-06T03:15:52.401114+0000","last_peered":"2023-10-06T03:15:52.401114+0000","last_clean":"2023-10-06T03:15:52.401114+0000","last_became_active":"2023-10-06T03:15:52.398286+0000","last_became_peered":"2023-10-06T03:15:52.398286+0000","last_unstale":"2023-10-06T03:15:52.401114+0000","last_undegraded":"2023-10-06T03:15:52.401114+0000","last_fullsized":"2023-10-06T03:15:52.401114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:48.612711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388731+0000","last_change":"2023-10-06T03:15:51.397296+0000","last_active":"2023-10-06T03:15:52.388731+0000","last_peered":"2023-10-06T03:15:52.388731+0000","last_clean":"2023-10-06T03:15:52.388731+0000","last_became_active":"2023-10-06T03:15:51.397042+0000","last_became_peered":"2023-10-06T03:15:51.397042+0000","last_unstale":"2023-10-06T03:15:52.388731+0000","last_undegraded":"2023-10-06T03:15:52.388731+0000","last_fullsized":"2023-10-06T03:15:52.388731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412296+0000","last_change":"2023-10-06T03:15:52.407501+0000","last_active":"2023-10-06T03:15:52.412296+0000","last_peered":"2023-10-06T03:15:52.412296+0000","last_clean":"2023-10-06T03:15:52.412296+0000","last_became_active":"2023-10-06T03:15:52.407276+0000","last_became_peered":"2023-10-06T03:15:52.407276+0000","last_unstale":"2023-10-06T03:15:52.412296+0000","last_undegraded":"2023-10-06T03:15:52.412296+0000","last_fullsized":"2023-10-06T03:15:52.412296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.952236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418342+0000","last_change":"2023-10-06T03:15:51.401981+0000","last_active":"2023-10-06T03:15:52.418342+0000","last_peered":"2023-10-06T03:15:52.418342+0000","last_clean":"2023-10-06T03:15:52.418342+0000","last_became_active":"2023-10-06T03:15:51.401737+0000","last_became_peered":"2023-10-06T03:15:51.401737+0000","last_unstale":"2023-10-06T03:15:52.418342+0000","last_undegraded":"2023-10-06T03:15:52.418342+0000","last_fullsized":"2023-10-06T03:15:52.418342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409103+0000","last_change":"2023-10-06T03:15:52.402215+0000","last_active":"2023-10-06T03:15:52.409103+0000","last_peered":"2023-10-06T03:15:52.409103+0000","last_clean":"2023-10-06T03:15:52.409103+0000","last_became_active":"2023-10-06T03:15:52.401984+0000","last_became_peered":"2023-10-06T03:15:52.401984+0000","last_unstale":"2023-10-06T03:15:52.409103+0000","last_undegraded":"2023-10-06T03:15:52.409103+0000","last_fullsized":"2023-10-06T03:15:52.409103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.420512+0000","last_change":"2023-10-06T03:15:51.398687+0000","last_active":"2023-10-06T03:15:52.420512+0000","last_peered":"2023-10-06T03:15:52.420512+0000","last_clean":"2023-10-06T03:15:52.420512+0000","last_became_active":"2023-10-06T03:15:51.398419+0000","last_became_peered":"2023-10-06T03:15:51.398419+0000","last_unstale":"2023-10-06T03:15:52.420512+0000","last_undegraded":"2023-10-06T03:15:52.420512+0000","last_fullsized":"2023-10-06T03:15:52.420512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408183+0000","last_change":"2023-10-06T03:15:52.404174+0000","last_active":"2023-10-06T03:15:52.408183+0000","last_peered":"2023-10-06T03:15:52.408183+0000","last_clean":"2023-10-06T03:15:52.408183+0000","last_became_active":"2023-10-06T03:15:52.403892+0000","last_became_peered":"2023-10-06T03:15:52.403892+0000","last_unstale":"2023-10-06T03:15:52.408183+0000","last_undegraded":"2023-10-06T03:15:52.408183+0000","last_fullsized":"2023-10-06T03:15:52.408183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:48.612711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418455+0000","last_change":"2023-10-06T03:15:51.399272+0000","last_active":"2023-10-06T03:15:52.418455+0000","last_peered":"2023-10-06T03:15:52.418455+0000","last_clean":"2023-10-06T03:15:52.418455+0000","last_became_active":"2023-10-06T03:15:51.398980+0000","last_became_peered":"2023-10-06T03:15:51.398980+0000","last_unstale":"2023-10-06T03:15:52.418455+0000","last_undegraded":"2023-10-06T03:15:52.418455+0000","last_fullsized":"2023-10-06T03:15:52.418455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:30.507247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403724+0000","last_change":"2023-10-06T03:15:52.400547+0000","last_active":"2023-10-06T03:15:52.403724+0000","last_peered":"2023-10-06T03:15:52.403724+0000","last_clean":"2023-10-06T03:15:52.403724+0000","last_became_active":"2023-10-06T03:15:52.400318+0000","last_became_peered":"2023-10-06T03:15:52.400318+0000","last_unstale":"2023-10-06T03:15:52.403724+0000","last_undegraded":"2023-10-06T03:15:52.403724+0000","last_fullsized":"2023-10-06T03:15:52.403724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:04.891285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385392+0000","last_change":"2023-10-06T03:15:51.397316+0000","last_active":"2023-10-06T03:15:52.385392+0000","last_peered":"2023-10-06T03:15:52.385392+0000","last_clean":"2023-10-06T03:15:52.385392+0000","last_became_active":"2023-10-06T03:15:51.397057+0000","last_became_peered":"2023-10-06T03:15:51.397057+0000","last_unstale":"2023-10-06T03:15:52.385392+0000","last_undegraded":"2023-10-06T03:15:52.385392+0000","last_fullsized":"2023-10-06T03:15:52.385392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412525+0000","last_change":"2023-10-06T03:15:52.404046+0000","last_active":"2023-10-06T03:15:52.412525+0000","last_peered":"2023-10-06T03:15:52.412525+0000","last_clean":"2023-10-06T03:15:52.412525+0000","last_became_active":"2023-10-06T03:15:52.403608+0000","last_became_peered":"2023-10-06T03:15:52.403608+0000","last_unstale":"2023-10-06T03:15:52.412525+0000","last_undegraded":"2023-10-06T03:15:52.412525+0000","last_fullsized":"2023-10-06T03:15:52.412525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.393335+0000","last_change":"2023-10-06T03:15:51.400696+0000","last_active":"2023-10-06T03:15:52.393335+0000","last_peered":"2023-10-06T03:15:52.393335+0000","last_clean":"2023-10-06T03:15:52.393335+0000","last_became_active":"2023-10-06T03:15:51.400423+0000","last_became_peered":"2023-10-06T03:15:51.400423+0000","last_unstale":"2023-10-06T03:15:52.393335+0000","last_undegraded":"2023-10-06T03:15:52.393335+0000","last_fullsized":"2023-10-06T03:15:52.393335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:47.458357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409679+0000","last_change":"2023-10-06T03:15:52.402973+0000","last_active":"2023-10-06T03:15:52.409679+0000","last_peered":"2023-10-06T03:15:52.409679+0000","last_clean":"2023-10-06T03:15:52.409679+0000","last_became_active":"2023-10-06T03:15:52.402707+0000","last_became_peered":"2023-10-06T03:15:52.402707+0000","last_unstale":"2023-10-06T03:15:52.409679+0000","last_undegraded":"2023-10-06T03:15:52.409679+0000","last_fullsized":"2023-10-06T03:15:52.409679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418712+0000","last_change":"2023-10-06T03:15:51.398207+0000","last_active":"2023-10-06T03:15:52.418712+0000","last_peered":"2023-10-06T03:15:52.418712+0000","last_clean":"2023-10-06T03:15:52.418712+0000","last_became_active":"2023-10-06T03:15:51.397903+0000","last_became_peered":"2023-10-06T03:15:51.397903+0000","last_unstale":"2023-10-06T03:15:52.418712+0000","last_undegraded":"2023-10-06T03:15:52.418712+0000","last_fullsized":"2023-10-06T03:15:52.418712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415171+0000","last_change":"2023-10-06T03:15:52.411310+0000","last_active":"2023-10-06T03:15:52.415171+0000","last_peered":"2023-10-06T03:15:52.415171+0000","last_clean":"2023-10-06T03:15:52.415171+0000","last_became_active":"2023-10-06T03:15:52.411060+0000","last_became_peered":"2023-10-06T03:15:52.411060+0000","last_unstale":"2023-10-06T03:15:52.415171+0000","last_undegraded":"2023-10-06T03:15:52.415171+0000","last_fullsized":"2023-10-06T03:15:52.415171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418008+0000","last_change":"2023-10-06T03:15:51.399461+0000","last_active":"2023-10-06T03:15:52.418008+0000","last_peered":"2023-10-06T03:15:52.418008+0000","last_clean":"2023-10-06T03:15:52.418008+0000","last_became_active":"2023-10-06T03:15:51.398657+0000","last_became_peered":"2023-10-06T03:15:51.398657+0000","last_unstale":"2023-10-06T03:15:52.418008+0000","last_undegraded":"2023-10-06T03:15:52.418008+0000","last_fullsized":"2023-10-06T03:15:52.418008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.595391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412382+0000","last_change":"2023-10-06T03:15:52.401919+0000","last_active":"2023-10-06T03:15:52.412382+0000","last_peered":"2023-10-06T03:15:52.412382+0000","last_clean":"2023-10-06T03:15:52.412382+0000","last_became_active":"2023-10-06T03:15:52.401624+0000","last_became_peered":"2023-10-06T03:15:52.401624+0000","last_unstale":"2023-10-06T03:15:52.412382+0000","last_undegraded":"2023-10-06T03:15:52.412382+0000","last_fullsized":"2023-10-06T03:15:52.412382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418041+0000","last_change":"2023-10-06T03:15:51.399919+0000","last_active":"2023-10-06T03:15:52.418041+0000","last_peered":"2023-10-06T03:15:52.418041+0000","last_clean":"2023-10-06T03:15:52.418041+0000","last_became_active":"2023-10-06T03:15:51.399678+0000","last_became_peered":"2023-10-06T03:15:51.399678+0000","last_unstale":"2023-10-06T03:15:52.418041+0000","last_undegraded":"2023-10-06T03:15:52.418041+0000","last_fullsized":"2023-10-06T03:15:52.418041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:57.295789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.406812+0000","last_change":"2023-10-06T03:15:52.397998+0000","last_active":"2023-10-06T03:15:52.406812+0000","last_peered":"2023-10-06T03:15:52.406812+0000","last_clean":"2023-10-06T03:15:52.406812+0000","last_became_active":"2023-10-06T03:15:52.397706+0000","last_became_peered":"2023-10-06T03:15:52.397706+0000","last_unstale":"2023-10-06T03:15:52.406812+0000","last_undegraded":"2023-10-06T03:15:52.406812+0000","last_fullsized":"2023-10-06T03:15:52.406812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:32.121745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.417854+0000","last_change":"2023-10-06T03:15:51.401427+0000","last_active":"2023-10-06T03:15:52.417854+0000","last_peered":"2023-10-06T03:15:52.417854+0000","last_clean":"2023-10-06T03:15:52.417854+0000","last_became_active":"2023-10-06T03:15:51.401124+0000","last_became_peered":"2023-10-06T03:15:51.401124+0000","last_unstale":"2023-10-06T03:15:52.417854+0000","last_undegraded":"2023-10-06T03:15:52.417854+0000","last_fullsized":"2023-10-06T03:15:52.417854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:41.329304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407021+0000","last_change":"2023-10-06T03:15:52.398501+0000","last_active":"2023-10-06T03:15:52.407021+0000","last_peered":"2023-10-06T03:15:52.407021+0000","last_clean":"2023-10-06T03:15:52.407021+0000","last_became_active":"2023-10-06T03:15:52.398218+0000","last_became_peered":"2023-10-06T03:15:52.398218+0000","last_unstale":"2023-10-06T03:15:52.407021+0000","last_undegraded":"2023-10-06T03:15:52.407021+0000","last_fullsized":"2023-10-06T03:15:52.407021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:58.301276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.389184+0000","last_change":"2023-10-06T03:15:51.398288+0000","last_active":"2023-10-06T03:15:52.389184+0000","last_peered":"2023-10-06T03:15:52.389184+0000","last_clean":"2023-10-06T03:15:52.389184+0000","last_became_active":"2023-10-06T03:15:51.398015+0000","last_became_peered":"2023-10-06T03:15:51.398015+0000","last_unstale":"2023-10-06T03:15:52.389184+0000","last_undegraded":"2023-10-06T03:15:52.389184+0000","last_fullsized":"2023-10-06T03:15:52.389184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404625+0000","last_change":"2023-10-06T03:15:52.398846+0000","last_active":"2023-10-06T03:15:52.404625+0000","last_peered":"2023-10-06T03:15:52.404625+0000","last_clean":"2023-10-06T03:15:52.404625+0000","last_became_active":"2023-10-06T03:15:52.398603+0000","last_became_peered":"2023-10-06T03:15:52.398603+0000","last_unstale":"2023-10-06T03:15:52.404625+0000","last_undegraded":"2023-10-06T03:15:52.404625+0000","last_fullsized":"2023-10-06T03:15:52.404625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412777+0000","last_change":"2023-10-06T03:15:51.407297+0000","last_active":"2023-10-06T03:15:52.412777+0000","last_peered":"2023-10-06T03:15:52.412777+0000","last_clean":"2023-10-06T03:15:52.412777+0000","last_became_active":"2023-10-06T03:15:51.407027+0000","last_became_peered":"2023-10-06T03:15:51.407027+0000","last_unstale":"2023-10-06T03:15:52.412777+0000","last_undegraded":"2023-10-06T03:15:52.412777+0000","last_fullsized":"2023-10-06T03:15:52.412777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.595391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408429+0000","last_change":"2023-10-06T03:15:52.401694+0000","last_active":"2023-10-06T03:15:52.408429+0000","last_peered":"2023-10-06T03:15:52.408429+0000","last_clean":"2023-10-06T03:15:52.408429+0000","last_became_active":"2023-10-06T03:15:52.401416+0000","last_became_peered":"2023-10-06T03:15:52.401416+0000","last_unstale":"2023-10-06T03:15:52.408429+0000","last_undegraded":"2023-10-06T03:15:52.408429+0000","last_fullsized":"2023-10-06T03:15:52.408429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:01.423050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395011+0000","last_change":"2023-10-06T03:15:51.396237+0000","last_active":"2023-10-06T03:15:52.395011+0000","last_peered":"2023-10-06T03:15:52.395011+0000","last_clean":"2023-10-06T03:15:52.395011+0000","last_became_active":"2023-10-06T03:15:51.395961+0000","last_became_peered":"2023-10-06T03:15:51.395961+0000","last_unstale":"2023-10-06T03:15:52.395011+0000","last_undegraded":"2023-10-06T03:15:52.395011+0000","last_fullsized":"2023-10-06T03:15:52.395011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403024+0000","last_change":"2023-10-06T03:15:52.397196+0000","last_active":"2023-10-06T03:15:52.403024+0000","last_peered":"2023-10-06T03:15:52.403024+0000","last_clean":"2023-10-06T03:15:52.403024+0000","last_became_active":"2023-10-06T03:15:52.396909+0000","last_became_peered":"2023-10-06T03:15:52.396909+0000","last_unstale":"2023-10-06T03:15:52.403024+0000","last_undegraded":"2023-10-06T03:15:52.403024+0000","last_fullsized":"2023-10-06T03:15:52.403024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:04.891285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388015+0000","last_change":"2023-10-06T03:15:51.397413+0000","last_active":"2023-10-06T03:15:52.388015+0000","last_peered":"2023-10-06T03:15:52.388015+0000","last_clean":"2023-10-06T03:15:52.388015+0000","last_became_active":"2023-10-06T03:15:51.397074+0000","last_became_peered":"2023-10-06T03:15:51.397074+0000","last_unstale":"2023-10-06T03:15:52.388015+0000","last_undegraded":"2023-10-06T03:15:52.388015+0000","last_fullsized":"2023-10-06T03:15:52.388015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408667+0000","last_change":"2023-10-06T03:15:52.405384+0000","last_active":"2023-10-06T03:15:52.408667+0000","last_peered":"2023-10-06T03:15:52.408667+0000","last_clean":"2023-10-06T03:15:52.408667+0000","last_became_active":"2023-10-06T03:15:52.405148+0000","last_became_peered":"2023-10-06T03:15:52.405148+0000","last_unstale":"2023-10-06T03:15:52.408667+0000","last_undegraded":"2023-10-06T03:15:52.408667+0000","last_fullsized":"2023-10-06T03:15:52.408667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395105+0000","last_change":"2023-10-06T03:15:51.401070+0000","last_active":"2023-10-06T03:15:52.395105+0000","last_peered":"2023-10-06T03:15:52.395105+0000","last_clean":"2023-10-06T03:15:52.395105+0000","last_became_active":"2023-10-06T03:15:51.400536+0000","last_became_peered":"2023-10-06T03:15:51.400536+0000","last_unstale":"2023-10-06T03:15:52.395105+0000","last_undegraded":"2023-10-06T03:15:52.395105+0000","last_fullsized":"2023-10-06T03:15:52.395105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.405811+0000","last_change":"2023-10-06T03:15:52.401281+0000","last_active":"2023-10-06T03:15:52.405811+0000","last_peered":"2023-10-06T03:15:52.405811+0000","last_clean":"2023-10-06T03:15:52.405811+0000","last_became_active":"2023-10-06T03:15:52.401028+0000","last_became_peered":"2023-10-06T03:15:52.401028+0000","last_unstale":"2023-10-06T03:15:52.405811+0000","last_undegraded":"2023-10-06T03:15:52.405811+0000","last_fullsized":"2023-10-06T03:15:52.405811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:27.436923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.415300+0000","last_change":"2023-10-06T03:15:51.398105+0000","last_active":"2023-10-06T03:15:52.415300+0000","last_peered":"2023-10-06T03:15:52.415300+0000","last_clean":"2023-10-06T03:15:52.415300+0000","last_became_active":"2023-10-06T03:15:51.397877+0000","last_became_peered":"2023-10-06T03:15:51.397877+0000","last_unstale":"2023-10-06T03:15:52.415300+0000","last_undegraded":"2023-10-06T03:15:52.415300+0000","last_fullsized":"2023-10-06T03:15:52.415300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388474+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:15:52.388474+0000","last_peered":"2023-10-06T03:15:52.388474+0000","last_clean":"2023-10-06T03:15:52.388474+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:15:52.388474+0000","last_undegraded":"2023-10-06T03:15:52.388474+0000","last_fullsized":"2023-10-06T03:15:52.388474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412308+0000","last_change":"2023-10-06T03:15:52.407538+0000","last_active":"2023-10-06T03:15:52.412308+0000","last_peered":"2023-10-06T03:15:52.412308+0000","last_clean":"2023-10-06T03:15:52.412308+0000","last_became_active":"2023-10-06T03:15:52.407273+0000","last_became_peered":"2023-10-06T03:15:52.407273+0000","last_unstale":"2023-10-06T03:15:52.412308+0000","last_undegraded":"2023-10-06T03:15:52.412308+0000","last_fullsized":"2023-10-06T03:15:52.412308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:24.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392479+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:15:52.392479+0000","last_peered":"2023-10-06T03:15:52.392479+0000","last_clean":"2023-10-06T03:15:52.392479+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:15:52.392479+0000","last_undegraded":"2023-10-06T03:15:52.392479+0000","last_fullsized":"2023-10-06T03:15:52.392479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T03:15:53.835919+0000","last_change":"2023-10-06T03:15:51.399935+0000","last_active":"2023-10-06T03:15:53.835919+0000","last_peered":"2023-10-06T03:15:53.835919+0000","last_clean":"2023-10-06T03:15:53.835919+0000","last_became_active":"2023-10-06T03:15:51.399621+0000","last_became_peered":"2023-10-06T03:15:51.399621+0000","last_unstale":"2023-10-06T03:15:53.835919+0000","last_undegraded":"2023-10-06T03:15:53.835919+0000","last_fullsized":"2023-10-06T03:15:53.835919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396231+0000","last_change":"2023-10-06T03:15:52.390913+0000","last_active":"2023-10-06T03:15:52.396231+0000","last_peered":"2023-10-06T03:15:52.396231+0000","last_clean":"2023-10-06T03:15:52.396231+0000","last_became_active":"2023-10-06T03:15:52.390637+0000","last_became_peered":"2023-10-06T03:15:52.390637+0000","last_unstale":"2023-10-06T03:15:52.396231+0000","last_undegraded":"2023-10-06T03:15:52.396231+0000","last_fullsized":"2023-10-06T03:15:52.396231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:52.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396289+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:15:52.396289+0000","last_peered":"2023-10-06T03:15:52.396289+0000","last_clean":"2023-10-06T03:15:52.396289+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:15:52.396289+0000","last_undegraded":"2023-10-06T03:15:52.396289+0000","last_fullsized":"2023-10-06T03:15:52.396289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392848+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:15:52.392848+0000","last_peered":"2023-10-06T03:15:52.392848+0000","last_clean":"2023-10-06T03:15:52.392848+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:15:52.392848+0000","last_undegraded":"2023-10-06T03:15:52.392848+0000","last_fullsized":"2023-10-06T03:15:52.392848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.385325+0000","last_change":"2023-10-06T03:15:51.396703+0000","last_active":"2023-10-06T03:15:52.385325+0000","last_peered":"2023-10-06T03:15:52.385325+0000","last_clean":"2023-10-06T03:15:52.385325+0000","last_became_active":"2023-10-06T03:15:51.396436+0000","last_became_peered":"2023-10-06T03:15:51.396436+0000","last_unstale":"2023-10-06T03:15:52.385325+0000","last_undegraded":"2023-10-06T03:15:52.385325+0000","last_fullsized":"2023-10-06T03:15:52.385325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404610+0000","last_change":"2023-10-06T03:15:52.399034+0000","last_active":"2023-10-06T03:15:52.404610+0000","last_peered":"2023-10-06T03:15:52.404610+0000","last_clean":"2023-10-06T03:15:52.404610+0000","last_became_active":"2023-10-06T03:15:52.398801+0000","last_became_peered":"2023-10-06T03:15:52.398801+0000","last_unstale":"2023-10-06T03:15:52.404610+0000","last_undegraded":"2023-10-06T03:15:52.404610+0000","last_fullsized":"2023-10-06T03:15:52.404610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:55.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.393310+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:15:52.393310+0000","last_peered":"2023-10-06T03:15:52.393310+0000","last_clean":"2023-10-06T03:15:52.393310+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:15:52.393310+0000","last_undegraded":"2023-10-06T03:15:52.393310+0000","last_fullsized":"2023-10-06T03:15:52.393310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395966+0000","last_change":"2023-10-06T03:15:51.397023+0000","last_active":"2023-10-06T03:15:52.395966+0000","last_peered":"2023-10-06T03:15:52.395966+0000","last_clean":"2023-10-06T03:15:52.395966+0000","last_became_active":"2023-10-06T03:15:51.396769+0000","last_became_peered":"2023-10-06T03:15:51.396769+0000","last_unstale":"2023-10-06T03:15:52.395966+0000","last_undegraded":"2023-10-06T03:15:52.395966+0000","last_fullsized":"2023-10-06T03:15:52.395966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:22.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402231+0000","last_change":"2023-10-06T03:15:52.397382+0000","last_active":"2023-10-06T03:15:52.402231+0000","last_peered":"2023-10-06T03:15:52.402231+0000","last_clean":"2023-10-06T03:15:52.402231+0000","last_became_active":"2023-10-06T03:15:52.397128+0000","last_became_peered":"2023-10-06T03:15:52.397128+0000","last_unstale":"2023-10-06T03:15:52.402231+0000","last_undegraded":"2023-10-06T03:15:52.402231+0000","last_fullsized":"2023-10-06T03:15:52.402231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.102751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.392559+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:15:52.392559+0000","last_peered":"2023-10-06T03:15:52.392559+0000","last_clean":"2023-10-06T03:15:52.392559+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:15:52.392559+0000","last_undegraded":"2023-10-06T03:15:52.392559+0000","last_fullsized":"2023-10-06T03:15:52.392559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.394632+0000","last_change":"2023-10-06T03:15:51.401653+0000","last_active":"2023-10-06T03:15:52.394632+0000","last_peered":"2023-10-06T03:15:52.394632+0000","last_clean":"2023-10-06T03:15:52.394632+0000","last_became_active":"2023-10-06T03:15:51.401467+0000","last_became_peered":"2023-10-06T03:15:51.401467+0000","last_unstale":"2023-10-06T03:15:52.394632+0000","last_undegraded":"2023-10-06T03:15:52.394632+0000","last_fullsized":"2023-10-06T03:15:52.394632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407029+0000","last_change":"2023-10-06T03:15:52.399597+0000","last_active":"2023-10-06T03:15:52.407029+0000","last_peered":"2023-10-06T03:15:52.407029+0000","last_clean":"2023-10-06T03:15:52.407029+0000","last_became_active":"2023-10-06T03:15:52.399333+0000","last_became_peered":"2023-10-06T03:15:52.399333+0000","last_unstale":"2023-10-06T03:15:52.407029+0000","last_undegraded":"2023-10-06T03:15:52.407029+0000","last_fullsized":"2023-10-06T03:15:52.407029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:42.334791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.388470+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:15:52.388470+0000","last_peered":"2023-10-06T03:15:52.388470+0000","last_clean":"2023-10-06T03:15:52.388470+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:15:52.388470+0000","last_undegraded":"2023-10-06T03:15:52.388470+0000","last_fullsized":"2023-10-06T03:15:52.388470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.387909+0000","last_change":"2023-10-06T03:15:51.397390+0000","last_active":"2023-10-06T03:15:52.387909+0000","last_peered":"2023-10-06T03:15:52.387909+0000","last_clean":"2023-10-06T03:15:52.387909+0000","last_became_active":"2023-10-06T03:15:51.397066+0000","last_became_peered":"2023-10-06T03:15:51.397066+0000","last_unstale":"2023-10-06T03:15:52.387909+0000","last_undegraded":"2023-10-06T03:15:52.387909+0000","last_fullsized":"2023-10-06T03:15:52.387909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:11.722189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402326+0000","last_change":"2023-10-06T03:15:52.397246+0000","last_active":"2023-10-06T03:15:52.402326+0000","last_peered":"2023-10-06T03:15:52.402326+0000","last_clean":"2023-10-06T03:15:52.402326+0000","last_became_active":"2023-10-06T03:15:52.396967+0000","last_became_peered":"2023-10-06T03:15:52.396967+0000","last_unstale":"2023-10-06T03:15:52.402326+0000","last_undegraded":"2023-10-06T03:15:52.402326+0000","last_fullsized":"2023-10-06T03:15:52.402326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:38.322802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.394796+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:15:52.394796+0000","last_peered":"2023-10-06T03:15:52.394796+0000","last_clean":"2023-10-06T03:15:52.394796+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:15:52.394796+0000","last_undegraded":"2023-10-06T03:15:52.394796+0000","last_fullsized":"2023-10-06T03:15:52.394796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396400+0000","last_change":"2023-10-06T03:15:51.398607+0000","last_active":"2023-10-06T03:15:52.396400+0000","last_peered":"2023-10-06T03:15:52.396400+0000","last_clean":"2023-10-06T03:15:52.396400+0000","last_became_active":"2023-10-06T03:15:51.398350+0000","last_became_peered":"2023-10-06T03:15:51.398350+0000","last_unstale":"2023-10-06T03:15:52.396400+0000","last_undegraded":"2023-10-06T03:15:52.396400+0000","last_fullsized":"2023-10-06T03:15:52.396400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.396430+0000","last_change":"2023-10-06T03:15:52.390631+0000","last_active":"2023-10-06T03:15:52.396430+0000","last_peered":"2023-10-06T03:15:52.396430+0000","last_clean":"2023-10-06T03:15:52.396430+0000","last_became_active":"2023-10-06T03:15:52.390376+0000","last_became_peered":"2023-10-06T03:15:52.390376+0000","last_unstale":"2023-10-06T03:15:52.396430+0000","last_undegraded":"2023-10-06T03:15:52.396430+0000","last_fullsized":"2023-10-06T03:15:52.396430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:38.322802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.395054+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:15:52.395054+0000","last_peered":"2023-10-06T03:15:52.395054+0000","last_clean":"2023-10-06T03:15:52.395054+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:15:52.395054+0000","last_undegraded":"2023-10-06T03:15:52.395054+0000","last_fullsized":"2023-10-06T03:15:52.395054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.389055+0000","last_change":"2023-10-06T03:15:51.398658+0000","last_active":"2023-10-06T03:15:52.389055+0000","last_peered":"2023-10-06T03:15:52.389055+0000","last_clean":"2023-10-06T03:15:52.389055+0000","last_became_active":"2023-10-06T03:15:51.397983+0000","last_became_peered":"2023-10-06T03:15:51.397983+0000","last_unstale":"2023-10-06T03:15:52.389055+0000","last_undegraded":"2023-10-06T03:15:52.389055+0000","last_fullsized":"2023-10-06T03:15:52.389055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:05.790281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402303+0000","last_change":"2023-10-06T03:15:52.397235+0000","last_active":"2023-10-06T03:15:52.402303+0000","last_peered":"2023-10-06T03:15:52.402303+0000","last_clean":"2023-10-06T03:15:52.402303+0000","last_became_active":"2023-10-06T03:15:52.396993+0000","last_became_peered":"2023-10-06T03:15:52.396993+0000","last_unstale":"2023-10-06T03:15:52.402303+0000","last_undegraded":"2023-10-06T03:15:52.402303+0000","last_fullsized":"2023-10-06T03:15:52.402303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418401+0000","last_change":"2023-10-06T03:15:51.396724+0000","last_active":"2023-10-06T03:15:52.418401+0000","last_peered":"2023-10-06T03:15:52.418401+0000","last_clean":"2023-10-06T03:15:52.418401+0000","last_became_active":"2023-10-06T03:15:51.396495+0000","last_became_peered":"2023-10-06T03:15:51.396495+0000","last_unstale":"2023-10-06T03:15:52.418401+0000","last_undegraded":"2023-10-06T03:15:52.418401+0000","last_fullsized":"2023-10-06T03:15:52.418401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:19.536463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.404335+0000","last_change":"2023-10-06T03:15:52.399707+0000","last_active":"2023-10-06T03:15:52.404335+0000","last_peered":"2023-10-06T03:15:52.404335+0000","last_clean":"2023-10-06T03:15:52.404335+0000","last_became_active":"2023-10-06T03:15:52.399315+0000","last_became_peered":"2023-10-06T03:15:52.399315+0000","last_unstale":"2023-10-06T03:15:52.404335+0000","last_undegraded":"2023-10-06T03:15:52.404335+0000","last_fullsized":"2023-10-06T03:15:52.404335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:55.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412599+0000","last_change":"2023-10-06T03:15:51.394879+0000","last_active":"2023-10-06T03:15:52.412599+0000","last_peered":"2023-10-06T03:15:52.412599+0000","last_clean":"2023-10-06T03:15:52.412599+0000","last_became_active":"2023-10-06T03:15:51.394338+0000","last_became_peered":"2023-10-06T03:15:51.394338+0000","last_unstale":"2023-10-06T03:15:52.412599+0000","last_undegraded":"2023-10-06T03:15:52.412599+0000","last_fullsized":"2023-10-06T03:15:52.412599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:54.693853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.407753+0000","last_change":"2023-10-06T03:15:52.400514+0000","last_active":"2023-10-06T03:15:52.407753+0000","last_peered":"2023-10-06T03:15:52.407753+0000","last_clean":"2023-10-06T03:15:52.407753+0000","last_became_active":"2023-10-06T03:15:52.399876+0000","last_became_peered":"2023-10-06T03:15:52.399876+0000","last_unstale":"2023-10-06T03:15:52.407753+0000","last_undegraded":"2023-10-06T03:15:52.407753+0000","last_fullsized":"2023-10-06T03:15:52.407753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:27.152523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412710+0000","last_change":"2023-10-06T03:15:51.394704+0000","last_active":"2023-10-06T03:15:52.412710+0000","last_peered":"2023-10-06T03:15:52.412710+0000","last_clean":"2023-10-06T03:15:52.412710+0000","last_became_active":"2023-10-06T03:15:51.394420+0000","last_became_peered":"2023-10-06T03:15:51.394420+0000","last_unstale":"2023-10-06T03:15:52.412710+0000","last_undegraded":"2023-10-06T03:15:52.412710+0000","last_fullsized":"2023-10-06T03:15:52.412710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408476+0000","last_change":"2023-10-06T03:15:52.401606+0000","last_active":"2023-10-06T03:15:52.408476+0000","last_peered":"2023-10-06T03:15:52.408476+0000","last_clean":"2023-10-06T03:15:52.408476+0000","last_became_active":"2023-10-06T03:15:52.401319+0000","last_became_peered":"2023-10-06T03:15:52.401319+0000","last_unstale":"2023-10-06T03:15:52.408476+0000","last_undegraded":"2023-10-06T03:15:52.408476+0000","last_fullsized":"2023-10-06T03:15:52.408476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:26.415006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.414847+0000","last_change":"2023-10-06T03:15:51.397229+0000","last_active":"2023-10-06T03:15:52.414847+0000","last_peered":"2023-10-06T03:15:52.414847+0000","last_clean":"2023-10-06T03:15:52.414847+0000","last_became_active":"2023-10-06T03:15:51.396971+0000","last_became_peered":"2023-10-06T03:15:51.396971+0000","last_unstale":"2023-10-06T03:15:52.414847+0000","last_undegraded":"2023-10-06T03:15:52.414847+0000","last_fullsized":"2023-10-06T03:15:52.414847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:59.673789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403707+0000","last_change":"2023-10-06T03:15:52.399759+0000","last_active":"2023-10-06T03:15:52.403707+0000","last_peered":"2023-10-06T03:15:52.403707+0000","last_clean":"2023-10-06T03:15:52.403707+0000","last_became_active":"2023-10-06T03:15:52.399459+0000","last_became_peered":"2023-10-06T03:15:52.399459+0000","last_unstale":"2023-10-06T03:15:52.403707+0000","last_undegraded":"2023-10-06T03:15:52.403707+0000","last_fullsized":"2023-10-06T03:15:52.403707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.418238+0000","last_change":"2023-10-06T03:15:51.398436+0000","last_active":"2023-10-06T03:15:52.418238+0000","last_peered":"2023-10-06T03:15:52.418238+0000","last_clean":"2023-10-06T03:15:52.418238+0000","last_became_active":"2023-10-06T03:15:51.397582+0000","last_became_peered":"2023-10-06T03:15:51.397582+0000","last_unstale":"2023-10-06T03:15:52.418238+0000","last_undegraded":"2023-10-06T03:15:52.418238+0000","last_fullsized":"2023-10-06T03:15:52.418238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:50.370058+0000","last_clean_scrub_stamp":"2023-10-06T03:15:50.370058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:45.400856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.402534+0000","last_change":"2023-10-06T03:15:52.396983+0000","last_active":"2023-10-06T03:15:52.402534+0000","last_peered":"2023-10-06T03:15:52.402534+0000","last_clean":"2023-10-06T03:15:52.402534+0000","last_became_active":"2023-10-06T03:15:52.396686+0000","last_became_peered":"2023-10-06T03:15:52.396686+0000","last_unstale":"2023-10-06T03:15:52.402534+0000","last_undegraded":"2023-10-06T03:15:52.402534+0000","last_fullsized":"2023-10-06T03:15:52.402534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:20.918076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.410272+0000","last_change":"2023-10-06T03:15:52.402390+0000","last_active":"2023-10-06T03:15:52.410272+0000","last_peered":"2023-10-06T03:15:52.410272+0000","last_clean":"2023-10-06T03:15:52.410272+0000","last_became_active":"2023-10-06T03:15:52.402104+0000","last_became_peered":"2023-10-06T03:15:52.402104+0000","last_unstale":"2023-10-06T03:15:52.410272+0000","last_undegraded":"2023-10-06T03:15:52.410272+0000","last_fullsized":"2023-10-06T03:15:52.410272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:31.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.403729+0000","last_change":"2023-10-06T03:15:52.400667+0000","last_active":"2023-10-06T03:15:52.403729+0000","last_peered":"2023-10-06T03:15:52.403729+0000","last_clean":"2023-10-06T03:15:52.403729+0000","last_became_active":"2023-10-06T03:15:52.399974+0000","last_became_peered":"2023-10-06T03:15:52.399974+0000","last_unstale":"2023-10-06T03:15:52.403729+0000","last_undegraded":"2023-10-06T03:15:52.403729+0000","last_fullsized":"2023-10-06T03:15:52.403729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:52.924827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.408497+0000","last_change":"2023-10-06T03:15:52.404305+0000","last_active":"2023-10-06T03:15:52.408497+0000","last_peered":"2023-10-06T03:15:52.408497+0000","last_clean":"2023-10-06T03:15:52.408497+0000","last_became_active":"2023-10-06T03:15:52.403971+0000","last_became_peered":"2023-10-06T03:15:52.403971+0000","last_unstale":"2023-10-06T03:15:52.408497+0000","last_undegraded":"2023-10-06T03:15:52.408497+0000","last_fullsized":"2023-10-06T03:15:52.408497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:46.002827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.412347+0000","last_change":"2023-10-06T03:15:52.407238+0000","last_active":"2023-10-06T03:15:52.412347+0000","last_peered":"2023-10-06T03:15:52.412347+0000","last_clean":"2023-10-06T03:15:52.412347+0000","last_became_active":"2023-10-06T03:15:52.406982+0000","last_became_peered":"2023-10-06T03:15:52.406982+0000","last_unstale":"2023-10-06T03:15:52.412347+0000","last_undegraded":"2023-10-06T03:15:52.412347+0000","last_fullsized":"2023-10-06T03:15:52.412347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:01.045364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T03:15:52.409124+0000","last_change":"2023-10-06T03:15:52.402218+0000","last_active":"2023-10-06T03:15:52.409124+0000","last_peered":"2023-10-06T03:15:52.409124+0000","last_clean":"2023-10-06T03:15:52.409124+0000","last_became_active":"2023-10-06T03:15:52.401956+0000","last_became_peered":"2023-10-06T03:15:52.401956+0000","last_unstale":"2023-10-06T03:15:52.409124+0000","last_undegraded":"2023-10-06T03:15:52.409124+0000","last_fullsized":"2023-10-06T03:15:52.409124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:51.375545+0000","last_clean_scrub_stamp":"2023-10-06T03:15:51.375545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:31.339662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":664951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:16:01.479 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:16:01.479 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T03:16:01.479 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T03:16:01.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T03:16:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.624+0000 7efd0ff8d700 1 Processor -- start 2023-10-06T03:16:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.624+0000 7efd0ff8d700 1 -- start start 2023-10-06T03:16:01.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.625+0000 7efd0ff8d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd081501f0 0x7efd080ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.625+0000 7efd0ff8d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd08068d50 0x7efd080ac340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.625+0000 7efd0ff8d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd080b0920 con 0x7efd080adad0 2023-10-06T03:16:01.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.625+0000 7efd0ff8d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd080abeb0 con 0x7efd08068d50 2023-10-06T03:16:01.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.625+0000 7efd0ff8d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd080b0640 con 0x7efd081501f0 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.625+0000 7efd0e52a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd08068d50 0x7efd080ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.625+0000 7efd0d528700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efd080adad0 0x7efd08068640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53940/0 (socket says 172.21.15.82:53940) 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.625+0000 7efd0d528700 1 -- 172.21.15.82:0/4289719744 learned_addr learned my addr 172.21.15.82:0/4289719744 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0dd29700 1 --2- 172.21.15.82:0/4289719744 >> v2:172.21.15.134:3300/0 conn(0x7efd081501f0 0x7efd080ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0e52a700 1 -- 172.21.15.82:0/4289719744 >> v2:172.21.15.134:3300/0 conn(0x7efd081501f0 msgr2=0x7efd080ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0e52a700 1 --2- 172.21.15.82:0/4289719744 >> v2:172.21.15.134:3300/0 conn(0x7efd081501f0 0x7efd080ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0cd27700 1 -- 172.21.15.82:0/4289719744 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870701892 0 0) 0x7efd080b0920 con 0x7efd080adad0 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0e52a700 1 -- 172.21.15.82:0/4289719744 >> v1:172.21.15.82:6789/0 conn(0x7efd080adad0 legacy=0x7efd08068640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0e52a700 1 -- 172.21.15.82:0/4289719744 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd080ab860 con 0x7efd08068d50 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0e52a700 1 --2- 172.21.15.82:0/4289719744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08068d50 0x7efd080ac340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd0806a590 tx=0x7efd0000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc16f5b2be716a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0cd27700 1 -- 172.21.15.82:0/4289719744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000f070 con 0x7efd08068d50 2023-10-06T03:16:01.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0cd27700 1 -- 172.21.15.82:0/4289719744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0000a2e0 con 0x7efd08068d50 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0cd27700 1 -- 172.21.15.82:0/4289719744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000cd20 con 0x7efd08068d50 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0ff8d700 1 -- 172.21.15.82:0/4289719744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08068d50 msgr2=0x7efd080ac340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/4289719744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08068d50 0x7efd080ac340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd0806a590 tx=0x7efd0000a890 comp rx=0 tx=0).stop 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0ff8d700 1 -- 172.21.15.82:0/4289719744 shutdown_connections 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/4289719744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08068d50 0x7efd080ac340 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/4289719744 >> v2:172.21.15.134:3300/0 conn(0x7efd081501f0 0x7efd080ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.626+0000 7efd0ff8d700 1 -- 172.21.15.82:0/4289719744 >> 172.21.15.82:0/4289719744 conn(0x7efd080ccd30 msgr2=0x7efd080694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.627+0000 7efd0ff8d700 1 -- 172.21.15.82:0/4289719744 shutdown_connections 2023-10-06T03:16:01.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.627+0000 7efd0ff8d700 1 -- 172.21.15.82:0/4289719744 wait complete. 2023-10-06T03:16:01.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0ff8d700 1 Processor -- start 2023-10-06T03:16:01.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0ff8d700 1 -- start start 2023-10-06T03:16:01.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0ff8d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd08068d50 0x7efd08148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0ff8d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd080adad0 0x7efd0806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0ff8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd081501f0 0x7efd0806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0ff8d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0814d810 con 0x7efd081501f0 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0ff8d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0814cc00 con 0x7efd080adad0 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0ff8d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0814cee0 con 0x7efd08068d50 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0e52a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd081501f0 0x7efd0806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0e52a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd081501f0 0x7efd0806ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43884/0 (socket says 172.21.15.82:43884) 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.628+0000 7efd0e52a700 1 -- 172.21.15.82:0/2152376054 learned_addr learned my addr 172.21.15.82:0/2152376054 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0d528700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd080adad0 0x7efd0806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0dd29700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd08068d50 0x7efd08148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0e52a700 1 -- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd08068d50 msgr2=0x7efd08148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0e52a700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd08068d50 0x7efd08148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0e52a700 1 -- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd080adad0 msgr2=0x7efd0806ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0e52a700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd080adad0 0x7efd0806ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0e52a700 1 -- 172.21.15.82:0/2152376054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0000ab30 con 0x7efd081501f0 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0e52a700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd081501f0 0x7efd0806ef50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd00013000 tx=0x7efd00019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efcfdffb700 1 -- 172.21.15.82:0/2152376054 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00027460 con 0x7efd081501f0 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efcfdffb700 1 -- 172.21.15.82:0/2152376054 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd000275e0 con 0x7efd081501f0 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efcfdffb700 1 -- 172.21.15.82:0/2152376054 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd000279a0 con 0x7efd081501f0 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0814d1c0 con 0x7efd081501f0 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.629+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd08149220 con 0x7efd081501f0 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.630+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0814d980 con 0x7efd081501f0 2023-10-06T03:16:01.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.630+0000 7efcfdffb700 1 -- 172.21.15.82:0/2152376054 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd00027d50 con 0x7efd081501f0 2023-10-06T03:16:01.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.631+0000 7efcfdffb700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efcec066f30 0x7efcec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.631+0000 7efcfdffb700 1 -- 172.21.15.82:0/2152376054 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efd00087840 con 0x7efd081501f0 2023-10-06T03:16:01.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.631+0000 7efd0dd29700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efcec066f30 0x7efcec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.631+0000 7efd0dd29700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efcec066f30 0x7efcec0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd04006fd0 tx=0x7efd04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.635+0000 7efcfdffb700 1 -- 172.21.15.82:0/2152376054 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd00054950 con 0x7efd081501f0 2023-10-06T03:16:01.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.856+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efd0814dba0 con 0x7efd081501f0 2023-10-06T03:16:01.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.857+0000 7efcfdffb700 1 -- 172.21.15.82:0/2152376054 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efd00057f70 con 0x7efd081501f0 2023-10-06T03:16:01.859 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:01.859 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T03:16:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.858+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efcec066f30 msgr2=0x7efcec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efcec066f30 0x7efcec0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd04006fd0 tx=0x7efd04008040 comp rx=0 tx=0).stop 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd081501f0 msgr2=0x7efd0806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd081501f0 0x7efd0806ef50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd00013000 tx=0x7efd00019000 comp rx=0 tx=0).stop 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 shutdown_connections 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd081501f0 0x7efd0806ef50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efcec066f30 0x7efcec0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd08068d50 0x7efd08148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 --2- 172.21.15.82:0/2152376054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd080adad0 0x7efd0806ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 >> 172.21.15.82:0/2152376054 conn(0x7efd080ccd30 msgr2=0x7efd0806d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 shutdown_connections 2023-10-06T03:16:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.859+0000 7efd0ff8d700 1 -- 172.21.15.82:0/2152376054 wait complete. 2023-10-06T03:16:01.872 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T03:16:01.873 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:01.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.984+0000 7fec23a29700 1 Processor -- start 2023-10-06T03:16:01.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.984+0000 7fec23a29700 1 -- start start 2023-10-06T03:16:01.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.985+0000 7fec23a29700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c15d930 0x7fec1c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.985+0000 7fec23a29700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec1c1591b0 0x7fec1c159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.985+0000 7fec23a29700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0b2ad0 con 0x7fec1c15d560 2023-10-06T03:16:01.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.985+0000 7fec23a29700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c0b4160 con 0x7fec1c1591b0 2023-10-06T03:16:01.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.985+0000 7fec23a29700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c159b70 con 0x7fec1c15d930 2023-10-06T03:16:01.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.985+0000 7fec21fc6700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec1c1591b0 0x7fec1c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.985+0000 7fec20fc4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c15d930 0x7fec1c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec20fc4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c15d930 0x7fec1c0d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42600/0 (socket says 172.21.15.82:42600) 2023-10-06T03:16:01.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec21fc6700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec1c1591b0 0x7fec1c159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44922/0 (socket says 172.21.15.82:44922) 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec217c5700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fec1c15d560 0x7fec1c0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:49806/0 (socket says 172.21.15.82:49806) 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec20fc4700 1 -- 172.21.15.82:0/1817715921 learned_addr learned my addr 172.21.15.82:0/1817715921 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec21fc6700 1 -- 172.21.15.82:0/1817715921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c15d930 msgr2=0x7fec1c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec21fc6700 1 --2- 172.21.15.82:0/1817715921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c15d930 0x7fec1c0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec21fc6700 1 -- 172.21.15.82:0/1817715921 >> v1:172.21.15.134:6789/0 conn(0x7fec1c15d560 legacy=0x7fec1c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec21fc6700 1 -- 172.21.15.82:0/1817715921 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c0b2230 con 0x7fec1c1591b0 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec1bfff700 1 -- 172.21.15.82:0/1817715921 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880391641 0 0) 0x7fec1c0b2ad0 con 0x7fec1c15d560 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec20fc4700 1 --2- 172.21.15.82:0/1817715921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c15d930 0x7fec1c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec21fc6700 1 --2- 172.21.15.82:0/1817715921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c1591b0 0x7fec1c159630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec140098e0 tx=0x7fec140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa38c2595feb990 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec1bfff700 1 -- 172.21.15.82:0/1817715921 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400b640 con 0x7fec1c1591b0 2023-10-06T03:16:01.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec1bfff700 1 -- 172.21.15.82:0/1817715921 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400b7a0 con 0x7fec1c1591b0 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.986+0000 7fec1bfff700 1 -- 172.21.15.82:0/1817715921 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400bb40 con 0x7fec1c1591b0 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.987+0000 7fec23a29700 1 -- 172.21.15.82:0/1817715921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c1591b0 msgr2=0x7fec1c159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.987+0000 7fec23a29700 1 --2- 172.21.15.82:0/1817715921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c1591b0 0x7fec1c159630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec140098e0 tx=0x7fec140091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.987+0000 7fec23a29700 1 -- 172.21.15.82:0/1817715921 shutdown_connections 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.987+0000 7fec23a29700 1 --2- 172.21.15.82:0/1817715921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c1591b0 0x7fec1c159630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.987+0000 7fec23a29700 1 --2- 172.21.15.82:0/1817715921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c15d930 0x7fec1c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.987+0000 7fec23a29700 1 -- 172.21.15.82:0/1817715921 >> 172.21.15.82:0/1817715921 conn(0x7fec1c0d1180 msgr2=0x7fec1c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.987+0000 7fec23a29700 1 -- 172.21.15.82:0/1817715921 shutdown_connections 2023-10-06T03:16:01.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.987+0000 7fec23a29700 1 -- 172.21.15.82:0/1817715921 wait complete. 2023-10-06T03:16:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.988+0000 7fec23a29700 1 Processor -- start 2023-10-06T03:16:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.988+0000 7fec23a29700 1 -- start start 2023-10-06T03:16:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec23a29700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c1591b0 0x7fec1c154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec23a29700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c15d560 0x7fec1c0a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec23a29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec1c15d930 0x7fec1c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec23a29700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c15b260 con 0x7fec1c15d930 2023-10-06T03:16:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec23a29700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c15c0c0 con 0x7fec1c15d560 2023-10-06T03:16:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec23a29700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c15b4b0 con 0x7fec1c1591b0 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec1c15d930 0x7fec1c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec1c15d930 0x7fec1c15c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43888/0 (socket says 172.21.15.82:43888) 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 -- 172.21.15.82:0/3987897127 learned_addr learned my addr 172.21.15.82:0/3987897127 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec217c5700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c1591b0 0x7fec1c154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec20fc4700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c15d560 0x7fec1c0a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 -- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c1591b0 msgr2=0x7fec1c154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c1591b0 0x7fec1c154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 -- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c15d560 msgr2=0x7fec1c0a6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c15d560 0x7fec1c0a6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 -- 172.21.15.82:0/3987897127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100094f0 con 0x7fec1c15d930 2023-10-06T03:16:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.989+0000 7fec21fc6700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec1c15d930 0x7fec1c15c550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fec1c064a20 tx=0x7fec14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.990+0000 7fec197fa700 1 -- 172.21.15.82:0/3987897127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec14011420 con 0x7fec1c15d930 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.990+0000 7fec197fa700 1 -- 172.21.15.82:0/3987897127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec14011580 con 0x7fec1c15d930 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.990+0000 7fec197fa700 1 -- 172.21.15.82:0/3987897127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec14011920 con 0x7fec1c15d930 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.990+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec14009420 con 0x7fec1c15d930 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.990+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c15ba70 con 0x7fec1c15d930 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.990+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c15c230 con 0x7fec1c15d930 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.991+0000 7fec197fa700 1 -- 172.21.15.82:0/3987897127 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec14011c90 con 0x7fec1c15d930 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.991+0000 7fec197fa700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fec08066f30 0x7fec080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.991+0000 7fec197fa700 1 -- 172.21.15.82:0/3987897127 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fec14086200 con 0x7fec1c15d930 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.992+0000 7fec217c5700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fec08066f30 0x7fec080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:01.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.992+0000 7fec217c5700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fec08066f30 0x7fec080693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec0c001560 tx=0x7fec0c005d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:01.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:01.995+0000 7fec197fa700 1 -- 172.21.15.82:0/3987897127 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec14053310 con 0x7fec1c15d930 2023-10-06T03:16:02.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.179+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec1c064050 con 0x7fec1c15d930 2023-10-06T03:16:02.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.180+0000 7fec197fa700 1 -- 172.21.15.82:0/3987897127 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fec14056930 con 0x7fec1c15d930 2023-10-06T03:16:02.182 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fec08066f30 msgr2=0x7fec080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fec08066f30 0x7fec080693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec0c001560 tx=0x7fec0c005d10 comp rx=0 tx=0).stop 2023-10-06T03:16:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec1c15d930 msgr2=0x7fec1c15c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec1c15d930 0x7fec1c15c550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fec1c064a20 tx=0x7fec14017000 comp rx=0 tx=0).stop 2023-10-06T03:16:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 shutdown_connections 2023-10-06T03:16:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec1c15d930 0x7fec1c15c550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fec08066f30 0x7fec080693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1c1591b0 0x7fec1c154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 --2- 172.21.15.82:0/3987897127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec1c15d560 0x7fec1c0a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 >> 172.21.15.82:0/3987897127 conn(0x7fec1c0d1180 msgr2=0x7fec1c0b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 shutdown_connections 2023-10-06T03:16:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.182+0000 7fec23a29700 1 -- 172.21.15.82:0/3987897127 wait complete. 2023-10-06T03:16:02.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:15:49.404080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:15:50.736320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:16:02.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.312+0000 7fe983447700 1 Processor -- start 2023-10-06T03:16:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.312+0000 7fe983447700 1 -- start start 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe983447700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe97c157b50 0x7fe97c0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe983447700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c0cdb30 0x7fe97c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe983447700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c159a60 con 0x7fe97c158460 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe983447700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c158e50 con 0x7fe97c157b50 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe983447700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c159130 con 0x7fe97c0cdb30 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe9811e3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe97c157b50 0x7fe97c0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe9819e4700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe97c158460 0x7fe97c159ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53942/0 (socket says 172.21.15.82:53942) 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe9819e4700 1 -- 172.21.15.82:0/2810631418 learned_addr learned my addr 172.21.15.82:0/2810631418 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe9809e2700 1 --2- 172.21.15.82:0/2810631418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c0cdb30 0x7fe97c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe973fff700 1 -- 172.21.15.82:0/2810631418 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195980740 0 0) 0x7fe97c159a60 con 0x7fe97c158460 2023-10-06T03:16:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.313+0000 7fe973fff700 1 -- 172.21.15.82:0/2810631418 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe968003570 con 0x7fe97c158460 2023-10-06T03:16:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe9811e3700 1 -- 172.21.15.82:0/2810631418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c0cdb30 msgr2=0x7fe97c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe9811e3700 1 --2- 172.21.15.82:0/2810631418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c0cdb30 0x7fe97c157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe9811e3700 1 -- 172.21.15.82:0/2810631418 >> v1:172.21.15.82:6789/0 conn(0x7fe97c158460 legacy=0x7fe97c159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe9811e3700 1 -- 172.21.15.82:0/2810631418 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c159410 con 0x7fe97c157b50 2023-10-06T03:16:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe9811e3700 1 --2- 172.21.15.82:0/2810631418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c157b50 0x7fe97c0cd5f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe978009e60 tx=0x7fe978009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d539e3ee427b399 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe973fff700 1 -- 172.21.15.82:0/2810631418 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97800e070 con 0x7fe97c157b50 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe973fff700 1 -- 172.21.15.82:0/2810631418 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97800bab0 con 0x7fe97c157b50 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe973fff700 1 -- 172.21.15.82:0/2810631418 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97800be70 con 0x7fe97c157b50 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe983447700 1 -- 172.21.15.82:0/2810631418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c157b50 msgr2=0x7fe97c0cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.314+0000 7fe983447700 1 --2- 172.21.15.82:0/2810631418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c157b50 0x7fe97c0cd5f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe978009e60 tx=0x7fe978009780 comp rx=0 tx=0).stop 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.315+0000 7fe983447700 1 -- 172.21.15.82:0/2810631418 shutdown_connections 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.315+0000 7fe983447700 1 --2- 172.21.15.82:0/2810631418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c157b50 0x7fe97c0cd5f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.315+0000 7fe983447700 1 --2- 172.21.15.82:0/2810631418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c0cdb30 0x7fe97c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.315+0000 7fe983447700 1 -- 172.21.15.82:0/2810631418 >> 172.21.15.82:0/2810631418 conn(0x7fe97c06d890 msgr2=0x7fe97c06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.315+0000 7fe983447700 1 -- 172.21.15.82:0/2810631418 shutdown_connections 2023-10-06T03:16:02.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.315+0000 7fe983447700 1 -- 172.21.15.82:0/2810631418 wait complete. 2023-10-06T03:16:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.316+0000 7fe983447700 1 Processor -- start 2023-10-06T03:16:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.316+0000 7fe983447700 1 -- start start 2023-10-06T03:16:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe983447700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c0cdb30 0x7fe97c15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe983447700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe97c157b50 0x7fe97c154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe983447700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c158460 0x7fe97c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe983447700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c154a40 con 0x7fe97c0cdb30 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe983447700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c15aec0 con 0x7fe97c157b50 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe983447700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c154ce0 con 0x7fe97c158460 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c0cdb30 0x7fe97c15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c0cdb30 0x7fe97c15b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43914/0 (socket says 172.21.15.82:43914) 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 -- 172.21.15.82:0/4037561021 learned_addr learned my addr 172.21.15.82:0/4037561021 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9819e4700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c158460 0x7fe97c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 -- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c158460 msgr2=0x7fe97c0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c158460 0x7fe97c0b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 -- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe97c157b50 msgr2=0x7fe97c154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe97c157b50 0x7fe97c154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 -- 172.21.15.82:0/4037561021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978009a20 con 0x7fe97c0cdb30 2023-10-06T03:16:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9811e3700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c0cdb30 0x7fe97c15b980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9780097c0 tx=0x7fe978019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9717fa700 1 -- 172.21.15.82:0/4037561021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978012d00 con 0x7fe97c0cdb30 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9717fa700 1 -- 172.21.15.82:0/4037561021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe978012e80 con 0x7fe97c0cdb30 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c154fc0 con 0x7fe97c0cdb30 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe9717fa700 1 -- 172.21.15.82:0/4037561021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780276c0 con 0x7fe97c0cdb30 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.317+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c15b460 con 0x7fe97c0cdb30 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.318+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c155150 con 0x7fe97c0cdb30 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.319+0000 7fe9717fa700 1 -- 172.21.15.82:0/4037561021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe978024070 con 0x7fe97c0cdb30 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.319+0000 7fe9717fa700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.319+0000 7fe9717fa700 1 -- 172.21.15.82:0/4037561021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe978086c80 con 0x7fe97c0cdb30 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.319+0000 7fe9809e2700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.320+0000 7fe9809e2700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe97c157210 tx=0x7fe96c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.323+0000 7fe9717fa700 1 -- 172.21.15.82:0/4037561021 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe978053d90 con 0x7fe97c0cdb30 2023-10-06T03:16:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.507+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe97c15b680 con 0x7fe97c0cdb30 2023-10-06T03:16:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.507+0000 7fe9717fa700 1 -- 172.21.15.82:0/4037561021 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe97802c0a0 con 0x7fe97c0cdb30 2023-10-06T03:16:02.509 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe960066f30 msgr2=0x7fe9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe97c157210 tx=0x7fe96c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c0cdb30 msgr2=0x7fe97c15b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c0cdb30 0x7fe97c15b980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9780097c0 tx=0x7fe978019000 comp rx=0 tx=0).stop 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 shutdown_connections 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe97c158460 0x7fe97c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe97c0cdb30 0x7fe97c15b980 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 --2- 172.21.15.82:0/4037561021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe97c157b50 0x7fe97c154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 >> 172.21.15.82:0/4037561021 conn(0x7fe97c06d890 msgr2=0x7fe97c14eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 shutdown_connections 2023-10-06T03:16:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.509+0000 7fe983447700 1 -- 172.21.15.82:0/4037561021 wait complete. 2023-10-06T03:16:02.523 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:02.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.637+0000 7f2d39cb3700 1 Processor -- start 2023-10-06T03:16:02.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.637+0000 7f2d39cb3700 1 -- start start 2023-10-06T03:16:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d39cb3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2d34159500 0x7f2d341598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d39cb3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d3415dab0 0x7f2d340cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d39cb3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340b1110 con 0x7f2d340b3fd0 2023-10-06T03:16:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d39cb3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340b13b0 con 0x7f2d3415dab0 2023-10-06T03:16:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d39cb3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340b1690 con 0x7f2d34159500 2023-10-06T03:16:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d33fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d3415dab0 0x7f2d340cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d33fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d3415dab0 0x7f2d340cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43930/0 (socket says 172.21.15.82:43930) 2023-10-06T03:16:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d33fff700 1 -- 172.21.15.82:0/3032836983 learned_addr learned my addr 172.21.15.82:0/3032836983 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d337fe700 1 --2- 172.21.15.82:0/3032836983 >> v2:172.21.15.134:3300/0 conn(0x7f2d34159500 0x7f2d341598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d33fff700 1 -- 172.21.15.82:0/3032836983 >> v2:172.21.15.134:3300/0 conn(0x7f2d34159500 msgr2=0x7f2d341598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d33fff700 1 --2- 172.21.15.82:0/3032836983 >> v2:172.21.15.134:3300/0 conn(0x7f2d34159500 0x7f2d341598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d33fff700 1 -- 172.21.15.82:0/3032836983 >> v1:172.21.15.134:6789/0 conn(0x7f2d340b3fd0 legacy=0x7f2d3415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d33fff700 1 -- 172.21.15.82:0/3032836983 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340b1970 con 0x7f2d3415dab0 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d337fe700 1 --2- 172.21.15.82:0/3032836983 >> v2:172.21.15.134:3300/0 conn(0x7f2d34159500 0x7f2d341598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.638+0000 7f2d33fff700 1 --2- 172.21.15.82:0/3032836983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3415dab0 0x7f2d340cf6c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d34063e00 tx=0x7f2d2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7e8d922b07a326 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d327fc700 1 -- 172.21.15.82:0/3032836983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00b820 con 0x7f2d3415dab0 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d327fc700 1 -- 172.21.15.82:0/3032836983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c00b980 con 0x7f2d3415dab0 2023-10-06T03:16:02.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d327fc700 1 -- 172.21.15.82:0/3032836983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00bd20 con 0x7f2d3415dab0 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d39cb3700 1 -- 172.21.15.82:0/3032836983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3415dab0 msgr2=0x7f2d340cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/3032836983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3415dab0 0x7f2d340cf6c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d34063e00 tx=0x7f2d2c009250 comp rx=0 tx=0).stop 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d39cb3700 1 -- 172.21.15.82:0/3032836983 shutdown_connections 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/3032836983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3415dab0 0x7f2d340cf6c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/3032836983 >> v2:172.21.15.134:3300/0 conn(0x7f2d34159500 0x7f2d341598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d39cb3700 1 -- 172.21.15.82:0/3032836983 >> 172.21.15.82:0/3032836983 conn(0x7f2d34067630 msgr2=0x7f2d34069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d39cb3700 1 -- 172.21.15.82:0/3032836983 shutdown_connections 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.639+0000 7f2d39cb3700 1 -- 172.21.15.82:0/3032836983 wait complete. 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.640+0000 7f2d39cb3700 1 Processor -- start 2023-10-06T03:16:02.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.640+0000 7f2d39cb3700 1 -- start start 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d39cb3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340b3fd0 0x7f2d3414d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d39cb3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34159500 0x7f2d34154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d39cb3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d3415dab0 0x7f2d34155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d39cb3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3416df90 con 0x7f2d34159500 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d39cb3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3416d380 con 0x7f2d340b3fd0 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d39cb3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3416d660 con 0x7f2d3415dab0 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d32ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34159500 0x7f2d34154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d32ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34159500 0x7f2d34154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43942/0 (socket says 172.21.15.82:43942) 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d32ffd700 1 -- 172.21.15.82:0/2943443477 learned_addr learned my addr 172.21.15.82:0/2943443477 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d33fff700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d3415dab0 0x7f2d34155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d337fe700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340b3fd0 0x7f2d3414d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d32ffd700 1 -- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d3415dab0 msgr2=0x7f2d34155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d32ffd700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d3415dab0 0x7f2d34155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d32ffd700 1 -- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340b3fd0 msgr2=0x7f2d3414d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d32ffd700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340b3fd0 0x7f2d3414d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.641+0000 7f2d32ffd700 1 -- 172.21.15.82:0/2943443477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c0094f0 con 0x7f2d34159500 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.642+0000 7f2d337fe700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340b3fd0 0x7f2d3414d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.642+0000 7f2d32ffd700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34159500 0x7f2d34154f00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c5d0 tx=0x7f2d28007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.642+0000 7f2d1b7fe700 1 -- 172.21.15.82:0/2943443477 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28011590 con 0x7f2d34159500 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.642+0000 7f2d1b7fe700 1 -- 172.21.15.82:0/2943443477 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28011710 con 0x7f2d34159500 2023-10-06T03:16:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.642+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3416d940 con 0x7f2d34159500 2023-10-06T03:16:02.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.642+0000 7f2d1b7fe700 1 -- 172.21.15.82:0/2943443477 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28011ad0 con 0x7f2d34159500 2023-10-06T03:16:02.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.642+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3414d660 con 0x7f2d34159500 2023-10-06T03:16:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.643+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3414d8e0 con 0x7f2d34159500 2023-10-06T03:16:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.643+0000 7f2d1b7fe700 1 -- 172.21.15.82:0/2943443477 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d2801c460 con 0x7f2d34159500 2023-10-06T03:16:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.643+0000 7f2d1b7fe700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2d20066f30 0x7f2d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.644+0000 7f2d1b7fe700 1 -- 172.21.15.82:0/2943443477 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2d28084530 con 0x7f2d34159500 2023-10-06T03:16:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.644+0000 7f2d337fe700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2d20066f30 0x7f2d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.644+0000 7f2d337fe700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2d20066f30 0x7f2d200693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400d640 tx=0x7f2d24007670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.648+0000 7f2d1b7fe700 1 -- 172.21.15.82:0/2943443477 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d280515a0 con 0x7f2d34159500 2023-10-06T03:16:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.830+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d3416dde0 con 0x7f2d34159500 2023-10-06T03:16:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.831+0000 7f2d1b7fe700 1 -- 172.21.15.82:0/2943443477 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d28054bc0 con 0x7f2d34159500 2023-10-06T03:16:02.832 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.832+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2d20066f30 msgr2=0x7f2d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.832+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2d20066f30 0x7f2d200693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400d640 tx=0x7f2d24007670 comp rx=0 tx=0).stop 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34159500 msgr2=0x7f2d34154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34159500 0x7f2d34154f00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c5d0 tx=0x7f2d28007f60 comp rx=0 tx=0).stop 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 shutdown_connections 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2d20066f30 0x7f2d200693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d3415dab0 0x7f2d34155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d340b3fd0 0x7f2d3414d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 --2- 172.21.15.82:0/2943443477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34159500 0x7f2d34154f00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 >> 172.21.15.82:0/2943443477 conn(0x7f2d34067630 msgr2=0x7f2d340cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 shutdown_connections 2023-10-06T03:16:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.833+0000 7f2d39cb3700 1 -- 172.21.15.82:0/2943443477 wait complete. 2023-10-06T03:16:02.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:16:02.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.961+0000 7f4cefbba700 1 Processor -- start 2023-10-06T03:16:02.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.961+0000 7f4cefbba700 1 -- start start 2023-10-06T03:16:02.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4cefbba700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4ce81598d0 0x7f4ce815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4cefbba700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce815d8e0 0x7f4ce80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4cefbba700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce815dd20 con 0x7f4ce8159500 2023-10-06T03:16:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4cefbba700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80b1110 con 0x7f4ce81598d0 2023-10-06T03:16:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4cefbba700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80b13b0 con 0x7f4ce815d8e0 2023-10-06T03:16:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4cee157700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce815d8e0 0x7f4ce80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4ced155700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4ce81598d0 0x7f4ce815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4cee157700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce815d8e0 0x7f4ce80cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:42642/0 (socket says 172.21.15.82:42642) 2023-10-06T03:16:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.962+0000 7f4cee157700 1 -- 172.21.15.82:0/1840037707 learned_addr learned my addr 172.21.15.82:0/1840037707 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4cee157700 1 -- 172.21.15.82:0/1840037707 >> v2:172.21.15.134:3300/0 conn(0x7f4ce81598d0 msgr2=0x7f4ce815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4cee157700 1 --2- 172.21.15.82:0/1840037707 >> v2:172.21.15.134:3300/0 conn(0x7f4ce81598d0 0x7f4ce815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4cee157700 1 -- 172.21.15.82:0/1840037707 >> v1:172.21.15.134:6789/0 conn(0x7f4ce8159500 legacy=0x7f4ce80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4cee157700 1 -- 172.21.15.82:0/1840037707 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80b1690 con 0x7f4ce815d8e0 2023-10-06T03:16:02.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4ced155700 1 --2- 172.21.15.82:0/1840037707 >> v2:172.21.15.134:3300/0 conn(0x7f4ce81598d0 0x7f4ce815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:02.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4cee157700 1 --2- 172.21.15.82:0/1840037707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce815d8e0 0x7f4ce80cf6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00099b0 tx=0x7f4ce0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caaea7357610165b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4cec954700 1 -- 172.21.15.82:0/1840037707 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0009ea0 con 0x7f4ce815d8e0 2023-10-06T03:16:02.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4cec954700 1 -- 172.21.15.82:0/1840037707 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000b860 con 0x7f4ce815d8e0 2023-10-06T03:16:02.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.963+0000 7f4cec954700 1 -- 172.21.15.82:0/1840037707 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000bc00 con 0x7f4ce815d8e0 2023-10-06T03:16:02.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.964+0000 7f4cefbba700 1 -- 172.21.15.82:0/1840037707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce815d8e0 msgr2=0x7f4ce80cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.964+0000 7f4cefbba700 1 --2- 172.21.15.82:0/1840037707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce815d8e0 0x7f4ce80cf6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00099b0 tx=0x7f4ce0009250 comp rx=0 tx=0).stop 2023-10-06T03:16:02.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.964+0000 7f4cefbba700 1 -- 172.21.15.82:0/1840037707 shutdown_connections 2023-10-06T03:16:02.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.964+0000 7f4cefbba700 1 --2- 172.21.15.82:0/1840037707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce815d8e0 0x7f4ce80cf6c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.964+0000 7f4cefbba700 1 --2- 172.21.15.82:0/1840037707 >> v2:172.21.15.134:3300/0 conn(0x7f4ce81598d0 0x7f4ce815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.964+0000 7f4cefbba700 1 -- 172.21.15.82:0/1840037707 >> 172.21.15.82:0/1840037707 conn(0x7f4ce8067630 msgr2=0x7f4ce8069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:02.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.964+0000 7f4cefbba700 1 -- 172.21.15.82:0/1840037707 shutdown_connections 2023-10-06T03:16:02.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.964+0000 7f4cefbba700 1 -- 172.21.15.82:0/1840037707 wait complete. 2023-10-06T03:16:02.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.965+0000 7f4cefbba700 1 Processor -- start 2023-10-06T03:16:02.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.965+0000 7f4cefbba700 1 -- start start 2023-10-06T03:16:02.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cefbba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8159500 0x7f4ce814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cefbba700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce81598d0 0x7f4ce814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cefbba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce815d8e0 0x7f4ce814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cefbba700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce814cae0 con 0x7f4ce815d8e0 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cefbba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce814d0a0 con 0x7f4ce8159500 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cefbba700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce814ee80 con 0x7f4ce81598d0 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce815d8e0 0x7f4ce814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce815d8e0 0x7f4ce814bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43954/0 (socket says 172.21.15.82:43954) 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 -- 172.21.15.82:0/4064524968 learned_addr learned my addr 172.21.15.82:0/4064524968 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4ced956700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8159500 0x7f4ce814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4ced155700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce81598d0 0x7f4ce814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 -- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce81598d0 msgr2=0x7f4ce814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce81598d0 0x7f4ce814d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 -- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8159500 msgr2=0x7f4ce814e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8159500 0x7f4ce814e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 -- 172.21.15.82:0/4064524968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc009420 con 0x7f4ce815d8e0 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cee157700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce815d8e0 0x7f4ce814bfe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0006fd0 tx=0x7f4ce0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4ce5ffb700 1 -- 172.21.15.82:0/4064524968 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0027450 con 0x7f4ce815d8e0 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4ce5ffb700 1 -- 172.21.15.82:0/4064524968 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce00275b0 con 0x7f4ce815d8e0 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce00094f0 con 0x7f4ce815d8e0 2023-10-06T03:16:02.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.966+0000 7f4ce5ffb700 1 -- 172.21.15.82:0/4064524968 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0027970 con 0x7f4ce815d8e0 2023-10-06T03:16:02.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.967+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce815d2a0 con 0x7f4ce815d8e0 2023-10-06T03:16:02.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.967+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce814ce50 con 0x7f4ce815d8e0 2023-10-06T03:16:02.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.968+0000 7f4ce5ffb700 1 -- 172.21.15.82:0/4064524968 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ce0027ce0 con 0x7f4ce815d8e0 2023-10-06T03:16:02.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.968+0000 7f4ce5ffb700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4cd4066f30 0x7f4cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:02.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.968+0000 7f4ce5ffb700 1 -- 172.21.15.82:0/4064524968 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ce0086650 con 0x7f4ce815d8e0 2023-10-06T03:16:02.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.968+0000 7f4ced956700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4cd4066f30 0x7f4cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:02.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.969+0000 7f4ced956700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4cd4066f30 0x7f4cd40693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8007fd0 tx=0x7f4cd80016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:02.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:02.972+0000 7f4ce5ffb700 1 -- 172.21.15.82:0/4064524968 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ce00537e0 con 0x7f4ce815d8e0 2023-10-06T03:16:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.153+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ce8064050 con 0x7f4ce815d8e0 2023-10-06T03:16:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.153+0000 7f4ce5ffb700 1 -- 172.21.15.82:0/4064524968 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ce0056e00 con 0x7f4ce815d8e0 2023-10-06T03:16:03.155 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:16:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4cd4066f30 msgr2=0x7f4cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4cd4066f30 0x7f4cd40693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8007fd0 tx=0x7f4cd80016f0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce815d8e0 msgr2=0x7f4ce814bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce815d8e0 0x7f4ce814bfe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0006fd0 tx=0x7f4ce0017000 comp rx=0 tx=0).stop 2023-10-06T03:16:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 shutdown_connections 2023-10-06T03:16:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ce815d8e0 0x7f4ce814bfe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8159500 0x7f4ce814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4cd4066f30 0x7f4cd40693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 --2- 172.21.15.82:0/4064524968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce81598d0 0x7f4ce814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 >> 172.21.15.82:0/4064524968 conn(0x7f4ce8067630 msgr2=0x7f4ce80cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 shutdown_connections 2023-10-06T03:16:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.156+0000 7f4cefbba700 1 -- 172.21.15.82:0/4064524968 wait complete. 2023-10-06T03:16:03.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:16:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.285+0000 7f9bad74c700 1 Processor -- start 2023-10-06T03:16:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.285+0000 7f9bad74c700 1 -- start start 2023-10-06T03:16:03.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9bad74c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 0x7f9ba8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9bad74c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ba80b1690 0x7f9ba80b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9bad74c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba80698e0 con 0x7f9ba815cb10 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9bad74c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba80b2020 con 0x7f9ba80b1690 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9bad74c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8068fd0 con 0x7f9ba80b4000 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9ba77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ba80b1690 0x7f9ba80b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9ba77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ba80b1690 0x7f9ba80b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43962/0 (socket says 172.21.15.82:43962) 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9ba77fe700 1 -- 172.21.15.82:0/3710372901 learned_addr learned my addr 172.21.15.82:0/3710372901 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.286+0000 7f9ba67fc700 1 --2- 172.21.15.82:0/3710372901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 0x7f9ba8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9ba77fe700 1 -- 172.21.15.82:0/3710372901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 msgr2=0x7f9ba8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9ba77fe700 1 --2- 172.21.15.82:0/3710372901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 0x7f9ba8159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9ba77fe700 1 -- 172.21.15.82:0/3710372901 >> v1:172.21.15.134:6789/0 conn(0x7f9ba815cb10 legacy=0x7f9ba80af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9ba77fe700 1 -- 172.21.15.82:0/3710372901 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80b0020 con 0x7f9ba80b1690 2023-10-06T03:16:03.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9ba77fe700 1 --2- 172.21.15.82:0/3710372901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80b1ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00099b0 tx=0x7f9ba0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d939399b131ef83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9ba5ffb700 1 -- 172.21.15.82:0/3710372901 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0009ea0 con 0x7f9ba80b1690 2023-10-06T03:16:03.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9ba5ffb700 1 -- 172.21.15.82:0/3710372901 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba000b860 con 0x7f9ba80b1690 2023-10-06T03:16:03.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9ba5ffb700 1 -- 172.21.15.82:0/3710372901 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000bc00 con 0x7f9ba80b1690 2023-10-06T03:16:03.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9bad74c700 1 -- 172.21.15.82:0/3710372901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 msgr2=0x7f9ba80b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3710372901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80b1ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00099b0 tx=0x7f9ba0009250 comp rx=0 tx=0).stop 2023-10-06T03:16:03.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9bad74c700 1 -- 172.21.15.82:0/3710372901 shutdown_connections 2023-10-06T03:16:03.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3710372901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80b1ae0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3710372901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 0x7f9ba8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9bad74c700 1 -- 172.21.15.82:0/3710372901 >> 172.21.15.82:0/3710372901 conn(0x7f9ba806d890 msgr2=0x7f9ba806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:03.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.287+0000 7f9bad74c700 1 -- 172.21.15.82:0/3710372901 shutdown_connections 2023-10-06T03:16:03.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.288+0000 7f9bad74c700 1 -- 172.21.15.82:0/3710372901 wait complete. 2023-10-06T03:16:03.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9bad74c700 1 Processor -- start 2023-10-06T03:16:03.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9bad74c700 1 -- start start 2023-10-06T03:16:03.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9bad74c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9bad74c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 0x7f9ba816dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9bad74c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba815cb10 0x7f9ba8148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9bad74c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80cc830 con 0x7f9ba80b1690 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9bad74c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba816e150 con 0x7f9ba815cb10 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9bad74c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80cbc20 con 0x7f9ba80b4000 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.289+0000 7f9ba6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43978/0 (socket says 172.21.15.82:43978) 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba6ffd700 1 -- 172.21.15.82:0/3796261257 learned_addr learned my addr 172.21.15.82:0/3796261257 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba67fc700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 0x7f9ba816dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba77fe700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba815cb10 0x7f9ba8148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba6ffd700 1 -- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 msgr2=0x7f9ba816dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba6ffd700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 0x7f9ba816dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba6ffd700 1 -- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba815cb10 msgr2=0x7f9ba8148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba6ffd700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba815cb10 0x7f9ba8148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba6ffd700 1 -- 172.21.15.82:0/3796261257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba00094f0 con 0x7f9ba80b1690 2023-10-06T03:16:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9ba6ffd700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80cdba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c8e0 tx=0x7f9b98001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9b9effd700 1 -- 172.21.15.82:0/3796261257 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98012630 con 0x7f9ba80b1690 2023-10-06T03:16:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9b9effd700 1 -- 172.21.15.82:0/3796261257 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b980127b0 con 0x7f9ba80b1690 2023-10-06T03:16:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba80cbf00 con 0x7f9ba80b1690 2023-10-06T03:16:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9b9effd700 1 -- 172.21.15.82:0/3796261257 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98012b70 con 0x7f9ba80b1690 2023-10-06T03:16:03.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.290+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba80cc4c0 con 0x7f9ba80b1690 2023-10-06T03:16:03.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.291+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba8064050 con 0x7f9ba80b1690 2023-10-06T03:16:03.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.291+0000 7f9b9effd700 1 -- 172.21.15.82:0/3796261257 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b98003030 con 0x7f9ba80b1690 2023-10-06T03:16:03.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.292+0000 7f9b9effd700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9b88066f30 0x7f9b880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.292+0000 7f9b9effd700 1 -- 172.21.15.82:0/3796261257 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b98084570 con 0x7f9ba80b1690 2023-10-06T03:16:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.292+0000 7f9ba67fc700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9b88066f30 0x7f9b880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.292+0000 7f9ba67fc700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9b88066f30 0x7f9b880693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8158970 tx=0x7f9b900091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.296+0000 7f9b9effd700 1 -- 172.21.15.82:0/3796261257 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b98055110 con 0x7f9ba80b1690 2023-10-06T03:16:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.477+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ba8069290 con 0x7f9ba80b1690 2023-10-06T03:16:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.477+0000 7f9b9effd700 1 -- 172.21.15.82:0/3796261257 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b98054ca0 con 0x7f9ba80b1690 2023-10-06T03:16:03.485 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:16:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9b88066f30 msgr2=0x7f9b880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9b88066f30 0x7f9b880693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8158970 tx=0x7f9b900091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 msgr2=0x7f9ba80cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80cdba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c8e0 tx=0x7f9b98001710 comp rx=0 tx=0).stop 2023-10-06T03:16:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 shutdown_connections 2023-10-06T03:16:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ba815cb10 0x7f9ba8148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ba80b1690 0x7f9ba80cdba0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9b88066f30 0x7f9b880693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 --2- 172.21.15.82:0/3796261257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ba80b4000 0x7f9ba816dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 >> 172.21.15.82:0/3796261257 conn(0x7f9ba806d890 msgr2=0x7f9ba8159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 shutdown_connections 2023-10-06T03:16:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.479+0000 7f9bad74c700 1 -- 172.21.15.82:0/3796261257 wait complete. 2023-10-06T03:16:03.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:03.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.605+0000 7faae4f21700 1 Processor -- start 2023-10-06T03:16:03.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.605+0000 7faae4f21700 1 -- start start 2023-10-06T03:16:03.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faae4f21700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 0x7faae00cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faae4f21700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae0069f50 con 0x7faae0143160 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faae4f21700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae0069340 con 0x7faae0142d90 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faae4f21700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae00ccaf0 con 0x7faae00cc130 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faaddd9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faae0143160 0x7faae00c43c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53956/0 (socket says 172.21.15.82:53956) 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faaddd9b700 1 -- 172.21.15.82:0/3352731889 learned_addr learned my addr 172.21.15.82:0/3352731889 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faaded9d700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 0x7faae00cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943805627 0 0) 0x7faae0069f50 con 0x7faae0143160 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac8003570 con 0x7faae0143160 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154862202 0 0) 0x7faae0069340 con 0x7faae0142d90 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae0069f50 con 0x7faae0142d90 2023-10-06T03:16:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1899220232 0 0) 0x7faac8003570 con 0x7faae0143160 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 msgr2=0x7faae00cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 0x7faae00cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 >> v1:172.21.15.134:6789/0 conn(0x7faae0142d90 legacy=0x7faae006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae0069620 con 0x7faae0143160 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7faad4001470 con 0x7faae0143160 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faaded9d700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 0x7faae00cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 >> v1:172.21.15.82:6789/0 conn(0x7faae0143160 legacy=0x7faae00c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faac8003c20 0x7faac8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8004810 0x7faac8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 0x7faac80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00ccaf0 con 0x7faac8003c20 2023-10-06T03:16:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac800bb40 con 0x7faac8004810 2023-10-06T03:16:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac800bd00 con 0x7faae00cc130 2023-10-06T03:16:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faade59c700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faac8003c20 0x7faac8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.606+0000 7faaddd9b700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8004810 0x7faac8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faaded9d700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 0x7faac80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faade59c700 1 -- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 msgr2=0x7faac80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faade59c700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 0x7faac80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faade59c700 1 -- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8004810 msgr2=0x7faac8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faade59c700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8004810 0x7faac8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faade59c700 1 -- 172.21.15.82:0/3352731889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad8009420 con 0x7faac8003c20 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faaddd9b700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8004810 0x7faac8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faaded9d700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae00cc130 0x7faac80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faade59c700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faac8003c20 0x7faac8004010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faad0002120 tx=0x7faad00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25471c3aaa00c1f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0001ab0 con 0x7faac8003c20 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad000c980 con 0x7faac8003c20 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faadd59a700 1 -- 172.21.15.82:0/3352731889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000cd20 con 0x7faac8003c20 2023-10-06T03:16:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faae4f21700 1 -- 172.21.15.82:0/3352731889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faac8003c20 msgr2=0x7faac8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faae4f21700 1 --2- 172.21.15.82:0/3352731889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faac8003c20 0x7faac8004010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faad0002120 tx=0x7faad00017a0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faaded9d700 1 -- 172.21.15.82:0/3352731889 reap_dead start 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faae4f21700 1 -- 172.21.15.82:0/3352731889 shutdown_connections 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faae4f21700 1 -- 172.21.15.82:0/3352731889 >> 172.21.15.82:0/3352731889 conn(0x7faae00ce4d0 msgr2=0x7faae00ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faae4f21700 1 -- 172.21.15.82:0/3352731889 shutdown_connections 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.607+0000 7faae4f21700 1 -- 172.21.15.82:0/3352731889 wait complete. 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.608+0000 7faae4f21700 1 Processor -- start 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faae4f21700 1 -- start start 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faae4f21700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8003c20 0x7faae00ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faae4f21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae00c7f40 0x7faae015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faae4f21700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae0158f70 0x7faae00b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faae4f21700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae015c030 con 0x7faae00c7f40 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faae4f21700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c83b0 con 0x7faac8003c20 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faae4f21700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c97b0 con 0x7faae0158f70 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faaddd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae00c7f40 0x7faae015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faaddd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae00c7f40 0x7faae015b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43990/0 (socket says 172.21.15.82:43990) 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faaddd9b700 1 -- 172.21.15.82:0/2339920011 learned_addr learned my addr 172.21.15.82:0/2339920011 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faaded9d700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae0158f70 0x7faae00b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.609+0000 7faade59c700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8003c20 0x7faae00ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faaddd9b700 1 -- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae0158f70 msgr2=0x7faae00b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faaddd9b700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae0158f70 0x7faae00b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faaddd9b700 1 -- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8003c20 msgr2=0x7faae00ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faaddd9b700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8003c20 0x7faae00ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faaddd9b700 1 -- 172.21.15.82:0/2339920011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00c9a50 con 0x7faae00c7f40 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faade59c700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8003c20 0x7faae00ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faaddd9b700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae00c7f40 0x7faae015b800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faad400ebf0 tx=0x7faad40010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faace7fc700 1 -- 172.21.15.82:0/2339920011 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400c700 con 0x7faae00c7f40 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faace7fc700 1 -- 172.21.15.82:0/2339920011 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400c860 con 0x7faae00c7f40 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00c9d30 con 0x7faae00c7f40 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faace7fc700 1 -- 172.21.15.82:0/2339920011 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400cc20 con 0x7faae00c7f40 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.610+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae00ca2f0 con 0x7faae00c7f40 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.611+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae00ca510 con 0x7faae00c7f40 2023-10-06T03:16:03.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.611+0000 7faace7fc700 1 -- 172.21.15.82:0/2339920011 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faad401d460 con 0x7faae00c7f40 2023-10-06T03:16:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.612+0000 7faace7fc700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.612+0000 7faace7fc700 1 -- 172.21.15.82:0/2339920011 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faad40845a0 con 0x7faae00c7f40 2023-10-06T03:16:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.612+0000 7faade59c700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.612+0000 7faade59c700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faad0000f80 tx=0x7faad0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.616+0000 7faace7fc700 1 -- 172.21.15.82:0/2339920011 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faad4051770 con 0x7faae00c7f40 2023-10-06T03:16:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.839+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faae0064050 con 0x7faae00c7f40 2023-10-06T03:16:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.840+0000 7faace7fc700 1 -- 172.21.15.82:0/2339920011 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7faad4054d90 con 0x7faae00c7f40 2023-10-06T03:16:03.842 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:03.842 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:15:51.763473+0000","modified":"2023-10-06T03:15:55.399812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:16:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faac0066f30 msgr2=0x7faac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faad0000f80 tx=0x7faad0016000 comp rx=0 tx=0).stop 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae00c7f40 msgr2=0x7faae015b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae00c7f40 0x7faae015b800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faad400ebf0 tx=0x7faad40010f0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 shutdown_connections 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faae0158f70 0x7faae00b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac8003c20 0x7faae00ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 --2- 172.21.15.82:0/2339920011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae00c7f40 0x7faae015b800 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 >> 172.21.15.82:0/2339920011 conn(0x7faae00ce4d0 msgr2=0x7faae00c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 shutdown_connections 2023-10-06T03:16:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.842+0000 7faae4f21700 1 -- 172.21.15.82:0/2339920011 wait complete. 2023-10-06T03:16:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-10-06T03:16:03.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.967+0000 7f2e14a89700 1 Processor -- start 2023-10-06T03:16:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.967+0000 7f2e14a89700 1 -- start start 2023-10-06T03:16:03.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e14a89700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2e1015d480 0x7f2e10069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e14a89700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e100b0a20 0x7f2e100b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e14a89700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e100687c0 con 0x7f2e10069da0 2023-10-06T03:16:03.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e14a89700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e10068aa0 con 0x7f2e100b0a20 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e14a89700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e10068d80 con 0x7f2e1015d480 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e100b0a20 0x7f2e100b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2e10069da0 0x7f2e100b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53970/0 (socket says 172.21.15.82:53970) 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0effd700 1 -- 172.21.15.82:0/3275270912 learned_addr learned my addr 172.21.15.82:0/3275270912 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0f7fe700 1 --2- 172.21.15.82:0/3275270912 >> v2:172.21.15.134:3300/0 conn(0x7f2e1015d480 0x7f2e10069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0ffff700 1 -- 172.21.15.82:0/3275270912 >> v2:172.21.15.134:3300/0 conn(0x7f2e1015d480 msgr2=0x7f2e10069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0ffff700 1 --2- 172.21.15.82:0/3275270912 >> v2:172.21.15.134:3300/0 conn(0x7f2e1015d480 0x7f2e10069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0ffff700 1 -- 172.21.15.82:0/3275270912 >> v1:172.21.15.82:6789/0 conn(0x7f2e10069da0 legacy=0x7f2e100b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0ffff700 1 -- 172.21.15.82:0/3275270912 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e10069060 con 0x7f2e100b0a20 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.968+0000 7f2e0e7fc700 1 -- 172.21.15.82:0/3275270912 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954955244 0 0) 0x7f2e100687c0 con 0x7f2e10069da0 2023-10-06T03:16:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e0ffff700 1 --2- 172.21.15.82:0/3275270912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100b5c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2e10071370 tx=0x7f2e080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad70821f351e390e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e0e7fc700 1 -- 172.21.15.82:0/3275270912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08011630 con 0x7f2e100b0a20 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e0e7fc700 1 -- 172.21.15.82:0/3275270912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08011790 con 0x7f2e100b0a20 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e0e7fc700 1 -- 172.21.15.82:0/3275270912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08011b30 con 0x7f2e100b0a20 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e14a89700 1 -- 172.21.15.82:0/3275270912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 msgr2=0x7f2e100b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e14a89700 1 --2- 172.21.15.82:0/3275270912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100b5c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2e10071370 tx=0x7f2e080091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e14a89700 1 -- 172.21.15.82:0/3275270912 shutdown_connections 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e14a89700 1 --2- 172.21.15.82:0/3275270912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100b5c30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e14a89700 1 --2- 172.21.15.82:0/3275270912 >> v2:172.21.15.134:3300/0 conn(0x7f2e1015d480 0x7f2e10069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e14a89700 1 -- 172.21.15.82:0/3275270912 >> 172.21.15.82:0/3275270912 conn(0x7f2e100ccf80 msgr2=0x7f2e100cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e14a89700 1 -- 172.21.15.82:0/3275270912 shutdown_connections 2023-10-06T03:16:03.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.969+0000 7f2e14a89700 1 -- 172.21.15.82:0/3275270912 wait complete. 2023-10-06T03:16:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.970+0000 7f2e14a89700 1 Processor -- start 2023-10-06T03:16:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.970+0000 7f2e14a89700 1 -- start start 2023-10-06T03:16:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e14a89700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e10069da0 0x7f2e10134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e14a89700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e14a89700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2e1015d480 0x7f2e100cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e14a89700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e10131e50 con 0x7f2e100b0a20 2023-10-06T03:16:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e14a89700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e10130db0 con 0x7f2e10069da0 2023-10-06T03:16:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e14a89700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e10131090 con 0x7f2e1015d480 2023-10-06T03:16:03.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e0effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e0effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44008/0 (socket says 172.21.15.82:44008) 2023-10-06T03:16:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e0effd700 1 -- 172.21.15.82:0/866940209 learned_addr learned my addr 172.21.15.82:0/866940209 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e0f7fe700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e10069da0 0x7f2e10134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.971+0000 7f2e0ffff700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2e1015d480 0x7f2e100cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e0effd700 1 -- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2e1015d480 msgr2=0x7f2e100cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e0effd700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2e1015d480 0x7f2e100cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e0effd700 1 -- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e10069da0 msgr2=0x7f2e10134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e0effd700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e10069da0 0x7f2e10134ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e0effd700 1 -- 172.21.15.82:0/866940209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e08009420 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e0f7fe700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e10069da0 0x7f2e10134ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e0effd700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100cf5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400c7e0 tx=0x7f2e04007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2df77fe700 1 -- 172.21.15.82:0/866940209 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04005b30 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2df77fe700 1 -- 172.21.15.82:0/866940209 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e04005c90 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e10131370 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2df77fe700 1 -- 172.21.15.82:0/866940209 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04007300 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.972+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e10131930 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.973+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e10131b50 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.973+0000 7f2df77fe700 1 -- 172.21.15.82:0/866940209 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e040076b0 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.974+0000 7f2df77fe700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2dfc066f30 0x7f2dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.974+0000 7f2df77fe700 1 -- 172.21.15.82:0/866940209 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e04084160 con 0x7f2e100b0a20 2023-10-06T03:16:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.974+0000 7f2e0f7fe700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2dfc066f30 0x7f2dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.974+0000 7f2e0f7fe700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2dfc066f30 0x7f2dfc0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e00007640 tx=0x7f2e0000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:03.978+0000 7f2df77fe700 1 -- 172.21.15.82:0/866940209 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e040512f0 con 0x7f2e100b0a20 2023-10-06T03:16:04.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.164+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e1004c3c0 con 0x7f2e100b0a20 2023-10-06T03:16:04.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.165+0000 7f2df77fe700 1 -- 172.21.15.82:0/866940209 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f2e04054910 con 0x7f2e100b0a20 2023-10-06T03:16:04.166 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:04.167 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2dfc066f30 msgr2=0x7f2dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2dfc066f30 0x7f2dfc0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e00007640 tx=0x7f2e0000b040 comp rx=0 tx=0).stop 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 msgr2=0x7f2e100cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100cf5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400c7e0 tx=0x7f2e04007df0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 shutdown_connections 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2dfc066f30 0x7f2dfc0693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2e1015d480 0x7f2e100cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e10069da0 0x7f2e10134ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 --2- 172.21.15.82:0/866940209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e100b0a20 0x7f2e100cf5f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 >> 172.21.15.82:0/866940209 conn(0x7f2e100ccf80 msgr2=0x7f2e10141140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:04.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 shutdown_connections 2023-10-06T03:16:04.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.167+0000 7f2e14a89700 1 -- 172.21.15.82:0/866940209 wait complete. 2023-10-06T03:16:04.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:15:49.404080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:15:50.736320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:16:04.181 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:04.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.297+0000 7f47e2e34700 1 Processor -- start 2023-10-06T03:16:04.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.297+0000 7f47e2e34700 1 -- start start 2023-10-06T03:16:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e2e34700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47dc157b50 0x7f47dc0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e2e34700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f47dc158630 0x7f47dc161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e2e34700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc159a60 con 0x7f47dc0cdb30 2023-10-06T03:16:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e2e34700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc0cdfb0 con 0x7f47dc157b50 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e2e34700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc158e50 con 0x7f47dc158630 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e0bd0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47dc157b50 0x7f47dc0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47dbfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f47dc0cdb30 0x7f47dc157f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53972/0 (socket says 172.21.15.82:53972) 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47dbfff700 1 -- 172.21.15.82:0/2737536785 learned_addr learned my addr 172.21.15.82:0/2737536785 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e13d1700 1 --2- 172.21.15.82:0/2737536785 >> v2:172.21.15.134:3300/0 conn(0x7f47dc158630 0x7f47dc161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e0bd0700 1 -- 172.21.15.82:0/2737536785 >> v2:172.21.15.134:3300/0 conn(0x7f47dc158630 msgr2=0x7f47dc161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e0bd0700 1 --2- 172.21.15.82:0/2737536785 >> v2:172.21.15.134:3300/0 conn(0x7f47dc158630 0x7f47dc161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e0bd0700 1 -- 172.21.15.82:0/2737536785 >> v1:172.21.15.82:6789/0 conn(0x7f47dc0cdb30 legacy=0x7f47dc157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e0bd0700 1 -- 172.21.15.82:0/2737536785 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc159130 con 0x7f47dc157b50 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47db7fe700 1 -- 172.21.15.82:0/2737536785 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369666915 0 0) 0x7f47dc159a60 con 0x7f47dc0cdb30 2023-10-06T03:16:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e13d1700 1 --2- 172.21.15.82:0/2737536785 >> v2:172.21.15.134:3300/0 conn(0x7f47dc158630 0x7f47dc161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47e0bd0700 1 --2- 172.21.15.82:0/2737536785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc157b50 0x7f47dc0cd5f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0b14e0 tx=0x7f47d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aab98294478fe92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47db7fe700 1 -- 172.21.15.82:0/2737536785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400e070 con 0x7f47dc157b50 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47db7fe700 1 -- 172.21.15.82:0/2737536785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400bc30 con 0x7f47dc157b50 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.298+0000 7f47db7fe700 1 -- 172.21.15.82:0/2737536785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4012430 con 0x7f47dc157b50 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.299+0000 7f47e2e34700 1 -- 172.21.15.82:0/2737536785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc157b50 msgr2=0x7f47dc0cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.299+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2737536785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc157b50 0x7f47dc0cd5f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0b14e0 tx=0x7f47d4009780 comp rx=0 tx=0).stop 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.299+0000 7f47e2e34700 1 -- 172.21.15.82:0/2737536785 shutdown_connections 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.299+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2737536785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc157b50 0x7f47dc0cd5f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.299+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2737536785 >> v2:172.21.15.134:3300/0 conn(0x7f47dc158630 0x7f47dc161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.299+0000 7f47e2e34700 1 -- 172.21.15.82:0/2737536785 >> 172.21.15.82:0/2737536785 conn(0x7f47dc06d890 msgr2=0x7f47dc06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.299+0000 7f47e2e34700 1 -- 172.21.15.82:0/2737536785 shutdown_connections 2023-10-06T03:16:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.299+0000 7f47e2e34700 1 -- 172.21.15.82:0/2737536785 wait complete. 2023-10-06T03:16:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.300+0000 7f47e2e34700 1 Processor -- start 2023-10-06T03:16:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.300+0000 7f47e2e34700 1 -- start start 2023-10-06T03:16:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e2e34700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc0cdb30 0x7f47dc153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e2e34700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47dc157b50 0x7f47dc13b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e2e34700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47dc158630 0x7f47dc152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e2e34700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc154310 con 0x7f47dc0cdb30 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e2e34700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc1526b0 con 0x7f47dc158630 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e2e34700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc156d10 con 0x7f47dc157b50 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc0cdb30 0x7f47dc153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc0cdb30 0x7f47dc153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44018/0 (socket says 172.21.15.82:44018) 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 -- 172.21.15.82:0/2397881469 learned_addr learned my addr 172.21.15.82:0/2397881469 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47dbfff700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47dc157b50 0x7f47dc13b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e13d1700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47dc158630 0x7f47dc152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 -- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47dc157b50 msgr2=0x7f47dc13b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47dc157b50 0x7f47dc13b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 -- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47dc158630 msgr2=0x7f47dc152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47dc158630 0x7f47dc152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 -- 172.21.15.82:0/2397881469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4009a20 con 0x7f47dc0cdb30 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47e0bd0700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc0cdb30 0x7f47dc153a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47d4013000 tx=0x7f47d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.301+0000 7f47d8ff9700 1 -- 172.21.15.82:0/2397881469 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4012e50 con 0x7f47dc0cdb30 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.302+0000 7f47d8ff9700 1 -- 172.21.15.82:0/2397881469 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4027470 con 0x7f47dc0cdb30 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.302+0000 7f47d8ff9700 1 -- 172.21.15.82:0/2397881469 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4027830 con 0x7f47dc0cdb30 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.302+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc152910 con 0x7f47dc0cdb30 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.302+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc152ed0 con 0x7f47dc0cdb30 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.302+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc064050 con 0x7f47dc0cdb30 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.303+0000 7f47d8ff9700 1 -- 172.21.15.82:0/2397881469 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47d4024070 con 0x7f47dc0cdb30 2023-10-06T03:16:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.303+0000 7f47d8ff9700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47bc066f30 0x7f47bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.303+0000 7f47d8ff9700 1 -- 172.21.15.82:0/2397881469 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47d4086c50 con 0x7f47dc0cdb30 2023-10-06T03:16:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.303+0000 7f47dbfff700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47bc066f30 0x7f47bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.304+0000 7f47dbfff700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47bc066f30 0x7f47bc0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f47dc063950 tx=0x7f47cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.307+0000 7f47d8ff9700 1 -- 172.21.15.82:0/2397881469 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47d408c020 con 0x7f47dc0cdb30 2023-10-06T03:16:04.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.490+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47dc0ca4c0 con 0x7f47dc0cdb30 2023-10-06T03:16:04.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.491+0000 7f47d8ff9700 1 -- 172.21.15.82:0/2397881469 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47d402c020 con 0x7f47dc0cdb30 2023-10-06T03:16:04.492 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:04.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.492+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47bc066f30 msgr2=0x7f47bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.492+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47bc066f30 0x7f47bc0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f47dc063950 tx=0x7f47cc009040 comp rx=0 tx=0).stop 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc0cdb30 msgr2=0x7f47dc153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc0cdb30 0x7f47dc153a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47d4013000 tx=0x7f47d4019000 comp rx=0 tx=0).stop 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 shutdown_connections 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47dc158630 0x7f47dc152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47dc0cdb30 0x7f47dc153a10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47bc066f30 0x7f47bc0693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 --2- 172.21.15.82:0/2397881469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47dc157b50 0x7f47dc13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 >> 172.21.15.82:0/2397881469 conn(0x7f47dc06d890 msgr2=0x7f47dc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:04.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 shutdown_connections 2023-10-06T03:16:04.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.493+0000 7f47e2e34700 1 -- 172.21.15.82:0/2397881469 wait complete. 2023-10-06T03:16:04.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.621+0000 7f9461f59700 1 Processor -- start 2023-10-06T03:16:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.621+0000 7f9461f59700 1 -- start start 2023-10-06T03:16:04.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f9461f59700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f945c142e90 0x7f945c069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f9461f59700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c069380 con 0x7f945c15d9a0 2023-10-06T03:16:04.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f9461f59700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c0b63a0 con 0x7f945c069d50 2023-10-06T03:16:04.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f9461f59700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c068770 con 0x7f945c142e90 2023-10-06T03:16:04.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f9461758700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f945c15d9a0 0x7f945c0b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53982/0 (socket says 172.21.15.82:53982) 2023-10-06T03:16:04.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f9461758700 1 -- 172.21.15.82:0/479182972 learned_addr learned my addr 172.21.15.82:0/479182972 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:04.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f9460f57700 1 --2- 172.21.15.82:0/479182972 >> v2:172.21.15.134:3300/0 conn(0x7f945c142e90 0x7f945c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704837924 0 0) 0x7f945c069380 con 0x7f945c15d9a0 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9448003570 con 0x7f945c15d9a0 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079274767 0 0) 0x7f9448003570 con 0x7f945c15d9a0 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 >> v2:172.21.15.134:3300/0 conn(0x7f945c142e90 msgr2=0x7f945c069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f945b7fe700 1 --2- 172.21.15.82:0/479182972 >> v2:172.21.15.134:3300/0 conn(0x7f945c142e90 0x7f945c069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 >> v1:172.21.15.134:6789/0 conn(0x7f945c069d50 legacy=0x7f945c15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c068a50 con 0x7f945c15d9a0 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.622+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f9444001470 con 0x7f945c15d9a0 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 >> v1:172.21.15.82:6789/0 conn(0x7f945c15d9a0 legacy=0x7f945c0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9448003a60 0x7f9448003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9448004810 0x7f9448004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94480051c0 0x7f944800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c068770 con 0x7f94480051c0 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944800c160 con 0x7f9448004810 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944800c320 con 0x7f9448003a60 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9460f57700 1 --2- 172.21.15.82:0/479182972 >> v2:172.21.15.134:3300/0 conn(0x7f945c142e90 0x7f945c069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9461758700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94480051c0 0x7f944800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945bfff700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9448004810 0x7f9448004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9460f57700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9448003a60 0x7f9448003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9461758700 1 -- 172.21.15.82:0/479182972 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9448003a60 msgr2=0x7f9448003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9461758700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9448003a60 0x7f9448003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9461758700 1 -- 172.21.15.82:0/479182972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9448004810 msgr2=0x7f9448004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9461758700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9448004810 0x7f9448004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9461758700 1 -- 172.21.15.82:0/479182972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9448003570 con 0x7f94480051c0 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9461758700 1 -- 172.21.15.82:0/479182972 reap_dead start 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f9461758700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94480051c0 0x7f944800ba60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f944400c3c0 tx=0x7f9444001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585e93f3710dc021 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400cc90 con 0x7f94480051c0 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400ce30 con 0x7f94480051c0 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.623+0000 7f945b7fe700 1 -- 172.21.15.82:0/479182972 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444005b70 con 0x7f94480051c0 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.624+0000 7f9461f59700 1 -- 172.21.15.82:0/479182972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94480051c0 msgr2=0x7f944800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.624+0000 7f9461f59700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94480051c0 0x7f944800ba60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f944400c3c0 tx=0x7f9444001e50 comp rx=0 tx=0).stop 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.624+0000 7f9461f59700 1 -- 172.21.15.82:0/479182972 shutdown_connections 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.624+0000 7f9461f59700 1 --2- 172.21.15.82:0/479182972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94480051c0 0x7f944800ba60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.624+0000 7f9461f59700 1 -- 172.21.15.82:0/479182972 >> 172.21.15.82:0/479182972 conn(0x7f945c0ccfe0 msgr2=0x7f945c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.624+0000 7f9461f59700 1 -- 172.21.15.82:0/479182972 shutdown_connections 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.624+0000 7f9461f59700 1 -- 172.21.15.82:0/479182972 wait complete. 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.625+0000 7f9461f59700 1 Processor -- start 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.625+0000 7f9461f59700 1 -- start start 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461f59700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f945c16da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461f59700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f945c158830 0x7f945c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461f59700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f945c158ca0 0x7f945c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461f59700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c15ac30 con 0x7f945c158830 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461f59700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c16dfa0 con 0x7f94480051c0 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461f59700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c159d40 con 0x7f945c158ca0 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f945c158830 0x7f945c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f945c158830 0x7f945c0b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44040/0 (socket says 172.21.15.82:44040) 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 -- 172.21.15.82:0/1889185317 learned_addr learned my addr 172.21.15.82:0/1889185317 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461758700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f945c158ca0 0x7f945c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9460f57700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f945c16da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 -- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f945c158ca0 msgr2=0x7f945c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f945c158ca0 0x7f945c0b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 -- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 msgr2=0x7f945c16da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f945c16da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 -- 172.21.15.82:0/1889185317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c15a020 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f945bfff700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f945c158830 0x7f945c0b1340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f944c002920 tx=0x7f944c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9458ff9700 1 -- 172.21.15.82:0/1889185317 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c013600 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9458ff9700 1 -- 172.21.15.82:0/1889185317 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c013760 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c15a300 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9458ff9700 1 -- 172.21.15.82:0/1889185317 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c013b00 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.626+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c15a8c0 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.627+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c15ade0 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.628+0000 7f9458ff9700 1 -- 172.21.15.82:0/1889185317 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f944c01c400 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.628+0000 7f9458ff9700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.628+0000 7f9458ff9700 1 -- 172.21.15.82:0/1889185317 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f944c084a10 con 0x7f945c158830 2023-10-06T03:16:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.628+0000 7f9460f57700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.629+0000 7f9460f57700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f943c066f30 0x7f943c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94540099f0 tx=0x7f945400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.632+0000 7f9458ff9700 1 -- 172.21.15.82:0/1889185317 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f945c15ade0 con 0x7f945c158830 2023-10-06T03:16:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.817+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f945c15ade0 con 0x7f945c158830 2023-10-06T03:16:04.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.817+0000 7f9458ff9700 1 -- 172.21.15.82:0/1889185317 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f945c15ade0 con 0x7f945c158830 2023-10-06T03:16:04.820 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.819+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f943c066f30 msgr2=0x7f943c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.819+0000 7f9461f59700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f943c066f30 0x7f943c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94540099f0 tx=0x7f945400b040 comp rx=0 tx=0).stop 2023-10-06T03:16:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.819+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f945c158830 msgr2=0x7f945c0b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.819+0000 7f9461f59700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f945c158830 0x7f945c0b1340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f944c002920 tx=0x7f944c007d30 comp rx=0 tx=0).stop 2023-10-06T03:16:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.819+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 shutdown_connections 2023-10-06T03:16:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.819+0000 7f9461f59700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.820+0000 7f9461f59700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f945c158ca0 0x7f945c0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.820+0000 7f9461f59700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94480051c0 0x7f945c16da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.820+0000 7f9461f59700 1 --2- 172.21.15.82:0/1889185317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f945c158830 0x7f945c0b1340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.820+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 >> 172.21.15.82:0/1889185317 conn(0x7f945c0ccfe0 msgr2=0x7f945c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.820+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 shutdown_connections 2023-10-06T03:16:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.820+0000 7f9461f59700 1 -- 172.21.15.82:0/1889185317 wait complete. 2023-10-06T03:16:04.833 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:16:04.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.948+0000 7fd24be84700 1 Processor -- start 2023-10-06T03:16:04.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.948+0000 7fd24be84700 1 -- start start 2023-10-06T03:16:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24be84700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd244159500 0x7fd2441598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24be84700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2440b3fd0 0x7fd24415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24be84700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd24415d8e0 0x7fd2440cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24be84700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24415dd20 con 0x7fd2440b3fd0 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24be84700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2440b1110 con 0x7fd24415d8e0 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24be84700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440b13b0 con 0x7fd244159500 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24941f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2440b3fd0 0x7fd24415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24941f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2440b3fd0 0x7fd24415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44048/0 (socket says 172.21.15.82:44048) 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24941f700 1 -- 172.21.15.82:0/2643152094 learned_addr learned my addr 172.21.15.82:0/2643152094 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd249c20700 1 --2- 172.21.15.82:0/2643152094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd244159500 0x7fd2441598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.949+0000 7fd24a421700 1 --2- 172.21.15.82:0/2643152094 >> v2:172.21.15.134:3300/0 conn(0x7fd24415d8e0 0x7fd2440cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24941f700 1 -- 172.21.15.82:0/2643152094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd244159500 msgr2=0x7fd2441598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:04.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24941f700 1 --2- 172.21.15.82:0/2643152094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd244159500 0x7fd2441598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24941f700 1 -- 172.21.15.82:0/2643152094 >> v2:172.21.15.134:3300/0 conn(0x7fd24415d8e0 msgr2=0x7fd2440cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:04.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24941f700 1 --2- 172.21.15.82:0/2643152094 >> v2:172.21.15.134:3300/0 conn(0x7fd24415d8e0 0x7fd2440cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24941f700 1 -- 172.21.15.82:0/2643152094 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440b1690 con 0x7fd2440b3fd0 2023-10-06T03:16:04.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24941f700 1 --2- 172.21.15.82:0/2643152094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2440b3fd0 0x7fd24415d3a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2440b2f00 tx=0x7fd234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a9ecf4656105ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd248c1e700 1 -- 172.21.15.82:0/2643152094 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400b640 con 0x7fd2440b3fd0 2023-10-06T03:16:04.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd248c1e700 1 -- 172.21.15.82:0/2643152094 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400b7a0 con 0x7fd2440b3fd0 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd248c1e700 1 -- 172.21.15.82:0/2643152094 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400bb60 con 0x7fd2440b3fd0 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24be84700 1 -- 172.21.15.82:0/2643152094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2440b3fd0 msgr2=0x7fd24415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24be84700 1 --2- 172.21.15.82:0/2643152094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2440b3fd0 0x7fd24415d3a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2440b2f00 tx=0x7fd234009250 comp rx=0 tx=0).stop 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24be84700 1 -- 172.21.15.82:0/2643152094 shutdown_connections 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24be84700 1 --2- 172.21.15.82:0/2643152094 >> v2:172.21.15.134:3300/0 conn(0x7fd24415d8e0 0x7fd2440cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24be84700 1 --2- 172.21.15.82:0/2643152094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd244159500 0x7fd2441598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24be84700 1 --2- 172.21.15.82:0/2643152094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2440b3fd0 0x7fd24415d3a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24be84700 1 -- 172.21.15.82:0/2643152094 >> 172.21.15.82:0/2643152094 conn(0x7fd244067630 msgr2=0x7fd244069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.950+0000 7fd24be84700 1 -- 172.21.15.82:0/2643152094 shutdown_connections 2023-10-06T03:16:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.951+0000 7fd24be84700 1 -- 172.21.15.82:0/2643152094 wait complete. 2023-10-06T03:16:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.952+0000 7fd24be84700 1 Processor -- start 2023-10-06T03:16:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.952+0000 7fd24be84700 1 -- start start 2023-10-06T03:16:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.952+0000 7fd24be84700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2440b3fd0 0x7fd2440c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.952+0000 7fd24be84700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd244159500 0x7fd244068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.952+0000 7fd24be84700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24415d8e0 0x7fd244169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.952+0000 7fd24be84700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440c60c0 con 0x7fd244159500 2023-10-06T03:16:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.952+0000 7fd24be84700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24415baf0 con 0x7fd24415d8e0 2023-10-06T03:16:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.952+0000 7fd24be84700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440c5de0 con 0x7fd2440b3fd0 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd244159500 0x7fd244068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd244159500 0x7fd244068c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44056/0 (socket says 172.21.15.82:44056) 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 -- 172.21.15.82:0/2188011489 learned_addr learned my addr 172.21.15.82:0/2188011489 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd249c20700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2440b3fd0 0x7fd2440c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24a421700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24415d8e0 0x7fd244169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 -- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2440b3fd0 msgr2=0x7fd2440c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2440b3fd0 0x7fd2440c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 -- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24415d8e0 msgr2=0x7fd244169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24415d8e0 0x7fd244169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 -- 172.21.15.82:0/2188011489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340094f0 con 0x7fd244159500 2023-10-06T03:16:04.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24941f700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd244159500 0x7fd244068c20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd244088d00 tx=0x7fd234017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd239ffb700 1 -- 172.21.15.82:0/2188011489 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400b910 con 0x7fd244159500 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd239ffb700 1 -- 172.21.15.82:0/2188011489 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400ba70 con 0x7fd244159500 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd239ffb700 1 -- 172.21.15.82:0/2188011489 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234011630 con 0x7fd244159500 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24415b4a0 con 0x7fd244159500 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.953+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440c5ad0 con 0x7fd244159500 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.954+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24415b300 con 0x7fd244159500 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.955+0000 7fd239ffb700 1 -- 172.21.15.82:0/2188011489 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2340119a0 con 0x7fd244159500 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.955+0000 7fd239ffb700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd228066f30 0x7fd2280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.955+0000 7fd239ffb700 1 -- 172.21.15.82:0/2188011489 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd234085dd0 con 0x7fd244159500 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.955+0000 7fd249c20700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd228066f30 0x7fd2280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:04.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.956+0000 7fd249c20700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd228066f30 0x7fd2280693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2440c7370 tx=0x7fd2400091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:04.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:04.960+0000 7fd239ffb700 1 -- 172.21.15.82:0/2188011489 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd24415b300 con 0x7fd244159500 2023-10-06T03:16:05.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.141+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd24415b300 con 0x7fd244159500 2023-10-06T03:16:05.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.141+0000 7fd239ffb700 1 -- 172.21.15.82:0/2188011489 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd24415b300 con 0x7fd244159500 2023-10-06T03:16:05.143 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:16:05.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd228066f30 msgr2=0x7fd2280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd228066f30 0x7fd2280693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2440c7370 tx=0x7fd2400091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd244159500 msgr2=0x7fd244068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd244159500 0x7fd244068c20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd244088d00 tx=0x7fd234017000 comp rx=0 tx=0).stop 2023-10-06T03:16:05.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 shutdown_connections 2023-10-06T03:16:05.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24415d8e0 0x7fd244169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd228066f30 0x7fd2280693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2440b3fd0 0x7fd2440c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 --2- 172.21.15.82:0/2188011489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd244159500 0x7fd244068c20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 >> 172.21.15.82:0/2188011489 conn(0x7fd244067630 msgr2=0x7fd244157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:05.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 shutdown_connections 2023-10-06T03:16:05.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.143+0000 7fd24be84700 1 -- 172.21.15.82:0/2188011489 wait complete. 2023-10-06T03:16:05.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:16:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.272+0000 7fdfd2825700 1 Processor -- start 2023-10-06T03:16:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.272+0000 7fdfd2825700 1 -- start start 2023-10-06T03:16:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd2825700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06b470 0x7fdfcc15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd2825700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfcc0c80d0 0x7fdfcc159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd2825700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc0ae340 con 0x7fdfcc06f270 2023-10-06T03:16:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd2825700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc15e290 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd2825700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0c8870 con 0x7fdfcc06b470 2023-10-06T03:16:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd0dc2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfcc0c80d0 0x7fdfcc159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd0dc2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfcc0c80d0 0x7fdfcc159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44062/0 (socket says 172.21.15.82:44062) 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd0dc2700 1 -- 172.21.15.82:0/1283290474 learned_addr learned my addr 172.21.15.82:0/1283290474 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfcbfff700 1 --2- 172.21.15.82:0/1283290474 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06b470 0x7fdfcc15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd0dc2700 1 -- 172.21.15.82:0/1283290474 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06b470 msgr2=0x7fdfcc15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd0dc2700 1 --2- 172.21.15.82:0/1283290474 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06b470 0x7fdfcc15d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd0dc2700 1 -- 172.21.15.82:0/1283290474 >> v1:172.21.15.134:6789/0 conn(0x7fdfcc06f270 legacy=0x7fdfcc0c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd0dc2700 1 -- 172.21.15.82:0/1283290474 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0afaa0 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfd0dc2700 1 --2- 172.21.15.82:0/1283290474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc159a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009f20 tx=0x7fdfc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e55b5a5e30156 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfcaffd700 1 -- 172.21.15.82:0/1283290474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc400e070 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.273+0000 7fdfcaffd700 1 -- 172.21.15.82:0/1283290474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc400b9d0 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfcaffd700 1 -- 172.21.15.82:0/1283290474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40092e0 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfd2825700 1 -- 172.21.15.82:0/1283290474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 msgr2=0x7fdfcc159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfd2825700 1 --2- 172.21.15.82:0/1283290474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc159a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009f20 tx=0x7fdfc4009840 comp rx=0 tx=0).stop 2023-10-06T03:16:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfd2825700 1 -- 172.21.15.82:0/1283290474 shutdown_connections 2023-10-06T03:16:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfd2825700 1 --2- 172.21.15.82:0/1283290474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc159a60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfd2825700 1 --2- 172.21.15.82:0/1283290474 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06b470 0x7fdfcc15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfd2825700 1 -- 172.21.15.82:0/1283290474 >> 172.21.15.82:0/1283290474 conn(0x7fdfcc06e760 msgr2=0x7fdfcc06eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfd2825700 1 -- 172.21.15.82:0/1283290474 shutdown_connections 2023-10-06T03:16:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.274+0000 7fdfd2825700 1 -- 172.21.15.82:0/1283290474 wait complete. 2023-10-06T03:16:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.275+0000 7fdfd2825700 1 Processor -- start 2023-10-06T03:16:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.275+0000 7fdfd2825700 1 -- start start 2023-10-06T03:16:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd2825700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc06b470 0x7fdfcc0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd2825700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06f270 0x7fdfcc0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd2825700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd2825700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0c7140 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd2825700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b1230 con 0x7fdfcc06b470 2023-10-06T03:16:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd2825700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b0900 con 0x7fdfcc06f270 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc0cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc0cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44074/0 (socket says 172.21.15.82:44074) 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 -- 172.21.15.82:0/3078911202 learned_addr learned my addr 172.21.15.82:0/3078911202 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfcb7fe700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06f270 0x7fdfcc0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfcbfff700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc06b470 0x7fdfcc0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 -- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06f270 msgr2=0x7fdfcc0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06f270 0x7fdfcc0cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 -- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc06b470 msgr2=0x7fdfcc0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc06b470 0x7fdfcc0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 -- 172.21.15.82:0/3078911202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4009ae0 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfcbfff700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc06b470 0x7fdfcc0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.276+0000 7fdfd0dc2700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc0cbba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc06e000 tx=0x7fdfc4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.277+0000 7fdfc3fff700 1 -- 172.21.15.82:0/3078911202 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4007c20 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.277+0000 7fdfc3fff700 1 -- 172.21.15.82:0/3078911202 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc4007d80 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.277+0000 7fdfc3fff700 1 -- 172.21.15.82:0/3078911202 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc401d670 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.277+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc0b0be0 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.277+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc06a090 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.278+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc064050 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.278+0000 7fdfc3fff700 1 -- 172.21.15.82:0/3078911202 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfc4003040 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.278+0000 7fdfc3fff700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdfac066f30 0x7fdfac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.278+0000 7fdfc3fff700 1 -- 172.21.15.82:0/3078911202 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdfc4085e80 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.278+0000 7fdfcbfff700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdfac066f30 0x7fdfac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.279+0000 7fdfcbfff700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdfac066f30 0x7fdfac0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc006f00 tx=0x7fdfbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.283+0000 7fdfc3fff700 1 -- 172.21.15.82:0/3078911202 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfc4052f90 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.466+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfcc0cce00 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.466+0000 7fdfc3fff700 1 -- 172.21.15.82:0/3078911202 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfc40565b0 con 0x7fdfcc0c80d0 2023-10-06T03:16:05.468 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:16:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdfac066f30 msgr2=0x7fdfac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdfac066f30 0x7fdfac0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc006f00 tx=0x7fdfbc008040 comp rx=0 tx=0).stop 2023-10-06T03:16:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 msgr2=0x7fdfcc0cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc0cbba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc06e000 tx=0x7fdfc4018000 comp rx=0 tx=0).stop 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 shutdown_connections 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0c80d0 0x7fdfcc0cbba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc06b470 0x7fdfcc0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdfac066f30 0x7fdfac0693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 --2- 172.21.15.82:0/3078911202 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc06f270 0x7fdfcc0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 >> 172.21.15.82:0/3078911202 conn(0x7fdfcc06e760 msgr2=0x7fdfcc0ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 shutdown_connections 2023-10-06T03:16:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.468+0000 7fdfd2825700 1 -- 172.21.15.82:0/3078911202 wait complete. 2023-10-06T03:16:05.482 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:05.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.594+0000 7fedb016d700 1 Processor -- start 2023-10-06T03:16:05.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.594+0000 7fedb016d700 1 -- start start 2023-10-06T03:16:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedb016d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feda815d560 0x7feda80d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedb016d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda81591b0 0x7feda8159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedb016d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda80b2ad0 con 0x7feda815d930 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedb016d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda80b4160 con 0x7feda815d560 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedb016d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda8159b70 con 0x7feda81591b0 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedadf09700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feda815d560 0x7feda80d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedad708700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feda815d930 0x7feda80b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53994/0 (socket says 172.21.15.82:53994) 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedad708700 1 -- 172.21.15.82:0/4116339351 learned_addr learned my addr 172.21.15.82:0/4116339351 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.595+0000 7fedae70a700 1 --2- 172.21.15.82:0/4116339351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda81591b0 0x7feda8159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedadf09700 1 -- 172.21.15.82:0/4116339351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda81591b0 msgr2=0x7feda8159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedadf09700 1 --2- 172.21.15.82:0/4116339351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda81591b0 0x7feda8159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedadf09700 1 -- 172.21.15.82:0/4116339351 >> v1:172.21.15.82:6789/0 conn(0x7feda815d930 legacy=0x7feda80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedadf09700 1 -- 172.21.15.82:0/4116339351 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80b2230 con 0x7feda815d560 2023-10-06T03:16:05.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedacf07700 1 -- 172.21.15.82:0/4116339351 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698311581 0 0) 0x7feda80b2ad0 con 0x7feda815d930 2023-10-06T03:16:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedadf09700 1 --2- 172.21.15.82:0/4116339351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda80d0030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed98009e60 tx=0x7fed98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8b530bc9c88ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedacf07700 1 -- 172.21.15.82:0/4116339351 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9800e070 con 0x7feda815d560 2023-10-06T03:16:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedacf07700 1 -- 172.21.15.82:0/4116339351 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9800bc30 con 0x7feda815d560 2023-10-06T03:16:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedacf07700 1 -- 172.21.15.82:0/4116339351 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98012430 con 0x7feda815d560 2023-10-06T03:16:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedb016d700 1 -- 172.21.15.82:0/4116339351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 msgr2=0x7feda80d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedb016d700 1 --2- 172.21.15.82:0/4116339351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda80d0030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed98009e60 tx=0x7fed98009780 comp rx=0 tx=0).stop 2023-10-06T03:16:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedb016d700 1 -- 172.21.15.82:0/4116339351 shutdown_connections 2023-10-06T03:16:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedb016d700 1 --2- 172.21.15.82:0/4116339351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda80d0030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedb016d700 1 --2- 172.21.15.82:0/4116339351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda81591b0 0x7feda8159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedb016d700 1 -- 172.21.15.82:0/4116339351 >> 172.21.15.82:0/4116339351 conn(0x7feda80d1180 msgr2=0x7feda8069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedb016d700 1 -- 172.21.15.82:0/4116339351 shutdown_connections 2023-10-06T03:16:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.596+0000 7fedb016d700 1 -- 172.21.15.82:0/4116339351 wait complete. 2023-10-06T03:16:05.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.597+0000 7fedb016d700 1 Processor -- start 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedb016d700 1 -- start start 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedb016d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda81591b0 0x7feda814ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedb016d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda8151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedb016d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda815d930 0x7feda815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedb016d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda8150cf0 con 0x7feda815d560 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedb016d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda8151590 con 0x7feda81591b0 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedb016d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda815f3f0 con 0x7feda815d930 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedad708700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda8151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedad708700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda8151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44104/0 (socket says 172.21.15.82:44104) 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedad708700 1 -- 172.21.15.82:0/3337249034 learned_addr learned my addr 172.21.15.82:0/3337249034 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedadf09700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda81591b0 0x7feda814ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.598+0000 7fedae70a700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda815d930 0x7feda815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7fedad708700 1 -- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda815d930 msgr2=0x7feda815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7fedad708700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda815d930 0x7feda815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7fedad708700 1 -- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda81591b0 msgr2=0x7feda814ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7fedad708700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda81591b0 0x7feda814ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7fedad708700 1 -- 172.21.15.82:0/3337249034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98009a20 con 0x7feda815d560 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7fedad708700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda8151a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00c5b0 tx=0x7fed9c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7feda5ffb700 1 -- 172.21.15.82:0/3337249034 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c005b30 con 0x7feda815d560 2023-10-06T03:16:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7feda5ffb700 1 -- 172.21.15.82:0/3337249034 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c005c90 con 0x7feda815d560 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda8150f40 con 0x7feda815d560 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7feda5ffb700 1 -- 172.21.15.82:0/3337249034 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c007300 con 0x7feda815d560 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.599+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda814f210 con 0x7feda815d560 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.600+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda8151700 con 0x7feda815d560 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.600+0000 7feda5ffb700 1 -- 172.21.15.82:0/3337249034 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed9c01b3b0 con 0x7feda815d560 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.600+0000 7feda5ffb700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fed94066f30 0x7fed940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.601+0000 7feda5ffb700 1 -- 172.21.15.82:0/3337249034 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fed9c083bc0 con 0x7feda815d560 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.601+0000 7fedadf09700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fed94066f30 0x7fed940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.601+0000 7fedadf09700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fed94066f30 0x7fed940693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed98009e60 tx=0x7fed98019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.605+0000 7feda5ffb700 1 -- 172.21.15.82:0/3337249034 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed9c050cd0 con 0x7feda815d560 2023-10-06T03:16:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.831+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feda8064050 con 0x7feda815d560 2023-10-06T03:16:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.831+0000 7feda5ffb700 1 -- 172.21.15.82:0/3337249034 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fed9c017090 con 0x7feda815d560 2023-10-06T03:16:05.833 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:05.833 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:15:51.763473+0000","modified":"2023-10-06T03:15:55.399812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fed94066f30 msgr2=0x7fed940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fed94066f30 0x7fed940693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed98009e60 tx=0x7fed98019000 comp rx=0 tx=0).stop 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 msgr2=0x7feda8151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda8151a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00c5b0 tx=0x7fed9c001070 comp rx=0 tx=0).stop 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 shutdown_connections 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fed94066f30 0x7fed940693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda815d930 0x7feda815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda81591b0 0x7feda814ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 --2- 172.21.15.82:0/3337249034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda815d560 0x7feda8151a20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 >> 172.21.15.82:0/3337249034 conn(0x7feda80d1180 msgr2=0x7feda80b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:05.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 shutdown_connections 2023-10-06T03:16:05.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.834+0000 7fedb016d700 1 -- 172.21.15.82:0/3337249034 wait complete. 2023-10-06T03:16:05.837 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-10-06T03:16:05.847 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.960+0000 7fe8e0574700 1 Processor -- start 2023-10-06T03:16:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.960+0000 7fe8e0574700 1 -- start start 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8e0574700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8d8157570 0x7fe8d80b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8e0574700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d81580d0 con 0x7fe8d815b210 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8e0574700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d815ba40 con 0x7fe8d80add70 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8e0574700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d8158c70 con 0x7fe8d8157570 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe8d815b210 0x7fe8d8158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54000/0 (socket says 172.21.15.82:54000) 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 -- 172.21.15.82:0/1541404265 learned_addr learned my addr 172.21.15.82:0/1541404265 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8de310700 1 --2- 172.21.15.82:0/1541404265 >> v2:172.21.15.134:3300/0 conn(0x7fe8d8157570 0x7fe8d80b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838226339 0 0) 0x7fe8d81580d0 con 0x7fe8d815b210 2023-10-06T03:16:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c0003570 con 0x7fe8d815b210 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 126644835 0 0) 0x7fe8c0003570 con 0x7fe8d815b210 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 >> v2:172.21.15.134:3300/0 conn(0x7fe8d8157570 msgr2=0x7fe8d80b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 --2- 172.21.15.82:0/1541404265 >> v2:172.21.15.134:3300/0 conn(0x7fe8d8157570 0x7fe8d80b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 >> v1:172.21.15.134:6789/0 conn(0x7fe8d80add70 legacy=0x7fe8d80ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d815bd20 con 0x7fe8d815b210 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fe8cc001470 con 0x7fe8d815b210 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 >> v1:172.21.15.82:6789/0 conn(0x7fe8d815b210 legacy=0x7fe8d8158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8c0003a60 0x7fe8c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c0004810 0x7fe8c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c00051c0 0x7fe8c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8158c70 con 0x7fe8c0004810 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c000c0d0 con 0x7fe8c00051c0 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c000c290 con 0x7fe8c0003a60 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c0004810 0x7fe8c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8de310700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8c0003a60 0x7fe8c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8deb11700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c00051c0 0x7fe8c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 -- 172.21.15.82:0/1541404265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8c0003a60 msgr2=0x7fe8c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8c0003a60 0x7fe8c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 -- 172.21.15.82:0/1541404265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c00051c0 msgr2=0x7fe8c000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c00051c0 0x7fe8c000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8deb11700 1 -- 172.21.15.82:0/1541404265 reap_dead start 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 -- 172.21.15.82:0/1541404265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0003570 con 0x7fe8c0004810 2023-10-06T03:16:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.962+0000 7fe8ddb0f700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c0004810 0x7fe8c0004c80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00c3c0 tx=0x7fe8cc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff70907670a44c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00cc90 con 0x7fe8c0004810 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00cdf0 con 0x7fe8c0004810 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8dd30e700 1 -- 172.21.15.82:0/1541404265 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc005b50 con 0x7fe8c0004810 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8e0574700 1 -- 172.21.15.82:0/1541404265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c0004810 msgr2=0x7fe8c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8e0574700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c0004810 0x7fe8c0004c80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00c3c0 tx=0x7fe8cc001e50 comp rx=0 tx=0).stop 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8e0574700 1 -- 172.21.15.82:0/1541404265 shutdown_connections 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8e0574700 1 --2- 172.21.15.82:0/1541404265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c0004810 0x7fe8c0004c80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8e0574700 1 -- 172.21.15.82:0/1541404265 >> 172.21.15.82:0/1541404265 conn(0x7fe8d8067630 msgr2=0x7fe8d8067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8e0574700 1 -- 172.21.15.82:0/1541404265 shutdown_connections 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.963+0000 7fe8e0574700 1 -- 172.21.15.82:0/1541404265 wait complete. 2023-10-06T03:16:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.965+0000 7fe8e0574700 1 Processor -- start 2023-10-06T03:16:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.965+0000 7fe8e0574700 1 -- start start 2023-10-06T03:16:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8e0574700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c0004810 0x7fe8d80c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8e0574700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d8169dd0 0x7fe8d80acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8e0574700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8068fd0 0x7fe8d80c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8e0574700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d816ae10 con 0x7fe8d8068fd0 2023-10-06T03:16:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8e0574700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80c9a80 con 0x7fe8c0004810 2023-10-06T03:16:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8e0574700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d816a570 con 0x7fe8d8169dd0 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8deb11700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8068fd0 0x7fe8d80c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8deb11700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8068fd0 0x7fe8d80c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44122/0 (socket says 172.21.15.82:44122) 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8deb11700 1 -- 172.21.15.82:0/4196276571 learned_addr learned my addr 172.21.15.82:0/4196276571 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8deb11700 1 -- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d8169dd0 msgr2=0x7fe8d80acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8ddb0f700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d8169dd0 0x7fe8d80acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8deb11700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d8169dd0 0x7fe8d80acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8deb11700 1 -- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c0004810 msgr2=0x7fe8d80c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8deb11700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c0004810 0x7fe8d80c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.966+0000 7fe8deb11700 1 -- 172.21.15.82:0/4196276571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d816a850 con 0x7fe8d8068fd0 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.967+0000 7fe8deb11700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8068fd0 0x7fe8d80c9f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8064a30 tx=0x7fe8d0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.967+0000 7fe8d67fc700 1 -- 172.21.15.82:0/4196276571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0006b00 con 0x7fe8d8068fd0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.967+0000 7fe8d67fc700 1 -- 172.21.15.82:0/4196276571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0006c60 con 0x7fe8d8068fd0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.967+0000 7fe8d67fc700 1 -- 172.21.15.82:0/4196276571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0007030 con 0x7fe8d8068fd0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.967+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d816ab30 con 0x7fe8d8068fd0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.967+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d80ad000 con 0x7fe8d8068fd0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.968+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d8064050 con 0x7fe8d8068fd0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.968+0000 7fe8d67fc700 1 -- 172.21.15.82:0/4196276571 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8d00073e0 con 0x7fe8d8068fd0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.968+0000 7fe8d67fc700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.968+0000 7fe8d67fc700 1 -- 172.21.15.82:0/4196276571 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe8d0083760 con 0x7fe8d8068fd0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.968+0000 7fe8de310700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.968+0000 7fe8de310700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8c4066f30 0x7fe8c40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009fd0 tx=0x7fe8c800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:05.971+0000 7fe8d67fc700 1 -- 172.21.15.82:0/4196276571 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8d0054300 con 0x7fe8d8068fd0 2023-10-06T03:16:06.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.158+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8d80c9bf0 con 0x7fe8d8068fd0 2023-10-06T03:16:06.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.159+0000 7fe8d67fc700 1 -- 172.21.15.82:0/4196276571 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fe8d0019020 con 0x7fe8d8068fd0 2023-10-06T03:16:06.160 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:06.160 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:06.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8c4066f30 msgr2=0x7fe8c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8c4066f30 0x7fe8c40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009fd0 tx=0x7fe8c800b040 comp rx=0 tx=0).stop 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8068fd0 msgr2=0x7fe8d80c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8068fd0 0x7fe8d80c9f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8064a30 tx=0x7fe8d0007d30 comp rx=0 tx=0).stop 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 shutdown_connections 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8068fd0 0x7fe8d80c9f10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c0004810 0x7fe8d80c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 --2- 172.21.15.82:0/4196276571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d8169dd0 0x7fe8d80acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 >> 172.21.15.82:0/4196276571 conn(0x7fe8d8067630 msgr2=0x7fe8d806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 shutdown_connections 2023-10-06T03:16:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.161+0000 7fe8e0574700 1 -- 172.21.15.82:0/4196276571 wait complete. 2023-10-06T03:16:06.173 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:06.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.287+0000 7f80a2ec2700 1 Processor -- start 2023-10-06T03:16:06.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.287+0000 7f80a2ec2700 1 -- start start 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a2ec2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f809c0cc2d0 0x7f809c0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a2ec2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c0699c0 0x7f809c143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a2ec2700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809c143690 con 0x7f809c142cd0 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a2ec2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c069e20 con 0x7f809c0cc2d0 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a2ec2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c06a030 con 0x7f809c0699c0 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a1ec0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f809c0cc2d0 0x7f809c0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a16bf700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f809c142cd0 0x7f809c0692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54016/0 (socket says 172.21.15.82:54016) 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a16bf700 1 -- 172.21.15.82:0/1163919547 learned_addr learned my addr 172.21.15.82:0/1163919547 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:06.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a26c1700 1 --2- 172.21.15.82:0/1163919547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c0699c0 0x7f809c143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a1ec0700 1 -- 172.21.15.82:0/1163919547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c0699c0 msgr2=0x7f809c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a1ec0700 1 --2- 172.21.15.82:0/1163919547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c0699c0 0x7f809c143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a1ec0700 1 -- 172.21.15.82:0/1163919547 >> v1:172.21.15.82:6789/0 conn(0x7f809c142cd0 legacy=0x7f809c0692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a1ec0700 1 -- 172.21.15.82:0/1163919547 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c06a310 con 0x7f809c0cc2d0 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a0ebe700 1 -- 172.21.15.82:0/1163919547 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051351102 0 0) 0x7f8090001110 con 0x7f809c142cd0 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a26c1700 1 --2- 172.21.15.82:0/1163919547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c0699c0 0x7f809c143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.288+0000 7f80a1ec0700 1 --2- 172.21.15.82:0/1163919547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c0cc6a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8094009eb0 tx=0x7f8094009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48aa067802b10fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a0ebe700 1 -- 172.21.15.82:0/1163919547 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809400e070 con 0x7f809c0cc2d0 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a0ebe700 1 -- 172.21.15.82:0/1163919547 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809400bc30 con 0x7f809c0cc2d0 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a0ebe700 1 -- 172.21.15.82:0/1163919547 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094012430 con 0x7f809c0cc2d0 2023-10-06T03:16:06.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1163919547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 msgr2=0x7f809c0cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:06.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1163919547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c0cc6a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8094009eb0 tx=0x7f8094009780 comp rx=0 tx=0).stop 2023-10-06T03:16:06.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1163919547 shutdown_connections 2023-10-06T03:16:06.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1163919547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c0cc6a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1163919547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c0699c0 0x7f809c143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1163919547 >> 172.21.15.82:0/1163919547 conn(0x7f809c0ce330 msgr2=0x7f809c0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:06.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1163919547 shutdown_connections 2023-10-06T03:16:06.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.289+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1163919547 wait complete. 2023-10-06T03:16:06.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.290+0000 7f80a2ec2700 1 Processor -- start 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.290+0000 7f80a2ec2700 1 -- start start 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a2ec2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f809c0699c0 0x7f809c159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a2ec2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a2ec2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c142cd0 0x7f809c1401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a2ec2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c15b690 con 0x7f809c0cc2d0 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a2ec2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c16ce10 con 0x7f809c0699c0 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a2ec2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c16d0f0 con 0x7f809c142cd0 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c15b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44148/0 (socket says 172.21.15.82:44148) 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 -- 172.21.15.82:0/1736930897 learned_addr learned my addr 172.21.15.82:0/1736930897 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:06.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a26c1700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c142cd0 0x7f809c1401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a1ec0700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f809c0699c0 0x7f809c159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 -- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c142cd0 msgr2=0x7f809c1401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c142cd0 0x7f809c1401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 -- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f809c0699c0 msgr2=0x7f809c159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f809c0699c0 0x7f809c159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 -- 172.21.15.82:0/1736930897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8094009a20 con 0x7f809c0cc2d0 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a1ec0700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f809c0699c0 0x7f809c159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a26c1700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c142cd0 0x7f809c1401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.291+0000 7f80a16bf700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c15b150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f809000c5b0 tx=0x7f8090001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.292+0000 7f8099ffb700 1 -- 172.21.15.82:0/1736930897 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090005b30 con 0x7f809c0cc2d0 2023-10-06T03:16:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.292+0000 7f8099ffb700 1 -- 172.21.15.82:0/1736930897 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090005c90 con 0x7f809c0cc2d0 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.292+0000 7f8099ffb700 1 -- 172.21.15.82:0/1736930897 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090007300 con 0x7f809c0cc2d0 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.292+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c15b8c0 con 0x7f809c0cc2d0 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.292+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c15be80 con 0x7f809c0cc2d0 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.293+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c16d2a0 con 0x7f809c0cc2d0 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.293+0000 7f8099ffb700 1 -- 172.21.15.82:0/1736930897 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f809001b3b0 con 0x7f809c0cc2d0 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.293+0000 7f8099ffb700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.293+0000 7f8099ffb700 1 -- 172.21.15.82:0/1736930897 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8090083a50 con 0x7f809c0cc2d0 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.294+0000 7f80a1ec0700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.294+0000 7f80a1ec0700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8088066f30 0x7f80880693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8094009eb0 tx=0x7f8094017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:06.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.297+0000 7f8099ffb700 1 -- 172.21.15.82:0/1736930897 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f809c16d2a0 con 0x7f809c0cc2d0 2023-10-06T03:16:06.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.528+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f809c143690 con 0x7f809c0cc2d0 2023-10-06T03:16:06.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.528+0000 7f8099ffb700 1 -- 172.21.15.82:0/1736930897 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f809c143690 con 0x7f809c0cc2d0 2023-10-06T03:16:06.529 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:06.529 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:15:51.763473+0000","modified":"2023-10-06T03:15:55.399812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:16:06.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8088066f30 msgr2=0x7f80880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:06.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8088066f30 0x7f80880693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8094009eb0 tx=0x7f8094017000 comp rx=0 tx=0).stop 2023-10-06T03:16:06.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 msgr2=0x7f809c15b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:06.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c15b150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f809000c5b0 tx=0x7f8090001070 comp rx=0 tx=0).stop 2023-10-06T03:16:06.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 shutdown_connections 2023-10-06T03:16:06.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f809c142cd0 0x7f809c1401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f809c0699c0 0x7f809c159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 --2- 172.21.15.82:0/1736930897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0cc2d0 0x7f809c15b150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:06.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 >> 172.21.15.82:0/1736930897 conn(0x7f809c0ce330 msgr2=0x7f809c0c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:06.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 shutdown_connections 2023-10-06T03:16:06.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:06.531+0000 7f80a2ec2700 1 -- 172.21.15.82:0/1736930897 wait complete. 2023-10-06T03:16:06.533 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-10-06T03:16:06.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:15:51.763473+0000', 'modified': '2023-10-06T03:15:55.399812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6837/585628338', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6835', 'nonce': 585628338}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 585628338}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:16:06.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:16:06.946 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:16:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.061+0000 7fd862634700 1 Processor -- start 2023-10-06T03:16:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.061+0000 7fd862634700 1 -- start start 2023-10-06T03:16:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd862634700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd85c142e90 0x7fd85c069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd862634700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd85c069d50 0x7fd85c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd862634700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd85c15de80 0x7fd85c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd862634700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c069380 con 0x7fd85c069d50 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd862634700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c068770 con 0x7fd85c15de80 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd862634700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c068a50 con 0x7fd85c142e90 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd860e31700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd85c069d50 0x7fd85c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd860e31700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd85c069d50 0x7fd85c15d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44156/0 (socket says 172.21.15.82:44156) 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd860e31700 1 -- 172.21.15.82:0/572776077 learned_addr learned my addr 172.21.15.82:0/572776077 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd860e31700 1 -- 172.21.15.82:0/572776077 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd85c142e90 msgr2=0x7fd85c069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd860e31700 1 --2- 172.21.15.82:0/572776077 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd85c142e90 0x7fd85c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd860e31700 1 -- 172.21.15.82:0/572776077 >> v2:172.21.15.134:3300/0 conn(0x7fd85c15de80 msgr2=0x7fd85c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd861e33700 1 --2- 172.21.15.82:0/572776077 >> v2:172.21.15.134:3300/0 conn(0x7fd85c15de80 0x7fd85c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd860e31700 1 --2- 172.21.15.82:0/572776077 >> v2:172.21.15.134:3300/0 conn(0x7fd85c15de80 0x7fd85c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd860e31700 1 -- 172.21.15.82:0/572776077 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c068d30 con 0x7fd85c069d50 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.062+0000 7fd861e33700 1 --2- 172.21.15.82:0/572776077 >> v2:172.21.15.134:3300/0 conn(0x7fd85c15de80 0x7fd85c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd860e31700 1 --2- 172.21.15.82:0/572776077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c069d50 0x7fd85c15d290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0b2360 tx=0x7fd850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fe8b4770db9c7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd85bfff700 1 -- 172.21.15.82:0/572776077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000b860 con 0x7fd85c069d50 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd85bfff700 1 -- 172.21.15.82:0/572776077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85000b9c0 con 0x7fd85c069d50 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd85bfff700 1 -- 172.21.15.82:0/572776077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000bd60 con 0x7fd85c069d50 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 -- 172.21.15.82:0/572776077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c069d50 msgr2=0x7fd85c15d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 --2- 172.21.15.82:0/572776077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c069d50 0x7fd85c15d290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0b2360 tx=0x7fd850009250 comp rx=0 tx=0).stop 2023-10-06T03:16:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 -- 172.21.15.82:0/572776077 shutdown_connections 2023-10-06T03:16:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 --2- 172.21.15.82:0/572776077 >> v2:172.21.15.134:3300/0 conn(0x7fd85c15de80 0x7fd85c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 --2- 172.21.15.82:0/572776077 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd85c142e90 0x7fd85c069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 --2- 172.21.15.82:0/572776077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c069d50 0x7fd85c15d290 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 -- 172.21.15.82:0/572776077 >> 172.21.15.82:0/572776077 conn(0x7fd85c0ccfe0 msgr2=0x7fd85c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 -- 172.21.15.82:0/572776077 shutdown_connections 2023-10-06T03:16:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.063+0000 7fd862634700 1 -- 172.21.15.82:0/572776077 wait complete. 2023-10-06T03:16:07.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.064+0000 7fd862634700 1 Processor -- start 2023-10-06T03:16:07.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.064+0000 7fd862634700 1 -- start start 2023-10-06T03:16:07.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd862634700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c069d50 0x7fd85c16cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd862634700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c142e90 0x7fd85c15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd862634700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd85c15de80 0x7fd85c141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd862634700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c16c690 con 0x7fd85c142e90 2023-10-06T03:16:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd862634700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c16ba80 con 0x7fd85c069d50 2023-10-06T03:16:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd862634700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c16bd60 con 0x7fd85c15de80 2023-10-06T03:16:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd860e31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c142e90 0x7fd85c15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd860e31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c142e90 0x7fd85c15c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44170/0 (socket says 172.21.15.82:44170) 2023-10-06T03:16:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd860e31700 1 -- 172.21.15.82:0/1350160875 learned_addr learned my addr 172.21.15.82:0/1350160875 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.065+0000 7fd860e31700 1 -- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd85c15de80 msgr2=0x7fd85c141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd860e31700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd85c15de80 0x7fd85c141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd860e31700 1 -- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c069d50 msgr2=0x7fd85c16cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd860e31700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c069d50 0x7fd85c16cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd860e31700 1 -- 172.21.15.82:0/1350160875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500094f0 con 0x7fd85c142e90 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd860e31700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c142e90 0x7fd85c15c4e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd850009290 tx=0x7fd850017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd8597fa700 1 -- 172.21.15.82:0/1350160875 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850026480 con 0x7fd85c142e90 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd8597fa700 1 -- 172.21.15.82:0/1350160875 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85001f070 con 0x7fd85c142e90 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd862634700 1 -- 172.21.15.82:0/1350160875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c16c040 con 0x7fd85c142e90 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd8597fa700 1 -- 172.21.15.82:0/1350160875 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850026850 con 0x7fd85c142e90 2023-10-06T03:16:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.066+0000 7fd862634700 1 -- 172.21.15.82:0/1350160875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c15ca20 con 0x7fd85c142e90 2023-10-06T03:16:07.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.067+0000 7fd8597fa700 1 -- 172.21.15.82:0/1350160875 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd85001a430 con 0x7fd85c142e90 2023-10-06T03:16:07.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.068+0000 7fd8597fa700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.068+0000 7fd8597fa700 1 -- 172.21.15.82:0/1350160875 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd850021070 con 0x7fd85c142e90 2023-10-06T03:16:07.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.068+0000 7fd861632700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.068+0000 7fd861632700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd848066f30 0x7fd8480693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00acf0 tx=0x7fd84c009370 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd86cb8eb80 1 Processor -- start 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd86cb8eb80 1 -- start start 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667aede50 0x560667ac8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667ac9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667acfa10 0x560667ac9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560667a23a70 con 0x560667aede50 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560667a21270 con 0x560667ace2c0 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560667a1d060 con 0x560667acfa10 2023-10-06T03:16:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd861632700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667aede50 0x560667ac8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd861632700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667aede50 0x560667ac8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44184/0 (socket says 172.21.15.82:44184) 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.070+0000 7fd861632700 1 -- 172.21.15.82:0/2793667884 learned_addr learned my addr 172.21.15.82:0/2793667884 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd861e33700 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667acfa10 0x560667ac9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd860e31700 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667ac9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd861632700 1 -- 172.21.15.82:0/2793667884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667acfa10 msgr2=0x560667ac9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd861632700 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667acfa10 0x560667ac9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd861632700 1 -- 172.21.15.82:0/2793667884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 msgr2=0x560667ac9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd861632700 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667ac9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd861632700 1 -- 172.21.15.82:0/2793667884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606678b7270 con 0x560667aede50 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd861632700 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667aede50 0x560667ac8cc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009250 tx=0x7fd84c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32479e27aea2a4ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd8427fc700 1 -- 172.21.15.82:0/2793667884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c01c070 con 0x560667aede50 2023-10-06T03:16:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd8427fc700 1 -- 172.21.15.82:0/2793667884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c009960 con 0x560667aede50 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd8427fc700 1 -- 172.21.15.82:0/2793667884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00f070 con 0x560667aede50 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/2793667884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667aede50 msgr2=0x560667ac8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667aede50 0x560667ac8cc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009250 tx=0x7fd84c012000 comp rx=0 tx=0).stop 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.071+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/2793667884 shutdown_connections 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.072+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667acfa10 0x560667ac9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.072+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667aede50 0x560667ac8cc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.072+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/2793667884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667ac9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.072+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/2793667884 >> 172.21.15.82:0/2793667884 conn(0x560667acde80 msgr2=0x560667ace6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.072+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/2793667884 shutdown_connections 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.072+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/2793667884 wait complete. 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.072+0000 7fd86cb8eb80 1 -- start start 2023-10-06T03:16:07.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.072+0000 7fd86cb8eb80 1 Processor -- start 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667ace2c0 0x560667ac93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667aeb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667aede50 0x560667aeb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606679c8890 con 0x560667acfa10 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606679e3ea0 con 0x560667aede50 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x56066789fe30 con 0x560667ace2c0 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd86cb8eb80 10 client.0 _ll_register_callbacks cb 0x560667a90020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd860e31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667aeb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd860e31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667aeb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44198/0 (socket says 172.21.15.82:44198) 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd860e31700 1 -- 172.21.15.82:0/610053228 learned_addr learned my addr 172.21.15.82:0/610053228 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd861632700 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667ace2c0 0x560667ac93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd861e33700 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667aede50 0x560667aeb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd860e31700 1 -- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667ace2c0 msgr2=0x560667ac93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd860e31700 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667ace2c0 0x560667ac93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd860e31700 1 -- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667aede50 msgr2=0x560667aeb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd860e31700 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667aede50 0x560667aeb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.073+0000 7fd860e31700 1 -- 172.21.15.82:0/610053228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c008e60 con 0x560667acfa10 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd860e31700 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667aeb480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd850012fd0 tx=0x7fd850084960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2374409cbcd8ce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd83b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd83b7fe700 1 -- 172.21.15.82:0/610053228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85005a6c0 con 0x560667acfa10 2023-10-06T03:16:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd83b7fe700 1 -- 172.21.15.82:0/610053228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd85005e3b0 con 0x560667acfa10 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/610053228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560667ac1940 con 0x560667acfa10 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd83b7fe700 1 -- 172.21.15.82:0/610053228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd850057880 con 0x560667acfa10 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 10 client.4704 fetch_fsmap learned FSMap version 7 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/610053228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x560667859fe0 con 0x560667acfa10 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd83b7fe700 1 -- 172.21.15.82:0/610053228 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560667ac1940 con 0x560667acfa10 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd83b7fe700 1 -- 172.21.15.82:0/610053228 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd850056900 con 0x560667acfa10 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 10 client.4704 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 10 client.4704 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 20 client.4704 populate_metadata read hostname 'smithi082' 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] conn(0x560667b13e30 0x560667b14200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 4 client.4704 mds_command: new command op to 4285 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:16:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/610053228 --> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560667a9e870 con 0x560667b13e30 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.074+0000 7fd861632700 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] conn(0x560667b13e30 0x560667b14200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.075+0000 7fd83b7fe700 10 client.4704 ms_handle_connect on v2:172.21.15.134:6835/585628338 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.075+0000 7fd861632700 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] conn(0x560667b13e30 0x560667b14200 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b29768839a4244e4 server_cookie=505cd9f6be613c3 in_seq=0 out_seq=0 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.075+0000 7fd83b7fe700 1 -- 172.21.15.82:0/610053228 <== mds.0 v2:172.21.15.134:6835/585628338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560667a9e870 con 0x560667b13e30 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.075+0000 7fd83b7fe700 10 client.4704 handle_command_reply: tid=0 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.075+0000 7fd86cb8eb80 1 client.4704 shutdown 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/610053228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 msgr2=0x560667aeb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667aeb480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd850012fd0 tx=0x7fd850084960 comp rx=0 tx=0).stop 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/610053228 shutdown_connections 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] conn(0x560667b13e30 0x560667b14200 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667aede50 0x560667aeb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd83b7fe700 0 client.4704 ms_handle_reset on v2:172.21.15.134:6835/585628338 2023-10-06T03:16:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667ace2c0 0x560667ac93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/610053228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667aeb480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/610053228 >> 172.21.15.82:0/610053228 conn(0x560667acde80 msgr2=0x560667aced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/610053228 shutdown_connections 2023-10-06T03:16:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/610053228 wait complete. 2023-10-06T03:16:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.076+0000 7fd86cb8eb80 20 client.4704 trim_cache size 0 max 16384 2023-10-06T03:16:07.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd86cb8eb80 1 Processor -- start 2023-10-06T03:16:07.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd86cb8eb80 1 -- start start 2023-10-06T03:16:07.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667b22500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667af8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667af90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560667ad03f0 con 0x560667acfa10 2023-10-06T03:16:07.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560667b26570 con 0x560667ace2c0 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560667aca300 con 0x560667aede50 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.093+0000 7fd860e31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667af8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd860e31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667af8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44204/0 (socket says 172.21.15.82:44204) 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd860e31700 1 -- 172.21.15.82:0/736601602 learned_addr learned my addr 172.21.15.82:0/736601602 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd861632700 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667b22500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd861e33700 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667af90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd860e31700 1 -- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 msgr2=0x560667af90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd860e31700 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667af90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd860e31700 1 -- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 msgr2=0x560667b22500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd860e31700 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667b22500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd860e31700 1 -- 172.21.15.82:0/736601602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606679eb780 con 0x560667acfa10 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd861632700 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667b22500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd860e31700 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667af8b90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd850006fd0 tx=0x7fd850027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927ab902a4282404 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd842ffd700 1 -- 172.21.15.82:0/736601602 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85005e3b0 con 0x560667acfa10 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd842ffd700 1 -- 172.21.15.82:0/736601602 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd850080050 con 0x560667acfa10 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd842ffd700 1 -- 172.21.15.82:0/736601602 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850057880 con 0x560667acfa10 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/736601602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 msgr2=0x560667af8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.094+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667af8b90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd850006fd0 tx=0x7fd850027000 comp rx=0 tx=0).stop 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/736601602 shutdown_connections 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667af90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667ace2c0 0x560667b22500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/736601602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667acfa10 0x560667af8b90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/736601602 >> 172.21.15.82:0/736601602 conn(0x560667acde80 msgr2=0x560667aee910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:07.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/736601602 shutdown_connections 2023-10-06T03:16:07.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/736601602 wait complete. 2023-10-06T03:16:07.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 -- start start 2023-10-06T03:16:07.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.095+0000 7fd86cb8eb80 1 Processor -- start 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667ace2c0 0x560667b15bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667acfa10 0x560667afbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd86cb8eb80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667b6ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560667aec7e0 con 0x560667ace2c0 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560667aecd10 con 0x560667acfa10 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd86cb8eb80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560667afb360 con 0x560667aede50 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd86cb8eb80 10 client.0 _ll_register_callbacks cb 0x560667a90020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861632700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667ace2c0 0x560667b15bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861632700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667ace2c0 0x560667b15bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44206/0 (socket says 172.21.15.82:44206) 2023-10-06T03:16:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861632700 1 -- 172.21.15.82:0/240897976 learned_addr learned my addr 172.21.15.82:0/240897976 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861e33700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667b6ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd860e31700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667acfa10 0x560667afbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861632700 1 -- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 msgr2=0x560667b6ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861632700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667b6ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861632700 1 -- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667acfa10 msgr2=0x560667afbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861632700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667acfa10 0x560667afbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861632700 1 -- 172.21.15.82:0/240897976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560667859fe0 con 0x560667ace2c0 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd860e31700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667acfa10 0x560667afbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.096+0000 7fd861e33700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667b6ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd861632700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667ace2c0 0x560667b15bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009480 tx=0x7fd84c027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2194bc12d13c7a97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd83b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd83b7fe700 1 -- 172.21.15.82:0/240897976 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0170c0 con 0x560667ace2c0 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd83b7fe700 1 -- 172.21.15.82:0/240897976 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd84c017220 con 0x560667ace2c0 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/240897976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd84c009960 con 0x560667ace2c0 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd83b7fe700 1 -- 172.21.15.82:0/240897976 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd84c016e70 con 0x560667ace2c0 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 10 client.4710 fetch_fsmap learned FSMap version 7 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/240897976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5606679d2470 con 0x560667ace2c0 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd83b7fe700 1 -- 172.21.15.82:0/240897976 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c009960 con 0x560667ace2c0 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd83b7fe700 1 -- 172.21.15.82:0/240897976 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd84c017970 con 0x560667ace2c0 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 10 client.4710 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 10 client.4710 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 20 client.4710 populate_metadata read hostname 'smithi082' 2023-10-06T03:16:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] conn(0x560667af90a0 0x560667af9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 4 client.4710 mds_command: new command op to 4285 tid=0[{"prefix": "status"}] 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/240897976 --> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5606679bfe00 con 0x560667af90a0 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.097+0000 7fd860e31700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] conn(0x560667af90a0 0x560667af9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd83b7fe700 10 client.4710 ms_handle_connect on v2:172.21.15.134:6835/585628338 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd860e31700 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] conn(0x560667af90a0 0x560667af9470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504f1a1ab13a7422 server_cookie=f8e28577dbcace1e in_seq=0 out_seq=0 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd83b7fe700 1 -- 172.21.15.82:0/240897976 <== mds.0 v2:172.21.15.134:6835/585628338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5606679bfe00 con 0x560667af90a0 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd83b7fe700 10 client.4710 handle_command_reply: tid=0 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 client.4710 shutdown 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/240897976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667ace2c0 msgr2=0x560667b15bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667ace2c0 0x560667b15bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009480 tx=0x7fd84c027040 comp rx=0 tx=0).stop 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/240897976 shutdown_connections 2023-10-06T03:16:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560667aede50 0x560667b6ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560667ace2c0 0x560667b15bb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:6835/585628338,v1:172.21.15.134:6837/585628338] conn(0x560667af90a0 0x560667af9470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 --2- 172.21.15.82:0/240897976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560667acfa10 0x560667afbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd83b7fe700 0 client.4710 ms_handle_reset on v2:172.21.15.134:6835/585628338 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/240897976 >> 172.21.15.82:0/240897976 conn(0x560667acde80 msgr2=0x560667b22500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/240897976 shutdown_connections 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 1 -- 172.21.15.82:0/240897976 wait complete. 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.098+0000 7fd86cb8eb80 20 client.4710 trim_cache size 0 max 16384 2023-10-06T03:16:07.108 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "968d6894-b90c-4b96-8e67-09d8a805d810", 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4285, 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 14.697548139, 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 7, 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 20, 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 20, 2023-10-06T03:16:07.109 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 20.631945856000002 2023-10-06T03:16:07.110 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:16:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 -- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd848066f30 msgr2=0x7fd8480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd848066f30 0x7fd8480693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00acf0 tx=0x7fd84c009370 comp rx=0 tx=0).stop 2023-10-06T03:16:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 -- 172.21.15.82:0/1350160875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c142e90 msgr2=0x7fd85c15c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c142e90 0x7fd85c15c4e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd850009290 tx=0x7fd850017000 comp rx=0 tx=0).stop 2023-10-06T03:16:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 -- 172.21.15.82:0/1350160875 shutdown_connections 2023-10-06T03:16:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd85c15de80 0x7fd85c141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd85c069d50 0x7fd85c16cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 --2- 172.21.15.82:0/1350160875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85c142e90 0x7fd85c15c4e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 -- 172.21.15.82:0/1350160875 >> 172.21.15.82:0/1350160875 conn(0x7fd85c0ccfe0 msgr2=0x7fd85c1407c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 -- 172.21.15.82:0/1350160875 shutdown_connections 2023-10-06T03:16:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.099+0000 7fd862634700 1 -- 172.21.15.82:0/1350160875 wait complete. 2023-10-06T03:16:07.112 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T03:16:07.132 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T03:16:07.133 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T03:16:07.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.133 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:16:07.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-10-06T03:16:07.214 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-10-06T03:16:07.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:16:07.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.216 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:16:07.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-10-06T03:16:07.336 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-10-06T03:16:07.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:16:07.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.337 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:16:07.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2023-10-06T03:16:07.426 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2023-10-06T03:16:07.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:16:07.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.428 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:16:07.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.485 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2023-10-06T03:16:07.554 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2023-10-06T03:16:07.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:16:07.555 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-06T03:16:07.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:16:07.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.669+0000 7f8ceffff700 1 Processor -- start 2023-10-06T03:16:07.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.669+0000 7f8ceffff700 1 -- start start 2023-10-06T03:16:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8ceffff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8cf015d480 0x7f8cf0069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8ceffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8cf0069da0 0x7f8cf00b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8ceffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d850 0x7f8cf00b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8ceffff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00687c0 con 0x7f8cf0069da0 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8ceffff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf0068aa0 con 0x7f8cf015d480 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8ceffff700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0068d80 con 0x7f8cf015d850 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8cf0069da0 0x7f8cf00b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8cf0069da0 0x7f8cf00b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53762/0 (socket says 172.21.15.82:53762) 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 -- 172.21.15.82:0/3334089370 learned_addr learned my addr 172.21.15.82:0/3334089370 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8ceeffd700 1 --2- 172.21.15.82:0/3334089370 >> v2:172.21.15.134:3300/0 conn(0x7f8cf015d480 0x7f8cf0069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cef7fe700 1 --2- 172.21.15.82:0/3334089370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d850 0x7f8cf00b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 -- 172.21.15.82:0/3334089370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d850 msgr2=0x7f8cf00b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 --2- 172.21.15.82:0/3334089370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d850 0x7f8cf00b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 -- 172.21.15.82:0/3334089370 >> v2:172.21.15.134:3300/0 conn(0x7f8cf015d480 msgr2=0x7f8cf0069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 --2- 172.21.15.82:0/3334089370 >> v2:172.21.15.134:3300/0 conn(0x7f8cf015d480 0x7f8cf0069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 -- 172.21.15.82:0/3334089370 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf0069060 con 0x7f8cf0069da0 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.670+0000 7f8cee7fc700 1 --2- 172.21.15.82:0/3334089370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf0069da0 0x7f8cf00b0310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0071370 tx=0x7f8cd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c800822b92c540b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8cedffb700 1 -- 172.21.15.82:0/3334089370 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800b860 con 0x7f8cf0069da0 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8cedffb700 1 -- 172.21.15.82:0/3334089370 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd800b9c0 con 0x7f8cf0069da0 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8cedffb700 1 -- 172.21.15.82:0/3334089370 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800bd60 con 0x7f8cf0069da0 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 -- 172.21.15.82:0/3334089370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf0069da0 msgr2=0x7f8cf00b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 --2- 172.21.15.82:0/3334089370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf0069da0 0x7f8cf00b0310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0071370 tx=0x7f8cd8009250 comp rx=0 tx=0).stop 2023-10-06T03:16:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 -- 172.21.15.82:0/3334089370 shutdown_connections 2023-10-06T03:16:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 --2- 172.21.15.82:0/3334089370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d850 0x7f8cf00b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 --2- 172.21.15.82:0/3334089370 >> v2:172.21.15.134:3300/0 conn(0x7f8cf015d480 0x7f8cf0069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 --2- 172.21.15.82:0/3334089370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf0069da0 0x7f8cf00b0310 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 -- 172.21.15.82:0/3334089370 >> 172.21.15.82:0/3334089370 conn(0x7f8cf00ccf80 msgr2=0x7f8cf00cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 -- 172.21.15.82:0/3334089370 shutdown_connections 2023-10-06T03:16:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.671+0000 7f8ceffff700 1 -- 172.21.15.82:0/3334089370 wait complete. 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.672+0000 7f8ceffff700 1 Processor -- start 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.672+0000 7f8ceffff700 1 -- start start 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8ceffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf0069da0 0x7f8cf00ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8ceffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d480 0x7f8cf00c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8ceffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf015d850 0x7f8cf0169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8ceffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c95b0 con 0x7f8cf015d850 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8ceffff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00ca0a0 con 0x7f8cf0069da0 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8ceffff700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c6440 con 0x7f8cf015d480 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8cef7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf015d850 0x7f8cf0169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8cef7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf015d850 0x7f8cf0169a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53774/0 (socket says 172.21.15.82:53774) 2023-10-06T03:16:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8cef7fe700 1 -- 172.21.15.82:0/814045314 learned_addr learned my addr 172.21.15.82:0/814045314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.673+0000 7f8ceeffd700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf0069da0 0x7f8cf00ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8cee7fc700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d480 0x7f8cf00c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8cef7fe700 1 -- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d480 msgr2=0x7f8cf00c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8cef7fe700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d480 0x7f8cf00c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8cef7fe700 1 -- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf0069da0 msgr2=0x7f8cf00ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8cef7fe700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf0069da0 0x7f8cf00ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8cef7fe700 1 -- 172.21.15.82:0/814045314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd80094f0 con 0x7f8cf015d850 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8ceeffd700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf0069da0 0x7f8cf00ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8cef7fe700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf015d850 0x7f8cf0169a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800d890 tx=0x7f8ce8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8ce6ffd700 1 -- 172.21.15.82:0/814045314 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80125f0 con 0x7f8cf015d850 2023-10-06T03:16:07.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8ce6ffd700 1 -- 172.21.15.82:0/814045314 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8012770 con 0x7f8cf015d850 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf00cff90 con 0x7f8cf015d850 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8ce6ffd700 1 -- 172.21.15.82:0/814045314 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8012b30 con 0x7f8cf015d850 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.674+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf00c9ae0 con 0x7f8cf015d850 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.675+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf00c65b0 con 0x7f8cf015d850 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.675+0000 7f8ce6ffd700 1 -- 172.21.15.82:0/814045314 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ce801e460 con 0x7f8cf015d850 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.675+0000 7f8ce6ffd700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8cd0066f30 0x7f8cd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.676+0000 7f8ce6ffd700 1 -- 172.21.15.82:0/814045314 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ce8084d00 con 0x7f8cf015d850 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.676+0000 7f8ceeffd700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8cd0066f30 0x7f8cd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:07.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.676+0000 7f8ceeffd700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8cd0066f30 0x7f8cd00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0007540 tx=0x7f8ce000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:07.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.680+0000 7f8ce6ffd700 1 -- 172.21.15.82:0/814045314 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ce8051e10 con 0x7f8cf015d850 2023-10-06T03:16:07.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.905+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8cf004c3c0 con 0x7f8cf015d850 2023-10-06T03:16:07.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.905+0000 7f8ce6ffd700 1 -- 172.21.15.82:0/814045314 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8ce8055430 con 0x7f8cf015d850 2023-10-06T03:16:07.907 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8cd0066f30 msgr2=0x7f8cd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8cd0066f30 0x7f8cd00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0007540 tx=0x7f8ce000b040 comp rx=0 tx=0).stop 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf015d850 msgr2=0x7f8cf0169a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf015d850 0x7f8cf0169a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800d890 tx=0x7f8ce8008040 comp rx=0 tx=0).stop 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 shutdown_connections 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cf015d850 0x7f8cf0169a80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf0069da0 0x7f8cf00ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8cd0066f30 0x7f8cd00693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 --2- 172.21.15.82:0/814045314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf015d480 0x7f8cf00c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 >> 172.21.15.82:0/814045314 conn(0x7f8cf00ccf80 msgr2=0x7f8cf00b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:07.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 shutdown_connections 2023-10-06T03:16:07.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:07.908+0000 7f8ceffff700 1 -- 172.21.15.82:0/814045314 wait complete. 2023-10-06T03:16:07.920 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:16:07.920 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:16:07.920 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-10-06T03:16:07.920 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:16:07.920 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:07.920 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:16:07.920 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:16:07.920 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:16:07.921 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:16:07.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.921 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-10-06T03:16:07.935 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:07.936 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42495sec preferred_lft 42495sec 2023-10-06T03:16:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-10-06T03:16:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:07.938 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:16:07.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:07.938 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:07.938 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:07.938 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:16:07.939 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2023-10-06T03:16:07.939 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2023-10-06T03:16:07.939 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:16:07.939 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:08.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:08.103 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:16:08.143 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-10-06T03:16:08.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:08.145 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-10-06T03:16:08.212 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-10-06T03:16:08.212 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:16:08.213 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:16:08.213 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:16:08.213 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:16:08.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:08.213 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:08.213 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:08.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:16:08.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:16:08.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:16:08.214 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:08.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:08.465 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:16:08.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:08.481 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-10-06T03:16:08.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:08.535 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:08.535 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:08.535 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:16:08.535 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T03:16:08.535 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:08.624 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T03:16:08.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:08.625 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:08.625 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:08.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T03:16:08.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:16:08.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T03:16:08.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T03:16:08.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T03:16:08.626 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:08.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:08.815 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:08.815 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:08.815 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-10-06T03:16:08.815 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:16:08.816 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:08.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:08.907 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:08.921 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:16:08.922 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:08.922 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:08.976 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:16:08.976 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:16:08.976 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:16:09.069 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:16:09.069 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:16:09.069 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:09.143 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:16:09.143 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:16:09.143 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:09.143 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:09.143 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:16:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:16:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:16:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:16:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:16:09.169 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:16:09.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.169 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:09.194 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-06T03:16:09.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:16:09.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.349+0000 7fdc4bb93700 1 Processor -- start 2023-10-06T03:16:09.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.349+0000 7fdc4bb93700 1 -- start start 2023-10-06T03:16:09.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4bb93700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 0x7fdc440d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:09.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4bb93700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc440b2ad0 con 0x7fdc4415d560 2023-10-06T03:16:09.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4bb93700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc440b4160 con 0x7fdc4415d930 2023-10-06T03:16:09.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4bb93700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440b2230 con 0x7fdc440b5600 2023-10-06T03:16:09.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4992f700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdc4415d560 0x7fdc440b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59362/0 (socket says 172.21.15.82:59362) 2023-10-06T03:16:09.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4992f700 1 -- 172.21.15.82:0/3462356340 learned_addr learned my addr 172.21.15.82:0/3462356340 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4a130700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 0x7fdc440d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787167417 0 0) 0x7fdc440b2ad0 con 0x7fdc4415d560 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc30003570 con 0x7fdc4415d560 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290483983 0 0) 0x7fdc440b4160 con 0x7fdc4415d930 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc440b2ad0 con 0x7fdc4415d930 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 775923815 0 0) 0x7fdc30003570 con 0x7fdc4415d560 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 msgr2=0x7fdc440d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 0x7fdc440d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 >> v1:172.21.15.134:6789/0 conn(0x7fdc4415d930 legacy=0x7fdc441591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc440b2510 con 0x7fdc4415d560 2023-10-06T03:16:09.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4a130700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 0x7fdc440d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fdc3c0017f0 con 0x7fdc4415d560 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 >> v1:172.21.15.82:6789/0 conn(0x7fdc4415d560 legacy=0x7fdc440b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30003c20 0x7fdc30004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 0x7fdc30004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc30004d50 0x7fdc300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.350+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440b2230 con 0x7fdc30004d50 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3000bb40 con 0x7fdc30003c20 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3000bd00 con 0x7fdc440b5600 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4a130700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc30004d50 0x7fdc300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4992f700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30003c20 0x7fdc30004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:09.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4912e700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 0x7fdc30004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4a130700 1 -- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 msgr2=0x7fdc30004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4a130700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc440b5600 0x7fdc30004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4a130700 1 -- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30003c20 msgr2=0x7fdc30004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4a130700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30003c20 0x7fdc30004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4a130700 1 -- 172.21.15.82:0/3462356340 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40009420 con 0x7fdc30004d50 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4a130700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc30004d50 0x7fdc300051c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009df0 tx=0x7fdc400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330ba22635574a4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40009740 con 0x7fdc30004d50 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000e920 con 0x7fdc30004d50 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.351+0000 7fdc4892d700 1 -- 172.21.15.82:0/3462356340 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000ece0 con 0x7fdc30004d50 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.352+0000 7fdc4bb93700 1 -- 172.21.15.82:0/3462356340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc30004d50 msgr2=0x7fdc300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.352+0000 7fdc4bb93700 1 --2- 172.21.15.82:0/3462356340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc30004d50 0x7fdc300051c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009df0 tx=0x7fdc400091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.352+0000 7fdc4a130700 1 -- 172.21.15.82:0/3462356340 reap_dead start 2023-10-06T03:16:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.352+0000 7fdc4bb93700 1 -- 172.21.15.82:0/3462356340 shutdown_connections 2023-10-06T03:16:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.352+0000 7fdc4bb93700 1 -- 172.21.15.82:0/3462356340 >> 172.21.15.82:0/3462356340 conn(0x7fdc440d1180 msgr2=0x7fdc44069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.352+0000 7fdc4bb93700 1 -- 172.21.15.82:0/3462356340 shutdown_connections 2023-10-06T03:16:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.352+0000 7fdc4bb93700 1 -- 172.21.15.82:0/3462356340 wait complete. 2023-10-06T03:16:09.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.353+0000 7fdc4bb93700 1 Processor -- start 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.353+0000 7fdc4bb93700 1 -- start start 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4bb93700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30004d50 0x7fdc44158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4bb93700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc4416cd80 0x7fdc4415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4bb93700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc44157d60 0x7fdc441581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4bb93700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44158720 con 0x7fdc4416cd80 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4bb93700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441595f0 con 0x7fdc30004d50 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4bb93700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441598d0 con 0x7fdc44157d60 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc4416cd80 0x7fdc4415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc4416cd80 0x7fdc4415b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53786/0 (socket says 172.21.15.82:53786) 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 -- 172.21.15.82:0/1133994779 learned_addr learned my addr 172.21.15.82:0/1133994779 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4992f700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30004d50 0x7fdc44158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4a130700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc44157d60 0x7fdc441581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 -- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc44157d60 msgr2=0x7fdc441581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc44157d60 0x7fdc441581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 -- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30004d50 msgr2=0x7fdc44158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30004d50 0x7fdc44158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 -- 172.21.15.82:0/1133994779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44159bb0 con 0x7fdc4416cd80 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4912e700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc4416cd80 0x7fdc4415b790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdc34002b30 tx=0x7fdc34007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc39ffb700 1 -- 172.21.15.82:0/1133994779 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3400f8d0 con 0x7fdc4416cd80 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc39ffb700 1 -- 172.21.15.82:0/1133994779 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3400fa30 con 0x7fdc4416cd80 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc44159e90 con 0x7fdc4416cd80 2023-10-06T03:16:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.354+0000 7fdc39ffb700 1 -- 172.21.15.82:0/1133994779 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3400fdf0 con 0x7fdc4416cd80 2023-10-06T03:16:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.355+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4415bcd0 con 0x7fdc4416cd80 2023-10-06T03:16:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.356+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc440cd7a0 con 0x7fdc4416cd80 2023-10-06T03:16:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.356+0000 7fdc39ffb700 1 -- 172.21.15.82:0/1133994779 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc340133f0 con 0x7fdc4416cd80 2023-10-06T03:16:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.356+0000 7fdc39ffb700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc28066f60 0x7fdc28069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.356+0000 7fdc39ffb700 1 -- 172.21.15.82:0/1133994779 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc340846e0 con 0x7fdc4416cd80 2023-10-06T03:16:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.356+0000 7fdc4992f700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc28066f60 0x7fdc28069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.357+0000 7fdc4992f700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc28066f60 0x7fdc28069410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0011d0 tx=0x7fdc3c006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.361+0000 7fdc39ffb700 1 -- 172.21.15.82:0/1133994779 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc340517f0 con 0x7fdc4416cd80 2023-10-06T03:16:09.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.590+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdc440afb60 con 0x7fdc4416cd80 2023-10-06T03:16:09.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.590+0000 7fdc39ffb700 1 -- 172.21.15.82:0/1133994779 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdc34054e10 con 0x7fdc4416cd80 2023-10-06T03:16:09.591 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:16:09.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc28066f60 msgr2=0x7fdc28069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:09.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc28066f60 0x7fdc28069410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0011d0 tx=0x7fdc3c006040 comp rx=0 tx=0).stop 2023-10-06T03:16:09.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc4416cd80 msgr2=0x7fdc4415b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:09.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc4416cd80 0x7fdc4415b790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdc34002b30 tx=0x7fdc34007d30 comp rx=0 tx=0).stop 2023-10-06T03:16:09.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 shutdown_connections 2023-10-06T03:16:09.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc28066f60 0x7fdc28069410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc44157d60 0x7fdc441581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc30004d50 0x7fdc44158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 --2- 172.21.15.82:0/1133994779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc4416cd80 0x7fdc4415b790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:09.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 >> 172.21.15.82:0/1133994779 conn(0x7fdc440d1180 msgr2=0x7fdc44155dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:09.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 shutdown_connections 2023-10-06T03:16:09.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:09.592+0000 7fdc4bb93700 1 -- 172.21.15.82:0/1133994779 wait complete. 2023-10-06T03:16:09.604 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:16:09.605 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:16:09.605 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-10-06T03:16:09.605 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T03:16:09.605 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T03:16:09.605 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:16:09.605 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:16:09.605 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:16:09.605 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:16:09.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.606 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-10-06T03:16:09.620 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:09.620 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:09.621 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42493sec preferred_lft 42493sec 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether be:dd:8c:84:42:c0 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:09.622 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::8c5f:c4ff:fe3a:9eac/64 scope link tentative 2023-10-06T03:16:09.623 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:09.623 INFO:teuthology.orchestra.run.smithi082.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:16:09.623 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether be:dd:8c:84:42:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:16:09.623 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::bcdd:8cff:fe84:42c0/64 scope link tentative 2023-10-06T03:16:09.623 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:09.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.623 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:16:09.683 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-10-06T03:16:09.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.684 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-10-06T03:16:09.741 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-10-06T03:16:09.741 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:16:09.741 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:16:09.741 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:16:09.741 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:16:09.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.742 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:09.742 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:09.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:16:09.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:16:09.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:16:09.742 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:09.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.841 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:16:09.855 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:16:09.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.856 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-10-06T03:16:09.909 INFO:teuthology.orchestra.run.smithi082.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T03:16:09.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.910 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:09.910 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:09.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:16:09.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T03:16:09.911 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:09.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:09.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:16:10.032 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:10.032 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 9a:af:fc:d3:f4:1b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::98af:fcff:fed3:f41b/64 scope link tentative 2023-10-06T03:16:10.033 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:10.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:10.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:16:10.122 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:10.122 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:10.122 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 9a:af:fc:d3:f4:1b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::98af:fcff:fed3:f41b/64 scope link tentative 2023-10-06T03:16:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:10.136 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T03:16:10.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:10.136 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:10.136 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:10.136 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T03:16:10.136 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:16:10.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T03:16:10.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T03:16:10.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T03:16:10.137 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:10.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:10.501 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:10.501 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:10.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.1 up 2023-10-06T03:16:10.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:16:10.501 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:10.581 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:10.826 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T03:16:10.841 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:16:10.841 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:10.841 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:16:10.896 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:16:10.896 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:16:10.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T03:16:10.976 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T03:16:10.976 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T03:16:10.976 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:10.984 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T03:16:10.984 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T03:16:10.984 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:10.985 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:10.985 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:11.007 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T03:16:11.007 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T03:16:11.007 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:11.007 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:11.008 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:11.008 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:16:11.008 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:16:11.008 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:16:11.009 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:16:11.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:11.009 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:16:11.074 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-06T03:16:11.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:16:11.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.228+0000 7fb40ffea700 1 Processor -- start 2023-10-06T03:16:11.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.228+0000 7fb40ffea700 1 -- start start 2023-10-06T03:16:11.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.229+0000 7fb40ffea700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb40815d560 0x7fb4080d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:11.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.229+0000 7fb40ffea700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4081591b0 0x7fb408159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:11.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.229+0000 7fb40ffea700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4080b2ad0 con 0x7fb40815d930 2023-10-06T03:16:11.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.229+0000 7fb40ffea700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4080b4160 con 0x7fb40815d560 2023-10-06T03:16:11.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.229+0000 7fb40ffea700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb408159b70 con 0x7fb4081591b0 2023-10-06T03:16:11.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40dd86700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb40815d560 0x7fb4080d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:11.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40e587700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4081591b0 0x7fb408159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:11.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40d585700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb40815d930 0x7fb4080b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:60428/0 (socket says 172.21.15.82:60428) 2023-10-06T03:16:11.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40d585700 1 -- 172.21.15.82:0/3749879874 learned_addr learned my addr 172.21.15.82:0/3749879874 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:11.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40e587700 1 -- 172.21.15.82:0/3749879874 >> v2:172.21.15.134:3300/0 conn(0x7fb40815d560 msgr2=0x7fb4080d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:11.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40e587700 1 --2- 172.21.15.82:0/3749879874 >> v2:172.21.15.134:3300/0 conn(0x7fb40815d560 0x7fb4080d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40e587700 1 -- 172.21.15.82:0/3749879874 >> v1:172.21.15.134:6789/0 conn(0x7fb40815d930 legacy=0x7fb4080b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:11.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40e587700 1 -- 172.21.15.82:0/3749879874 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080b2230 con 0x7fb4081591b0 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40dd86700 1 --2- 172.21.15.82:0/3749879874 >> v2:172.21.15.134:3300/0 conn(0x7fb40815d560 0x7fb4080d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40e587700 1 --2- 172.21.15.82:0/3749879874 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4081591b0 0x7fb408159630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4000098e0 tx=0x7fb4000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce63a72227581a05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40cd84700 1 -- 172.21.15.82:0/3749879874 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40000b640 con 0x7fb4081591b0 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40cd84700 1 -- 172.21.15.82:0/3749879874 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40000b7a0 con 0x7fb4081591b0 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.230+0000 7fb40cd84700 1 -- 172.21.15.82:0/3749879874 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40000bb40 con 0x7fb4081591b0 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.231+0000 7fb40ffea700 1 -- 172.21.15.82:0/3749879874 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4081591b0 msgr2=0x7fb408159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.231+0000 7fb40ffea700 1 --2- 172.21.15.82:0/3749879874 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4081591b0 0x7fb408159630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4000098e0 tx=0x7fb4000091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.231+0000 7fb40ffea700 1 -- 172.21.15.82:0/3749879874 shutdown_connections 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.231+0000 7fb40ffea700 1 --2- 172.21.15.82:0/3749879874 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4081591b0 0x7fb408159630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.231+0000 7fb40ffea700 1 --2- 172.21.15.82:0/3749879874 >> v2:172.21.15.134:3300/0 conn(0x7fb40815d560 0x7fb4080d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.231+0000 7fb40ffea700 1 -- 172.21.15.82:0/3749879874 >> 172.21.15.82:0/3749879874 conn(0x7fb4080d1180 msgr2=0x7fb408069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:11.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.231+0000 7fb40ffea700 1 -- 172.21.15.82:0/3749879874 shutdown_connections 2023-10-06T03:16:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.231+0000 7fb40ffea700 1 -- 172.21.15.82:0/3749879874 wait complete. 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.232+0000 7fb40ffea700 1 Processor -- start 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.232+0000 7fb40ffea700 1 -- start start 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40ffea700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4081591b0 0x7fb40815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40ffea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb40815d560 0x7fb4080c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40ffea700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb40815d930 0x7fb4080ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40ffea700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40815be70 con 0x7fb4081591b0 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40ffea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40815b260 con 0x7fb40815d560 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40ffea700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40815b540 con 0x7fb40815d930 2023-10-06T03:16:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40dd86700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4081591b0 0x7fb40815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40dd86700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4081591b0 0x7fb40815c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53794/0 (socket says 172.21.15.82:53794) 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40dd86700 1 -- 172.21.15.82:0/2929209170 learned_addr learned my addr 172.21.15.82:0/2929209170 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40e587700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb40815d930 0x7fb4080ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40d585700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb40815d560 0x7fb4080c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40dd86700 1 -- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb40815d930 msgr2=0x7fb4080ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40dd86700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb40815d930 0x7fb4080ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40dd86700 1 -- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb40815d560 msgr2=0x7fb4080c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40dd86700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb40815d560 0x7fb4080c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40dd86700 1 -- 172.21.15.82:0/2929209170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009a20 con 0x7fb4081591b0 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.233+0000 7fb40d585700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb40815d560 0x7fb4080c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.234+0000 7fb40dd86700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4081591b0 0x7fb40815c300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800c170 tx=0x7fb3f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:11.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.234+0000 7fb405ffb700 1 -- 172.21.15.82:0/2929209170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800ce10 con 0x7fb4081591b0 2023-10-06T03:16:11.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.234+0000 7fb405ffb700 1 -- 172.21.15.82:0/2929209170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f800f040 con 0x7fb4081591b0 2023-10-06T03:16:11.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.234+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb400009420 con 0x7fb4081591b0 2023-10-06T03:16:11.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.234+0000 7fb405ffb700 1 -- 172.21.15.82:0/2929209170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8014690 con 0x7fb4081591b0 2023-10-06T03:16:11.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.234+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40815bb00 con 0x7fb4081591b0 2023-10-06T03:16:11.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.235+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40815c150 con 0x7fb4081591b0 2023-10-06T03:16:11.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.235+0000 7fb405ffb700 1 -- 172.21.15.82:0/2929209170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3f8014a00 con 0x7fb4081591b0 2023-10-06T03:16:11.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.236+0000 7fb405ffb700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb3f4066f30 0x7fb3f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:11.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.236+0000 7fb405ffb700 1 -- 172.21.15.82:0/2929209170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb3f80855d0 con 0x7fb4081591b0 2023-10-06T03:16:11.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.236+0000 7fb40d585700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb3f4066f30 0x7fb3f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:11.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.236+0000 7fb40d585700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb3f4066f30 0x7fb3f40693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb40816ce00 tx=0x7fb3fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:11.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.240+0000 7fb405ffb700 1 -- 172.21.15.82:0/2929209170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3f80526e0 con 0x7fb4081591b0 2023-10-06T03:16:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.466+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb408064050 con 0x7fb4081591b0 2023-10-06T03:16:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.467+0000 7fb405ffb700 1 -- 172.21.15.82:0/2929209170 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb3f8014cb0 con 0x7fb4081591b0 2023-10-06T03:16:11.467 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb3f4066f30 msgr2=0x7fb3f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb3f4066f30 0x7fb3f40693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb40816ce00 tx=0x7fb3fc009040 comp rx=0 tx=0).stop 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4081591b0 msgr2=0x7fb40815c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4081591b0 0x7fb40815c300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800c170 tx=0x7fb3f800b040 comp rx=0 tx=0).stop 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 shutdown_connections 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb3f4066f30 0x7fb3f40693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb40815d930 0x7fb4080ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4081591b0 0x7fb40815c300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 --2- 172.21.15.82:0/2929209170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb40815d560 0x7fb4080c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:11.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 >> 172.21.15.82:0/2929209170 conn(0x7fb4080d1180 msgr2=0x7fb4080b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:11.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 shutdown_connections 2023-10-06T03:16:11.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:11.469+0000 7fb40ffea700 1 -- 172.21.15.82:0/2929209170 wait complete. 2023-10-06T03:16:11.483 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:16:11.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:16:11.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-10-06T03:16:11.484 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:16:11.484 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:11.484 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:16:11.484 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:16:11.484 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:16:11.484 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:16:11.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:11.484 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-10-06T03:16:11.502 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:11.502 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-10-06T03:16:11.503 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-10-06T03:16:11.503 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:11.504 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:16:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:16:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42489sec preferred_lft 42489sec 2023-10-06T03:16:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-10-06T03:16:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:11.505 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:16:11.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:11.505 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:11.505 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:11.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:16:11.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2023-10-06T03:16:11.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2023-10-06T03:16:11.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:16:11.506 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:11.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:11.669 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:16:11.709 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-10-06T03:16:11.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:11.710 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-10-06T03:16:11.783 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-10-06T03:16:11.783 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:16:11.783 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:16:11.783 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:16:11.783 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:16:11.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:11.784 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:11.784 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:11.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:16:11.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:16:11.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:16:11.784 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:12.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:12.030 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:16:12.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:12.045 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2023-10-06T03:16:12.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:12.099 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:12.099 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:12.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:16:12.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T03:16:12.099 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:12.188 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T03:16:12.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:12.188 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:12.189 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:12.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T03:16:12.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:16:12.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T03:16:12.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T03:16:12.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T03:16:12.189 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:12.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:12.390 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:12.390 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:12.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-10-06T03:16:12.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:16:12.391 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:12.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:12.484 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:12.498 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:16:12.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:12.499 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:12.553 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:16:12.553 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:16:12.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:12.653 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:12.654 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:12.654 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:12.726 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:12.726 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:12.726 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:12.727 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:12.727 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:12.747 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:12.747 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:12.747 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:12.747 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:12.747 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:12.748 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:16:12.748 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:16:12.748 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:16:12.749 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:16:12.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:12.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:12.775 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-06T03:16:12.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:16:12.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.890+0000 7fc0a9f2b700 1 Processor -- start 2023-10-06T03:16:12.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.890+0000 7fc0a9f2b700 1 -- start start 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a9f2b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a415d480 0x7fc0a4069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a9f2b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0a4069da0 0x7fc0a40b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a9f2b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc0a415d850 0x7fc0a40b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a9f2b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40687c0 con 0x7fc0a4069da0 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a9f2b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a4068aa0 con 0x7fc0a415d850 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a9f2b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4068d80 con 0x7fc0a415d480 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0a4069da0 0x7fc0a40b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0a4069da0 0x7fc0a40b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53808/0 (socket says 172.21.15.82:53808) 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 -- 172.21.15.82:0/137409535 learned_addr learned my addr 172.21.15.82:0/137409535 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a972a700 1 --2- 172.21.15.82:0/137409535 >> v2:172.21.15.134:3300/0 conn(0x7fc0a415d850 0x7fc0a40b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a8f29700 1 --2- 172.21.15.82:0/137409535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a415d480 0x7fc0a4069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:12.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 -- 172.21.15.82:0/137409535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a415d480 msgr2=0x7fc0a4069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 --2- 172.21.15.82:0/137409535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a415d480 0x7fc0a4069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 -- 172.21.15.82:0/137409535 >> v2:172.21.15.134:3300/0 conn(0x7fc0a415d850 msgr2=0x7fc0a40b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 --2- 172.21.15.82:0/137409535 >> v2:172.21.15.134:3300/0 conn(0x7fc0a415d850 0x7fc0a40b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 -- 172.21.15.82:0/137409535 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4069060 con 0x7fc0a4069da0 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.891+0000 7fc0a3fff700 1 --2- 172.21.15.82:0/137409535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a4069da0 0x7fc0a40b0310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40cdfe0 tx=0x7fc098009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a6f049b93ae0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a37fe700 1 -- 172.21.15.82:0/137409535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09800b860 con 0x7fc0a4069da0 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a37fe700 1 -- 172.21.15.82:0/137409535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09800b9c0 con 0x7fc0a4069da0 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a37fe700 1 -- 172.21.15.82:0/137409535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09800bd60 con 0x7fc0a4069da0 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/137409535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a4069da0 msgr2=0x7fc0a40b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/137409535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a4069da0 0x7fc0a40b0310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40cdfe0 tx=0x7fc098009250 comp rx=0 tx=0).stop 2023-10-06T03:16:12.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/137409535 shutdown_connections 2023-10-06T03:16:12.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/137409535 >> v2:172.21.15.134:3300/0 conn(0x7fc0a415d850 0x7fc0a40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:12.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/137409535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a415d480 0x7fc0a4069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:12.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/137409535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a4069da0 0x7fc0a40b0310 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:12.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/137409535 >> 172.21.15.82:0/137409535 conn(0x7fc0a40ccf80 msgr2=0x7fc0a40cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:12.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/137409535 shutdown_connections 2023-10-06T03:16:12.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.892+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/137409535 wait complete. 2023-10-06T03:16:12.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.893+0000 7fc0a9f2b700 1 Processor -- start 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.893+0000 7fc0a9f2b700 1 -- start start 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a9f2b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a4069da0 0x7fc0a415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a9f2b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a415d480 0x7fc0a406c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a9f2b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415d850 0x7fc0a40c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a9f2b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a406f3d0 con 0x7fc0a415d850 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a9f2b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a406e7c0 con 0x7fc0a415d480 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a9f2b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a406eaa0 con 0x7fc0a4069da0 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a972a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415d850 0x7fc0a40c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a972a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415d850 0x7fc0a40c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53822/0 (socket says 172.21.15.82:53822) 2023-10-06T03:16:12.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a972a700 1 -- 172.21.15.82:0/3028577878 learned_addr learned my addr 172.21.15.82:0/3028577878 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a3fff700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a415d480 0x7fc0a406c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.894+0000 7fc0a8f29700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a4069da0 0x7fc0a415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a972a700 1 -- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a4069da0 msgr2=0x7fc0a415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a972a700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a4069da0 0x7fc0a415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a972a700 1 -- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a415d480 msgr2=0x7fc0a406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a972a700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a415d480 0x7fc0a406c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a972a700 1 -- 172.21.15.82:0/3028577878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980094f0 con 0x7fc0a415d850 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a8f29700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a4069da0 0x7fc0a415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a3fff700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a415d480 0x7fc0a406c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a972a700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415d850 0x7fc0a40c7b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc09400d860 tx=0x7fc094008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a0ff9700 1 -- 172.21.15.82:0/3028577878 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940125f0 con 0x7fc0a415d850 2023-10-06T03:16:12.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a0ff9700 1 -- 172.21.15.82:0/3028577878 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094012750 con 0x7fc0a415d850 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a406ed80 con 0x7fc0a415d850 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a0ff9700 1 -- 172.21.15.82:0/3028577878 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094012b10 con 0x7fc0a415d850 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.895+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a415bf10 con 0x7fc0a415d850 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.896+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a404c3c0 con 0x7fc0a415d850 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.896+0000 7fc0a0ff9700 1 -- 172.21.15.82:0/3028577878 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc09401e460 con 0x7fc0a415d850 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.897+0000 7fc0a0ff9700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc090066f30 0x7fc0900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.897+0000 7fc0a0ff9700 1 -- 172.21.15.82:0/3028577878 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc094084cf0 con 0x7fc0a415d850 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.897+0000 7fc0a8f29700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc090066f30 0x7fc0900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:12.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.897+0000 7fc0a8f29700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc090066f30 0x7fc0900693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0075e0 tx=0x7fc09c0097e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:12.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:12.901+0000 7fc0a0ff9700 1 -- 172.21.15.82:0/3028577878 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc094089070 con 0x7fc0a415d850 2023-10-06T03:16:13.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.123+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc0a4070fe0 con 0x7fc0a415d850 2023-10-06T03:16:13.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.123+0000 7fc0a0ff9700 1 -- 172.21.15.82:0/3028577878 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc094055890 con 0x7fc0a415d850 2023-10-06T03:16:13.124 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:16:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc090066f30 msgr2=0x7fc0900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc090066f30 0x7fc0900693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0075e0 tx=0x7fc09c0097e0 comp rx=0 tx=0).stop 2023-10-06T03:16:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415d850 msgr2=0x7fc0a40c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415d850 0x7fc0a40c7b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc09400d860 tx=0x7fc094008040 comp rx=0 tx=0).stop 2023-10-06T03:16:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 shutdown_connections 2023-10-06T03:16:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415d850 0x7fc0a40c7b60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc090066f30 0x7fc0900693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0a4069da0 0x7fc0a415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 --2- 172.21.15.82:0/3028577878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a415d480 0x7fc0a406c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 >> 172.21.15.82:0/3028577878 conn(0x7fc0a40ccf80 msgr2=0x7fc0a4141e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 shutdown_connections 2023-10-06T03:16:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:13.125+0000 7fc0a9f2b700 1 -- 172.21.15.82:0/3028577878 wait complete. 2023-10-06T03:16:13.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:16:13.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:16:13.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-10-06T03:16:13.139 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T03:16:13.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T03:16:13.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:16:13.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:16:13.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:16:13.139 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:16:13.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.140 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-10-06T03:16:13.155 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:13.156 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:13.156 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:13.156 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.156 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:13.156 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.156 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:13.156 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:13.156 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42488sec preferred_lft 42488sec 2023-10-06T03:16:13.157 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-10-06T03:16:13.158 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.158 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:13.158 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:13.158 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:16:13.158 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.158 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::942d:80ff:fe6e:b134/64 scope link tentative 2023-10-06T03:16:13.158 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.159 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:16:13.159 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:16:13.159 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::7074:feff:fe81:9e88/64 scope link tentative 2023-10-06T03:16:13.159 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.159 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:16:13.219 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-10-06T03:16:13.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.221 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-10-06T03:16:13.277 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-10-06T03:16:13.277 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:16:13.277 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:16:13.277 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:16:13.277 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:16:13.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.278 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:13.278 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:13.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:16:13.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:16:13.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:16:13.278 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:13.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.378 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:16:13.392 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:16:13.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.393 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2023-10-06T03:16:13.448 INFO:teuthology.orchestra.run.smithi134.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T03:16:13.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.449 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:13.449 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:13.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:16:13.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T03:16:13.449 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:13.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:16:13.571 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether ca:d5:53:1d:68:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8d5:53ff:fe1d:68ef/64 scope link tentative 2023-10-06T03:16:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.584 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:16:13.658 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:13.658 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:13.658 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether ca:d5:53:1d:68:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c8d5:53ff:fe1d:68ef/64 scope link tentative 2023-10-06T03:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:13.666 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T03:16:13.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.667 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:13.667 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:13.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T03:16:13.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:16:13.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T03:16:13.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T03:16:13.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T03:16:13.667 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:13.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:13.897 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:13.897 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:13.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.1 up 2023-10-06T03:16:13.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:16:13.898 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:13.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:13.977 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T03:16:13.992 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:16:13.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:13.992 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:16:14.047 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:16:14.047 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:16:14.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T03:16:14.126 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T03:16:14.126 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T03:16:14.126 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:14.134 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T03:16:14.134 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T03:16:14.134 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:14.134 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:14.134 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:14.155 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T03:16:14.156 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T03:16:14.156 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:14.156 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:14.156 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:14.156 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:16:14.156 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:16:14.156 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:16:14.158 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:16:14.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:14.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:16:14.223 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T03:16:14.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:14.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.360+0000 7f81370cf700 1 Processor -- start 2023-10-06T03:16:14.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.360+0000 7f81370cf700 1 -- start start 2023-10-06T03:16:14.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f81370cf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f813015d930 0x7f81300d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f81370cf700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f81301591b0 0x7f8130159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f81370cf700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300b2ad0 con 0x7f813015d560 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f81370cf700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81300b4160 con 0x7f813015d930 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f81370cf700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81300b2230 con 0x7f81301591b0 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f813015d930 0x7f81300d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f8134e6b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f813015d560 0x7f81300b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59370/0 (socket says 172.21.15.82:59370) 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f8134e6b700 1 -- 172.21.15.82:0/2831333242 learned_addr learned my addr 172.21.15.82:0/2831333242 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f813566c700 1 --2- 172.21.15.82:0/2831333242 >> v2:172.21.15.134:3300/0 conn(0x7f81301591b0 0x7f8130159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812ffff700 1 -- 172.21.15.82:0/2831333242 >> v2:172.21.15.134:3300/0 conn(0x7f81301591b0 msgr2=0x7f8130159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812ffff700 1 --2- 172.21.15.82:0/2831333242 >> v2:172.21.15.134:3300/0 conn(0x7f81301591b0 0x7f8130159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812ffff700 1 -- 172.21.15.82:0/2831333242 >> v1:172.21.15.82:6789/0 conn(0x7f813015d560 legacy=0x7f81300b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812f7fe700 1 -- 172.21.15.82:0/2831333242 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819369494 0 0) 0x7f81300b2ad0 con 0x7f813015d560 2023-10-06T03:16:14.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812ffff700 1 -- 172.21.15.82:0/2831333242 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81300b2510 con 0x7f813015d930 2023-10-06T03:16:14.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812ffff700 1 --2- 172.21.15.82:0/2831333242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f813015d930 0x7f81300d0030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f81300b3af0 tx=0x7f8120009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f59c94681f468b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:14.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812f7fe700 1 -- 172.21.15.82:0/2831333242 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000e070 con 0x7f813015d930 2023-10-06T03:16:14.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812f7fe700 1 -- 172.21.15.82:0/2831333242 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812000bc30 con 0x7f813015d930 2023-10-06T03:16:14.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.361+0000 7f812f7fe700 1 -- 172.21.15.82:0/2831333242 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120012430 con 0x7f813015d930 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.362+0000 7f81370cf700 1 -- 172.21.15.82:0/2831333242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f813015d930 msgr2=0x7f81300d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.362+0000 7f81370cf700 1 --2- 172.21.15.82:0/2831333242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f813015d930 0x7f81300d0030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f81300b3af0 tx=0x7f8120009780 comp rx=0 tx=0).stop 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.362+0000 7f81370cf700 1 -- 172.21.15.82:0/2831333242 shutdown_connections 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.362+0000 7f81370cf700 1 --2- 172.21.15.82:0/2831333242 >> v2:172.21.15.134:3300/0 conn(0x7f81301591b0 0x7f8130159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.362+0000 7f81370cf700 1 --2- 172.21.15.82:0/2831333242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f813015d930 0x7f81300d0030 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.362+0000 7f81370cf700 1 -- 172.21.15.82:0/2831333242 >> 172.21.15.82:0/2831333242 conn(0x7f81300d1180 msgr2=0x7f8130069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.362+0000 7f81370cf700 1 -- 172.21.15.82:0/2831333242 shutdown_connections 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.362+0000 7f81370cf700 1 -- 172.21.15.82:0/2831333242 wait complete. 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.363+0000 7f81370cf700 1 Processor -- start 2023-10-06T03:16:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.363+0000 7f81370cf700 1 -- start start 2023-10-06T03:16:14.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f81370cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81301591b0 0x7f813014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f81370cf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813015d560 0x7f813015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f81370cf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f813015d930 0x7f81300aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f81370cf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813014a720 con 0x7f81301591b0 2023-10-06T03:16:14.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f81370cf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813015cfc0 con 0x7f813015d560 2023-10-06T03:16:14.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f81370cf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81300a84f0 con 0x7f813015d930 2023-10-06T03:16:14.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81301591b0 0x7f813014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81301591b0 0x7f813014a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53830/0 (socket says 172.21.15.82:53830) 2023-10-06T03:16:14.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 -- 172.21.15.82:0/2735208546 learned_addr learned my addr 172.21.15.82:0/2735208546 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:14.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f812ffff700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813015d560 0x7f813015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f813566c700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f813015d930 0x7f81300aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 -- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f813015d930 msgr2=0x7f81300aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f813015d930 0x7f81300aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 -- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813015d560 msgr2=0x7f813015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813015d560 0x7f813015bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 -- 172.21.15.82:0/2735208546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009a20 con 0x7f81301591b0 2023-10-06T03:16:14.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f813566c700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f813015d930 0x7f81300aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:14.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f812ffff700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813015d560 0x7f813015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.364+0000 7f8134e6b700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81301591b0 0x7f813014a1e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f812800c810 tx=0x7f8128007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.365+0000 7f812cff9700 1 -- 172.21.15.82:0/2735208546 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128005b30 con 0x7f81301591b0 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.365+0000 7f812cff9700 1 -- 172.21.15.82:0/2735208546 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128005c90 con 0x7f81301591b0 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.365+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813015ca00 con 0x7f81301591b0 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.365+0000 7f812cff9700 1 -- 172.21.15.82:0/2735208546 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128007300 con 0x7f81301591b0 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.365+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81300a8180 con 0x7f81301591b0 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.366+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8130064050 con 0x7f81301591b0 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.366+0000 7f812cff9700 1 -- 172.21.15.82:0/2735208546 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81280076b0 con 0x7f81301591b0 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.366+0000 7f812cff9700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.366+0000 7f812cff9700 1 -- 172.21.15.82:0/2735208546 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8128084190 con 0x7f81301591b0 2023-10-06T03:16:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.367+0000 7f812ffff700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.367+0000 7f812ffff700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8110066f30 0x7f81100693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f81300b3af0 tx=0x7f8120019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.370+0000 7f812cff9700 1 -- 172.21.15.82:0/2735208546 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8128051320 con 0x7f81301591b0 2023-10-06T03:16:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.555+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81300b27f0 con 0x7f81301591b0 2023-10-06T03:16:14.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.556+0000 7f812cff9700 1 -- 172.21.15.82:0/2735208546 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f8128054940 con 0x7f81301591b0 2023-10-06T03:16:14.557 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:14.557 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8110066f30 msgr2=0x7f81100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8110066f30 0x7f81100693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f81300b3af0 tx=0x7f8120019000 comp rx=0 tx=0).stop 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81301591b0 msgr2=0x7f813014a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81301591b0 0x7f813014a1e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f812800c810 tx=0x7f8128007df0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 shutdown_connections 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f813015d930 0x7f81300aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81301591b0 0x7f813014a1e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.558+0000 7f81370cf700 1 --2- 172.21.15.82:0/2735208546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f813015d560 0x7f813015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.559+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 >> 172.21.15.82:0/2735208546 conn(0x7f81300d1180 msgr2=0x7f81301564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.559+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 shutdown_connections 2023-10-06T03:16:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.559+0000 7f81370cf700 1 -- 172.21.15.82:0/2735208546 wait complete. 2023-10-06T03:16:14.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:15:49.404080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:15:50.736320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:16:14.572 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:14.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.687+0000 7f0fb9504700 1 Processor -- start 2023-10-06T03:16:14.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.687+0000 7f0fb9504700 1 -- start start 2023-10-06T03:16:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb9504700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0fb4159500 0x7f0fb41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb9504700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb415dab0 0x7f0fb40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb9504700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40b1110 con 0x7f0fb40b3fd0 2023-10-06T03:16:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb9504700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb40b13b0 con 0x7f0fb4159500 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb9504700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40b1690 con 0x7f0fb415dab0 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0fb4159500 0x7f0fb41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0fb4159500 0x7f0fb41598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53836/0 (socket says 172.21.15.82:53836) 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb2ffd700 1 -- 172.21.15.82:0/4138146207 learned_addr learned my addr 172.21.15.82:0/4138146207 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb37fe700 1 --2- 172.21.15.82:0/4138146207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb415dab0 0x7f0fb40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb2ffd700 1 -- 172.21.15.82:0/4138146207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb415dab0 msgr2=0x7f0fb40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb2ffd700 1 --2- 172.21.15.82:0/4138146207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb415dab0 0x7f0fb40cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb2ffd700 1 -- 172.21.15.82:0/4138146207 >> v1:172.21.15.134:6789/0 conn(0x7f0fb40b3fd0 legacy=0x7f0fb415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb2ffd700 1 -- 172.21.15.82:0/4138146207 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40b1970 con 0x7f0fb4159500 2023-10-06T03:16:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.688+0000 7f0fb2ffd700 1 --2- 172.21.15.82:0/4138146207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb4159500 0x7f0fb41598d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009f20 tx=0x7f0fa4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b49d7b6acbb5d8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb1ffb700 1 -- 172.21.15.82:0/4138146207 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400e070 con 0x7f0fb4159500 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb1ffb700 1 -- 172.21.15.82:0/4138146207 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400ba80 con 0x7f0fb4159500 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb1ffb700 1 -- 172.21.15.82:0/4138146207 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40092e0 con 0x7f0fb4159500 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb9504700 1 -- 172.21.15.82:0/4138146207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb4159500 msgr2=0x7f0fb41598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4138146207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb4159500 0x7f0fb41598d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009f20 tx=0x7f0fa4009840 comp rx=0 tx=0).stop 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb9504700 1 -- 172.21.15.82:0/4138146207 shutdown_connections 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4138146207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb415dab0 0x7f0fb40cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4138146207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb4159500 0x7f0fb41598d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb9504700 1 -- 172.21.15.82:0/4138146207 >> 172.21.15.82:0/4138146207 conn(0x7f0fb4067630 msgr2=0x7f0fb4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb9504700 1 -- 172.21.15.82:0/4138146207 shutdown_connections 2023-10-06T03:16:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.689+0000 7f0fb9504700 1 -- 172.21.15.82:0/4138146207 wait complete. 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.690+0000 7f0fb9504700 1 Processor -- start 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.690+0000 7f0fb9504700 1 -- start start 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb9504700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb40b3fd0 0x7f0fb414c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb9504700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fb4159500 0x7f0fb415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb9504700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb415dab0 0x7f0fb40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb9504700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb416ae20 con 0x7f0fb415dab0 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb9504700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb415a820 con 0x7f0fb4159500 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb9504700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb416a1a0 con 0x7f0fb40b3fd0 2023-10-06T03:16:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb415dab0 0x7f0fb40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb415dab0 0x7f0fb40689d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53852/0 (socket says 172.21.15.82:53852) 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb37fe700 1 -- 172.21.15.82:0/4167631203 learned_addr learned my addr 172.21.15.82:0/4167631203 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb2ffd700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb40b3fd0 0x7f0fb414c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb27fc700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fb4159500 0x7f0fb415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb37fe700 1 -- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb40b3fd0 msgr2=0x7f0fb414c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb37fe700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb40b3fd0 0x7f0fb414c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb37fe700 1 -- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fb4159500 msgr2=0x7f0fb415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.691+0000 7f0fb37fe700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fb4159500 0x7f0fb415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.692+0000 7f0fb37fe700 1 -- 172.21.15.82:0/4167631203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4009ae0 con 0x7f0fb415dab0 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.692+0000 7f0fb37fe700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb415dab0 0x7f0fb40689d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00d890 tx=0x7f0fac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:14.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.692+0000 7f0faaffd700 1 -- 172.21.15.82:0/4167631203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0125f0 con 0x7f0fb415dab0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.692+0000 7f0faaffd700 1 -- 172.21.15.82:0/4167631203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac012750 con 0x7f0fb415dab0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.692+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb416a480 con 0x7f0fb415dab0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.692+0000 7f0faaffd700 1 -- 172.21.15.82:0/4167631203 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac012b10 con 0x7f0fb415dab0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.692+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb416aa40 con 0x7f0fb415dab0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.693+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb416af60 con 0x7f0fb415dab0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.693+0000 7f0faaffd700 1 -- 172.21.15.82:0/4167631203 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fac013480 con 0x7f0fb415dab0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.693+0000 7f0faaffd700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0f94066f30 0x7f0f940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.694+0000 7f0faaffd700 1 -- 172.21.15.82:0/4167631203 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0fac084a50 con 0x7f0fb415dab0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.694+0000 7f0fb2ffd700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0f94066f30 0x7f0f940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:14.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.694+0000 7f0fb2ffd700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0f94066f30 0x7f0f940693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009880 tx=0x7f0fa4018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:14.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.698+0000 7f0faaffd700 1 -- 172.21.15.82:0/4167631203 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fb416af60 con 0x7f0fb415dab0 2023-10-06T03:16:14.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.877+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0fb416af60 con 0x7f0fb415dab0 2023-10-06T03:16:14.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.878+0000 7f0faaffd700 1 -- 172.21.15.82:0/4167631203 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0fb416af60 con 0x7f0fb415dab0 2023-10-06T03:16:14.879 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:14.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.879+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0f94066f30 msgr2=0x7f0f940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.879+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0f94066f30 0x7f0f940693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009880 tx=0x7f0fa4018000 comp rx=0 tx=0).stop 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.879+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb415dab0 msgr2=0x7f0fb40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.879+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb415dab0 0x7f0fb40689d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00d890 tx=0x7f0fac008040 comp rx=0 tx=0).stop 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.880+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 shutdown_connections 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.880+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fb415dab0 0x7f0fb40689d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.880+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0f94066f30 0x7f0f940693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.880+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fb40b3fd0 0x7f0fb414c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.880+0000 7f0fb9504700 1 --2- 172.21.15.82:0/4167631203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fb4159500 0x7f0fb415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.880+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 >> 172.21.15.82:0/4167631203 conn(0x7f0fb4067630 msgr2=0x7f0fb414d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.880+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 shutdown_connections 2023-10-06T03:16:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:14.880+0000 7f0fb9504700 1 -- 172.21.15.82:0/4167631203 wait complete. 2023-10-06T03:16:14.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:15.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.008+0000 7f679359e700 1 Processor -- start 2023-10-06T03:16:15.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.008+0000 7f679359e700 1 -- start start 2023-10-06T03:16:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679359e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67941571e0 0x7f679415af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679359e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67940ccb30 0x7f679415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940cddb0 con 0x7f67941575b0 2023-10-06T03:16:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679359e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67940cd1a0 con 0x7f67941571e0 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679359e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940cd480 con 0x7f67940ccb30 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f6791d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f67941575b0 0x7f67940cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59382/0 (socket says 172.21.15.82:59382) 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f6791d9b700 1 -- 172.21.15.82:0/3831929058 learned_addr learned my addr 172.21.15.82:0/3831929058 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f6792d9d700 1 --2- 172.21.15.82:0/3831929058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67940ccb30 0x7f679415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679259c700 1 --2- 172.21.15.82:0/3831929058 >> v2:172.21.15.134:3300/0 conn(0x7f67941571e0 0x7f679415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679159a700 1 -- 172.21.15.82:0/3831929058 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495784384 0 0) 0x7f67940cddb0 con 0x7f67941575b0 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679159a700 1 -- 172.21.15.82:0/3831929058 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f677c003570 con 0x7f67941575b0 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679159a700 1 -- 172.21.15.82:0/3831929058 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3885348997 0 0) 0x7f677c003570 con 0x7f67941575b0 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f6792d9d700 1 -- 172.21.15.82:0/3831929058 >> v2:172.21.15.134:3300/0 conn(0x7f67941571e0 msgr2=0x7f679415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f6792d9d700 1 --2- 172.21.15.82:0/3831929058 >> v2:172.21.15.134:3300/0 conn(0x7f67941571e0 0x7f679415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f6792d9d700 1 -- 172.21.15.82:0/3831929058 >> v1:172.21.15.82:6789/0 conn(0x7f67941575b0 legacy=0x7f67940cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f6792d9d700 1 -- 172.21.15.82:0/3831929058 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67940cd760 con 0x7f67940ccb30 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.009+0000 7f679259c700 1 --2- 172.21.15.82:0/3831929058 >> v2:172.21.15.134:3300/0 conn(0x7f67941571e0 0x7f679415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f6792d9d700 1 --2- 172.21.15.82:0/3831929058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67940ccb30 0x7f679415b4d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f678c009e60 tx=0x7f678c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a576a9ef8d4564a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679159a700 1 -- 172.21.15.82:0/3831929058 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c00e070 con 0x7f67940ccb30 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679159a700 1 -- 172.21.15.82:0/3831929058 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c00b7a0 con 0x7f67940ccb30 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679159a700 1 -- 172.21.15.82:0/3831929058 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788001470 con 0x7f67940ccb30 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679359e700 1 -- 172.21.15.82:0/3831929058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67940ccb30 msgr2=0x7f679415b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679359e700 1 --2- 172.21.15.82:0/3831929058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67940ccb30 0x7f679415b4d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f678c009e60 tx=0x7f678c009780 comp rx=0 tx=0).stop 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679359e700 1 -- 172.21.15.82:0/3831929058 shutdown_connections 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679359e700 1 --2- 172.21.15.82:0/3831929058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67940ccb30 0x7f679415b4d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679359e700 1 --2- 172.21.15.82:0/3831929058 >> v2:172.21.15.134:3300/0 conn(0x7f67941571e0 0x7f679415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679359e700 1 -- 172.21.15.82:0/3831929058 >> 172.21.15.82:0/3831929058 conn(0x7f67940ce390 msgr2=0x7f67940ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679359e700 1 -- 172.21.15.82:0/3831929058 shutdown_connections 2023-10-06T03:16:15.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.010+0000 7f679359e700 1 -- 172.21.15.82:0/3831929058 wait complete. 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.011+0000 7f679359e700 1 Processor -- start 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.011+0000 7f679359e700 1 -- start start 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67940ccb30 0x7f6794150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679359e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67941571e0 0x7f6794167e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679359e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67941575b0 0x7f6794155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6794151200 con 0x7f67940ccb30 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679359e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940c3ee0 con 0x7f67941575b0 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679359e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940c32d0 con 0x7f67941571e0 2023-10-06T03:16:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67940ccb30 0x7f6794150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67940ccb30 0x7f6794150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53862/0 (socket says 172.21.15.82:53862) 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.012+0000 7f679259c700 1 -- 172.21.15.82:0/2856608426 learned_addr learned my addr 172.21.15.82:0/2856608426 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f679259c700 1 -- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67941571e0 msgr2=0x7f6794167e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f679259c700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67941571e0 0x7f6794167e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f679259c700 1 -- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67941575b0 msgr2=0x7f6794155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f679259c700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67941575b0 0x7f6794155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f679259c700 1 -- 172.21.15.82:0/2856608426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784009420 con 0x7f67940ccb30 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f679259c700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67940ccb30 0x7f6794150cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f678400ec80 tx=0x7f67840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f67827fc700 1 -- 172.21.15.82:0/2856608426 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678400c9d0 con 0x7f67940ccb30 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f67827fc700 1 -- 172.21.15.82:0/2856608426 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678400cb30 con 0x7f67940ccb30 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f67827fc700 1 -- 172.21.15.82:0/2856608426 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678400ceb0 con 0x7f67940ccb30 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c009a20 con 0x7f67940ccb30 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.013+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67940c3890 con 0x7f67940ccb30 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.014+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679406ef00 con 0x7f67940ccb30 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.014+0000 7f67827fc700 1 -- 172.21.15.82:0/2856608426 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6784013680 con 0x7f67940ccb30 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.014+0000 7f67827fc700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.015+0000 7f67827fc700 1 -- 172.21.15.82:0/2856608426 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6784084ae0 con 0x7f67940ccb30 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.015+0000 7f6791d9b700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.015+0000 7f6791d9b700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6774066f30 0x7f67740693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f679416ab80 tx=0x7f67880012c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.019+0000 7f67827fc700 1 -- 172.21.15.82:0/2856608426 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6784051bf0 con 0x7f67940ccb30 2023-10-06T03:16:15.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.200+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f679404c3c0 con 0x7f67940ccb30 2023-10-06T03:16:15.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.200+0000 7f67827fc700 1 -- 172.21.15.82:0/2856608426 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6784055210 con 0x7f67940ccb30 2023-10-06T03:16:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:15.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.202+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6774066f30 msgr2=0x7f67740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.202+0000 7f679359e700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6774066f30 0x7f67740693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f679416ab80 tx=0x7f67880012c0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.202+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67940ccb30 msgr2=0x7f6794150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.202+0000 7f679359e700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67940ccb30 0x7f6794150cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f678400ec80 tx=0x7f67840091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.202+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 shutdown_connections 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.202+0000 7f679359e700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67941575b0 0x7f6794155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.203+0000 7f679359e700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67940ccb30 0x7f6794150cc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.203+0000 7f679359e700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.203+0000 7f679359e700 1 --2- 172.21.15.82:0/2856608426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67941571e0 0x7f6794167e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.203+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 >> 172.21.15.82:0/2856608426 conn(0x7f67940ce390 msgr2=0x7f67940b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.203+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 shutdown_connections 2023-10-06T03:16:15.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.203+0000 7f679359e700 1 -- 172.21.15.82:0/2856608426 wait complete. 2023-10-06T03:16:15.215 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:16:15.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.331+0000 7fa98e0db700 1 Processor -- start 2023-10-06T03:16:15.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.331+0000 7fa98e0db700 1 -- start start 2023-10-06T03:16:15.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa98e0db700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa988159500 0x7fa9881598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa98e0db700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa98815dab0 0x7fa9880cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa98e0db700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880b1110 con 0x7fa9880b3fd0 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa98e0db700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880b13b0 con 0x7fa98815dab0 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa98e0db700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880b1690 con 0x7fa988159500 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa986ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa9880b3fd0 0x7fa98815d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59386/0 (socket says 172.21.15.82:59386) 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa986ffd700 1 -- 172.21.15.82:0/109530369 learned_addr learned my addr 172.21.15.82:0/109530369 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa9877fe700 1 --2- 172.21.15.82:0/109530369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa988159500 0x7fa9881598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.332+0000 7fa987fff700 1 --2- 172.21.15.82:0/109530369 >> v2:172.21.15.134:3300/0 conn(0x7fa98815dab0 0x7fa9880cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9867fc700 1 -- 172.21.15.82:0/109530369 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746991863 0 0) 0x7fa9880b1110 con 0x7fa9880b3fd0 2023-10-06T03:16:15.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9867fc700 1 -- 172.21.15.82:0/109530369 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa970003570 con 0x7fa9880b3fd0 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9877fe700 1 -- 172.21.15.82:0/109530369 >> v2:172.21.15.134:3300/0 conn(0x7fa98815dab0 msgr2=0x7fa9880cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9877fe700 1 --2- 172.21.15.82:0/109530369 >> v2:172.21.15.134:3300/0 conn(0x7fa98815dab0 0x7fa9880cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9877fe700 1 -- 172.21.15.82:0/109530369 >> v1:172.21.15.82:6789/0 conn(0x7fa9880b3fd0 legacy=0x7fa98815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9877fe700 1 -- 172.21.15.82:0/109530369 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880b1970 con 0x7fa988159500 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa987fff700 1 --2- 172.21.15.82:0/109530369 >> v2:172.21.15.134:3300/0 conn(0x7fa98815dab0 0x7fa9880cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9877fe700 1 --2- 172.21.15.82:0/109530369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa988159500 0x7fa9881598d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa9780098e0 tx=0x7fa9780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=746bd504552ea077 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9867fc700 1 -- 172.21.15.82:0/109530369 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978011630 con 0x7fa988159500 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9867fc700 1 -- 172.21.15.82:0/109530369 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978011790 con 0x7fa988159500 2023-10-06T03:16:15.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.333+0000 7fa9867fc700 1 -- 172.21.15.82:0/109530369 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978011b30 con 0x7fa988159500 2023-10-06T03:16:15.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.334+0000 7fa98e0db700 1 -- 172.21.15.82:0/109530369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa988159500 msgr2=0x7fa9881598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.334+0000 7fa98e0db700 1 --2- 172.21.15.82:0/109530369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa988159500 0x7fa9881598d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa9780098e0 tx=0x7fa9780091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.334+0000 7fa98e0db700 1 -- 172.21.15.82:0/109530369 shutdown_connections 2023-10-06T03:16:15.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.334+0000 7fa98e0db700 1 --2- 172.21.15.82:0/109530369 >> v2:172.21.15.134:3300/0 conn(0x7fa98815dab0 0x7fa9880cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.334+0000 7fa98e0db700 1 --2- 172.21.15.82:0/109530369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa988159500 0x7fa9881598d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.334+0000 7fa98e0db700 1 -- 172.21.15.82:0/109530369 >> 172.21.15.82:0/109530369 conn(0x7fa988067630 msgr2=0x7fa988069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:15.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.334+0000 7fa98e0db700 1 -- 172.21.15.82:0/109530369 shutdown_connections 2023-10-06T03:16:15.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.334+0000 7fa98e0db700 1 -- 172.21.15.82:0/109530369 wait complete. 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.335+0000 7fa98e0db700 1 Processor -- start 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.335+0000 7fa98e0db700 1 -- start start 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa98e0db700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9880b3fd0 0x7fa98814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa98e0db700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988159500 0x7fa988146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa98e0db700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98815dab0 0x7fa988134f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa98e0db700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988146180 con 0x7fa988159500 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa98e0db700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988145570 con 0x7fa98815dab0 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa98e0db700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa988145850 con 0x7fa9880b3fd0 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988159500 0x7fa988146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988159500 0x7fa988146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53866/0 (socket says 172.21.15.82:53866) 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 -- 172.21.15.82:0/5971207 learned_addr learned my addr 172.21.15.82:0/5971207 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa987fff700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98815dab0 0x7fa988134f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa9877fe700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9880b3fd0 0x7fa98814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 -- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9880b3fd0 msgr2=0x7fa98814ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9880b3fd0 0x7fa98814ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 -- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98815dab0 msgr2=0x7fa988134f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98815dab0 0x7fa988134f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 -- 172.21.15.82:0/5971207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009a20 con 0x7fa988159500 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa986ffd700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988159500 0x7fa988146610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c7c0 tx=0x7fa97c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa96f7fe700 1 -- 172.21.15.82:0/5971207 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c005b30 con 0x7fa988159500 2023-10-06T03:16:15.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa96f7fe700 1 -- 172.21.15.82:0/5971207 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c005cb0 con 0x7fa988159500 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa96f7fe700 1 -- 172.21.15.82:0/5971207 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c007320 con 0x7fa988159500 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa978009420 con 0x7fa988159500 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.336+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa988145e10 con 0x7fa988159500 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.337+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa988064050 con 0x7fa988159500 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.338+0000 7fa96f7fe700 1 -- 172.21.15.82:0/5971207 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa97c01b3b0 con 0x7fa988159500 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.338+0000 7fa96f7fe700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa974066f30 0x7fa9740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.338+0000 7fa96f7fe700 1 -- 172.21.15.82:0/5971207 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa97c083ac0 con 0x7fa988159500 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.338+0000 7fa9877fe700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa974066f30 0x7fa9740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.339+0000 7fa9877fe700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa974066f30 0x7fa9740693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9780091e0 tx=0x7fa978017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.342+0000 7fa96f7fe700 1 -- 172.21.15.82:0/5971207 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa97c050c90 con 0x7fa988159500 2023-10-06T03:16:15.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.525+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9880d0420 con 0x7fa988159500 2023-10-06T03:16:15.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.526+0000 7fa96f7fe700 1 -- 172.21.15.82:0/5971207 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa97c083e60 con 0x7fa988159500 2023-10-06T03:16:15.526 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa974066f30 msgr2=0x7fa9740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa974066f30 0x7fa9740693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9780091e0 tx=0x7fa978017000 comp rx=0 tx=0).stop 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988159500 msgr2=0x7fa988146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988159500 0x7fa988146610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c7c0 tx=0x7fa97c007e00 comp rx=0 tx=0).stop 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 shutdown_connections 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa98815dab0 0x7fa988134f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa974066f30 0x7fa9740693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9880b3fd0 0x7fa98814ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 --2- 172.21.15.82:0/5971207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa988159500 0x7fa988146610 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 >> 172.21.15.82:0/5971207 conn(0x7fa988067630 msgr2=0x7fa988144170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:15.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 shutdown_connections 2023-10-06T03:16:15.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.528+0000 7fa98e0db700 1 -- 172.21.15.82:0/5971207 wait complete. 2023-10-06T03:16:15.541 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:16:15.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.659+0000 7f6830be7700 1 Processor -- start 2023-10-06T03:16:15.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.659+0000 7f6830be7700 1 -- start start 2023-10-06T03:16:15.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f6830be7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f682c142e90 0x7f682c069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f6830be7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f682c069d50 0x7f682c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f6830be7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c069380 con 0x7f682c15de80 2023-10-06T03:16:15.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f6830be7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682c068770 con 0x7f682c142e90 2023-10-06T03:16:15.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f6830be7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682c068a50 con 0x7f682c069d50 2023-10-06T03:16:15.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f682b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f682c142e90 0x7f682c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f682b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f682c142e90 0x7f682c069810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53876/0 (socket says 172.21.15.82:53876) 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f682b7fe700 1 -- 172.21.15.82:0/3138280327 learned_addr learned my addr 172.21.15.82:0/3138280327 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f682affd700 1 --2- 172.21.15.82:0/3138280327 >> v2:172.21.15.134:3300/0 conn(0x7f682c069d50 0x7f682c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f682b7fe700 1 -- 172.21.15.82:0/3138280327 >> v2:172.21.15.134:3300/0 conn(0x7f682c069d50 msgr2=0x7f682c15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f682b7fe700 1 --2- 172.21.15.82:0/3138280327 >> v2:172.21.15.134:3300/0 conn(0x7f682c069d50 0x7f682c15d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f682b7fe700 1 -- 172.21.15.82:0/3138280327 >> v1:172.21.15.134:6789/0 conn(0x7f682c15de80 legacy=0x7f682c0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.660+0000 7f682b7fe700 1 -- 172.21.15.82:0/3138280327 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c068d30 con 0x7f682c142e90 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f682b7fe700 1 --2- 172.21.15.82:0/3138280327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c069810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f682c06fd60 tx=0x7f681c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfea1c6866391577 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f682a7fc700 1 -- 172.21.15.82:0/3138280327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c009e70 con 0x7f682c142e90 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f682a7fc700 1 -- 172.21.15.82:0/3138280327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c00b860 con 0x7f682c142e90 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f682a7fc700 1 -- 172.21.15.82:0/3138280327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00bc00 con 0x7f682c142e90 2023-10-06T03:16:15.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f6830be7700 1 -- 172.21.15.82:0/3138280327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 msgr2=0x7f682c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f6830be7700 1 --2- 172.21.15.82:0/3138280327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c069810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f682c06fd60 tx=0x7f681c009250 comp rx=0 tx=0).stop 2023-10-06T03:16:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f6830be7700 1 -- 172.21.15.82:0/3138280327 shutdown_connections 2023-10-06T03:16:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f6830be7700 1 --2- 172.21.15.82:0/3138280327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c069810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f6830be7700 1 --2- 172.21.15.82:0/3138280327 >> v2:172.21.15.134:3300/0 conn(0x7f682c069d50 0x7f682c15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f6830be7700 1 -- 172.21.15.82:0/3138280327 >> 172.21.15.82:0/3138280327 conn(0x7f682c0ccfe0 msgr2=0x7f682c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f6830be7700 1 -- 172.21.15.82:0/3138280327 shutdown_connections 2023-10-06T03:16:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.661+0000 7f6830be7700 1 -- 172.21.15.82:0/3138280327 wait complete. 2023-10-06T03:16:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f6830be7700 1 Processor -- start 2023-10-06T03:16:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f6830be7700 1 -- start start 2023-10-06T03:16:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f6830be7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c069d50 0x7f682c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f6830be7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f6830be7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f682c15de80 0x7f682c0c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f6830be7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0c65d0 con 0x7f682c142e90 2023-10-06T03:16:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f6830be7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0c68a0 con 0x7f682c069d50 2023-10-06T03:16:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f6830be7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0c6b80 con 0x7f682c15de80 2023-10-06T03:16:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.663+0000 7f682affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c0c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53878/0 (socket says 172.21.15.82:53878) 2023-10-06T03:16:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682affd700 1 -- 172.21.15.82:0/712818499 learned_addr learned my addr 172.21.15.82:0/712818499 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682affd700 1 -- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f682c15de80 msgr2=0x7f682c0c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682affd700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f682c15de80 0x7f682c0c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682b7fe700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c069d50 0x7f682c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682affd700 1 -- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c069d50 msgr2=0x7f682c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682affd700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c069d50 0x7f682c0cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682affd700 1 -- 172.21.15.82:0/712818499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c0094f0 con 0x7f682c142e90 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f682affd700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c0c6090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f682000ea50 tx=0x7f68200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f68137fe700 1 -- 172.21.15.82:0/712818499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682000c920 con 0x7f682c142e90 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f68137fe700 1 -- 172.21.15.82:0/712818499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682000ca80 con 0x7f682c142e90 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c0c6e60 con 0x7f682c142e90 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f68137fe700 1 -- 172.21.15.82:0/712818499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682000ce20 con 0x7f682c142e90 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.664+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c0c7420 con 0x7f682c142e90 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.665+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c0ccb30 con 0x7f682c142e90 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.665+0000 7f68137fe700 1 -- 172.21.15.82:0/712818499 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6820013680 con 0x7f682c142e90 2023-10-06T03:16:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.666+0000 7f68137fe700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6818066f30 0x7f68180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.666+0000 7f68137fe700 1 -- 172.21.15.82:0/712818499 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6820084a80 con 0x7f682c142e90 2023-10-06T03:16:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.666+0000 7f682b7fe700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6818066f30 0x7f68180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.666+0000 7f682b7fe700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6818066f30 0x7f68180693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f682c06fd60 tx=0x7f681c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.670+0000 7f68137fe700 1 -- 172.21.15.82:0/712818499 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6820051b90 con 0x7f682c142e90 2023-10-06T03:16:15.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.856+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f682c04c3c0 con 0x7f682c142e90 2023-10-06T03:16:15.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.856+0000 7f68137fe700 1 -- 172.21.15.82:0/712818499 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68200551b0 con 0x7f682c142e90 2023-10-06T03:16:15.857 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:16:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6818066f30 msgr2=0x7f68180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6818066f30 0x7f68180693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f682c06fd60 tx=0x7f681c017000 comp rx=0 tx=0).stop 2023-10-06T03:16:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 msgr2=0x7f682c0c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c0c6090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f682000ea50 tx=0x7f68200091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 shutdown_connections 2023-10-06T03:16:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6818066f30 0x7f68180693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f682c15de80 0x7f682c0c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f682c069d50 0x7f682c0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 --2- 172.21.15.82:0/712818499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f682c142e90 0x7f682c0c6090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 >> 172.21.15.82:0/712818499 conn(0x7f682c0ccfe0 msgr2=0x7f682c0b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 shutdown_connections 2023-10-06T03:16:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.858+0000 7f6830be7700 1 -- 172.21.15.82:0/712818499 wait complete. 2023-10-06T03:16:15.871 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:15.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.985+0000 7fd191503700 1 Processor -- start 2023-10-06T03:16:15.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.985+0000 7fd191503700 1 -- start start 2023-10-06T03:16:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd191503700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c15d930 0x7fd18c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd191503700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c0b2ad0 con 0x7fd18c1591b0 2023-10-06T03:16:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd191503700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c0b4160 con 0x7fd18c15d560 2023-10-06T03:16:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd191503700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b2230 con 0x7fd18c15d930 2023-10-06T03:16:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd18b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd18c1591b0 0x7fd18c159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59390/0 (socket says 172.21.15.82:59390) 2023-10-06T03:16:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd18b7fe700 1 -- 172.21.15.82:0/2180402932 learned_addr learned my addr 172.21.15.82:0/2180402932 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd1827fc700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c15d930 0x7fd18c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187478211 0 0) 0x7fd18c0b2ad0 con 0x7fd18c1591b0 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.986+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd178003570 con 0x7fd18c1591b0 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1172310201 0 0) 0x7fd178003570 con 0x7fd18c1591b0 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c15d930 msgr2=0x7fd18c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c15d930 0x7fd18c0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 >> v1:172.21.15.134:6789/0 conn(0x7fd18c15d560 legacy=0x7fd18c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0b2510 con 0x7fd18c1591b0 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fd1840017f0 con 0x7fd18c1591b0 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 >> v1:172.21.15.82:6789/0 conn(0x7fd18c1591b0 legacy=0x7fd18c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd178003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c15d930 0x7fd178004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178004d50 0x7fd1780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b2230 con 0x7fd178003a90 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17800bb70 con 0x7fd178004d50 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17800bd30 con 0x7fd18c15d930 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18affd700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd178003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd1827fc700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c15d930 0x7fd178004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18b7fe700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178004d50 0x7fd1780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18affd700 1 -- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c15d930 msgr2=0x7fd178004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18affd700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c15d930 0x7fd178004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18affd700 1 -- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178004d50 msgr2=0x7fd1780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18affd700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178004d50 0x7fd1780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18affd700 1 -- 172.21.15.82:0/2180402932 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd178003570 con 0x7fd178003a90 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18b7fe700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178004d50 0x7fd1780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18affd700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd178003ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0018b0 tx=0x7fd17c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba67cc667f9c5586 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c012420 con 0x7fd178003a90 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c012580 con 0x7fd178003a90 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.987+0000 7fd18a7fc700 1 -- 172.21.15.82:0/2180402932 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c012920 con 0x7fd178003a90 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.988+0000 7fd191503700 1 -- 172.21.15.82:0/2180402932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 msgr2=0x7fd178003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.988+0000 7fd191503700 1 --2- 172.21.15.82:0/2180402932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd178003ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0018b0 tx=0x7fd17c007d30 comp rx=0 tx=0).stop 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.988+0000 7fd18b7fe700 1 -- 172.21.15.82:0/2180402932 reap_dead start 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.988+0000 7fd191503700 1 -- 172.21.15.82:0/2180402932 shutdown_connections 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.988+0000 7fd191503700 1 -- 172.21.15.82:0/2180402932 >> 172.21.15.82:0/2180402932 conn(0x7fd18c0d1180 msgr2=0x7fd18c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.988+0000 7fd191503700 1 -- 172.21.15.82:0/2180402932 shutdown_connections 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.988+0000 7fd191503700 1 -- 172.21.15.82:0/2180402932 wait complete. 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.989+0000 7fd191503700 1 Processor -- start 2023-10-06T03:16:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.989+0000 7fd191503700 1 -- start start 2023-10-06T03:16:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd191503700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd18c16c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd191503700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd18c0a7140 0x7fd18c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd191503700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c16ad00 0x7fd18c0b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd191503700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0a7c20 con 0x7fd178003a90 2023-10-06T03:16:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd191503700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c16cef0 con 0x7fd18c0a7140 2023-10-06T03:16:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd191503700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c15c0b0 con 0x7fd18c16ad00 2023-10-06T03:16:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd18c16c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd18c16c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53906/0 (socket says 172.21.15.82:53906) 2023-10-06T03:16:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 -- 172.21.15.82:0/1431500260 learned_addr learned my addr 172.21.15.82:0/1431500260 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd1827fc700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd18c0a7140 0x7fd18c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18b7fe700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c16ad00 0x7fd18c0b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 -- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c16ad00 msgr2=0x7fd18c0b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c16ad00 0x7fd18c0b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 -- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd18c0a7140 msgr2=0x7fd18c15b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd18c0a7140 0x7fd18c15b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 -- 172.21.15.82:0/1431500260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c15c390 con 0x7fd178003a90 2023-10-06T03:16:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.990+0000 7fd18affd700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd18c16c9b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00cfa0 tx=0x7fd17c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.991+0000 7fd1837fe700 1 -- 172.21.15.82:0/1431500260 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c001200 con 0x7fd178003a90 2023-10-06T03:16:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.991+0000 7fd1837fe700 1 -- 172.21.15.82:0/1431500260 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c012c90 con 0x7fd178003a90 2023-10-06T03:16:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.991+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c15c670 con 0x7fd178003a90 2023-10-06T03:16:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.991+0000 7fd1837fe700 1 -- 172.21.15.82:0/1431500260 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c012920 con 0x7fd178003a90 2023-10-06T03:16:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.991+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c15be40 con 0x7fd178003a90 2023-10-06T03:16:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.992+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c0a7f00 con 0x7fd178003a90 2023-10-06T03:16:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.992+0000 7fd1837fe700 1 -- 172.21.15.82:0/1431500260 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd17c006a30 con 0x7fd178003a90 2023-10-06T03:16:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.992+0000 7fd1837fe700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd16c066f30 0x7fd16c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.992+0000 7fd1837fe700 1 -- 172.21.15.82:0/1431500260 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd17c085bf0 con 0x7fd178003a90 2023-10-06T03:16:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.992+0000 7fd1827fc700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd16c066f30 0x7fd16c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.993+0000 7fd1827fc700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd16c066f30 0x7fd16c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd174006dc0 tx=0x7fd174008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:15.996+0000 7fd1837fe700 1 -- 172.21.15.82:0/1431500260 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd17c052d00 con 0x7fd178003a90 2023-10-06T03:16:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.179+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd18c0a79f0 con 0x7fd178003a90 2023-10-06T03:16:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.180+0000 7fd1837fe700 1 -- 172.21.15.82:0/1431500260 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fd18c0a79f0 con 0x7fd178003a90 2023-10-06T03:16:16.181 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:16.181 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.181+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd16c066f30 msgr2=0x7fd16c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.181+0000 7fd191503700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd16c066f30 0x7fd16c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd174006dc0 tx=0x7fd174008040 comp rx=0 tx=0).stop 2023-10-06T03:16:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.181+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 msgr2=0x7fd18c16c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.181+0000 7fd191503700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd18c16c9b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00cfa0 tx=0x7fd17c015000 comp rx=0 tx=0).stop 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.182+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 shutdown_connections 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.182+0000 7fd191503700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd16c066f30 0x7fd16c0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.182+0000 7fd191503700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd18c16ad00 0x7fd18c0b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.182+0000 7fd191503700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd178003a90 0x7fd18c16c9b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.182+0000 7fd191503700 1 --2- 172.21.15.82:0/1431500260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd18c0a7140 0x7fd18c15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.182+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 >> 172.21.15.82:0/1431500260 conn(0x7fd18c0d1180 msgr2=0x7fd18c0b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.182+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 shutdown_connections 2023-10-06T03:16:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.182+0000 7fd191503700 1 -- 172.21.15.82:0/1431500260 wait complete. 2023-10-06T03:16:16.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:15:49.404080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:15:50.736320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:16:16.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.311+0000 7f808c947700 1 Processor -- start 2023-10-06T03:16:16.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.311+0000 7f808c947700 1 -- start start 2023-10-06T03:16:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f808c947700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808815de80 0x7f80880b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f808c947700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8088069380 con 0x7f80880b61d0 2023-10-06T03:16:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f808c947700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8088069f20 con 0x7f8088142e90 2023-10-06T03:16:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f808c947700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8088068770 con 0x7f808815de80 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f808759e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f80880b61d0 0x7f808815d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59400/0 (socket says 172.21.15.82:59400) 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f808759e700 1 -- 172.21.15.82:0/1072599506 learned_addr learned my addr 172.21.15.82:0/1072599506 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648245338 0 0) 0x7f8088069380 con 0x7f80880b61d0 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8070003570 con 0x7f80880b61d0 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f808659c700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808815de80 0x7f80880b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2155616618 0 0) 0x7f8070003570 con 0x7f80880b61d0 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808815de80 msgr2=0x7f80880b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808815de80 0x7f80880b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 >> v1:172.21.15.134:6789/0 conn(0x7f8088142e90 legacy=0x7f8088069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088068a50 con 0x7f80880b61d0 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f80800017f0 con 0x7f80880b61d0 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 >> v1:172.21.15.82:6789/0 conn(0x7f80880b61d0 legacy=0x7f808815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070003a90 0x7f8070003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8070004810 0x7f8070004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808815de80 0x7f80700051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8088068770 con 0x7f8070003a90 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807000bb60 con 0x7f8070004810 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.312+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807000bd20 con 0x7f808815de80 2023-10-06T03:16:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8086d9d700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070003a90 0x7f8070003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f808659c700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8070004810 0x7f8070004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f808759e700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808815de80 0x7f80700051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8086d9d700 1 -- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808815de80 msgr2=0x7f80700051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8086d9d700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808815de80 0x7f80700051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8086d9d700 1 -- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8070004810 msgr2=0x7f8070004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8086d9d700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8070004810 0x7f8070004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8086d9d700 1 -- 172.21.15.82:0/1072599506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070003570 con 0x7f8070003a90 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f808659c700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8070004810 0x7f8070004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8086d9d700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070003a90 0x7f8070003ea0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f80780018b0 tx=0x7f8078007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c722bdae571e3b0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078012420 con 0x7f8070003a90 2023-10-06T03:16:16.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8078012580 con 0x7f8070003a90 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f8085d9b700 1 -- 172.21.15.82:0/1072599506 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078012920 con 0x7f8070003a90 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f808c947700 1 -- 172.21.15.82:0/1072599506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070003a90 msgr2=0x7f8070003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.313+0000 7f808c947700 1 --2- 172.21.15.82:0/1072599506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070003a90 0x7f8070003ea0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f80780018b0 tx=0x7f8078007d30 comp rx=0 tx=0).stop 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.314+0000 7f808759e700 1 -- 172.21.15.82:0/1072599506 reap_dead start 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.314+0000 7f808c947700 1 -- 172.21.15.82:0/1072599506 shutdown_connections 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.314+0000 7f808c947700 1 -- 172.21.15.82:0/1072599506 >> 172.21.15.82:0/1072599506 conn(0x7f80880ccfe0 msgr2=0x7f80880cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.314+0000 7f808c947700 1 -- 172.21.15.82:0/1072599506 shutdown_connections 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.314+0000 7f808c947700 1 -- 172.21.15.82:0/1072599506 wait complete. 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.315+0000 7f808c947700 1 Processor -- start 2023-10-06T03:16:16.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.315+0000 7f808c947700 1 -- start start 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.315+0000 7f808c947700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8070003a90 0x7f80880c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.315+0000 7f808c947700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808813f8a0 0x7f80880c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.315+0000 7f808c947700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80880c5850 0x7f808815f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.315+0000 7f808c947700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80880cb6c0 con 0x7f808813f8a0 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.315+0000 7f808c947700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80880cb0b0 con 0x7f80880c5850 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.315+0000 7f808c947700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80880c5d60 con 0x7f8070003a90 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808813f8a0 0x7f80880c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808813f8a0 0x7f80880c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53938/0 (socket says 172.21.15.82:53938) 2023-10-06T03:16:16.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 -- 172.21.15.82:0/1275877224 learned_addr learned my addr 172.21.15.82:0/1275877224 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808759e700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80880c5850 0x7f808815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f8086d9d700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8070003a90 0x7f80880c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 -- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8070003a90 msgr2=0x7f80880c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8070003a90 0x7f80880c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 -- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80880c5850 msgr2=0x7f808815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80880c5850 0x7f808815f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 -- 172.21.15.82:0/1275877224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80880c6040 con 0x7f808813f8a0 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808659c700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808813f8a0 0x7f80880c5310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f807c011990 tx=0x7f807c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f806effd700 1 -- 172.21.15.82:0/1275877224 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c011ed0 con 0x7f808813f8a0 2023-10-06T03:16:16.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f806effd700 1 -- 172.21.15.82:0/1275877224 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c00f8e0 con 0x7f808813f8a0 2023-10-06T03:16:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f806effd700 1 -- 172.21.15.82:0/1275877224 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00fca0 con 0x7f808813f8a0 2023-10-06T03:16:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80880cb350 con 0x7f808813f8a0 2023-10-06T03:16:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.316+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808815b5b0 con 0x7f808813f8a0 2023-10-06T03:16:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.317+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80880c6280 con 0x7f808813f8a0 2023-10-06T03:16:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.318+0000 7f806effd700 1 -- 172.21.15.82:0/1275877224 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f807c015670 con 0x7f808813f8a0 2023-10-06T03:16:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.318+0000 7f806effd700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8074066f60 0x7f8074069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.318+0000 7f806effd700 1 -- 172.21.15.82:0/1275877224 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f807c084ec0 con 0x7f808813f8a0 2023-10-06T03:16:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.318+0000 7f8086d9d700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8074066f60 0x7f8074069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.318+0000 7f8086d9d700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8074066f60 0x7f8074069410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8078001010 tx=0x7f8078015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.322+0000 7f806effd700 1 -- 172.21.15.82:0/1275877224 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80880c6280 con 0x7f808813f8a0 2023-10-06T03:16:16.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.506+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f80880c6280 con 0x7f808813f8a0 2023-10-06T03:16:16.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.507+0000 7f806effd700 1 -- 172.21.15.82:0/1275877224 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f80880c6280 con 0x7f808813f8a0 2023-10-06T03:16:16.507 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:16.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8074066f60 msgr2=0x7f8074069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8074066f60 0x7f8074069410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8078001010 tx=0x7f8078015000 comp rx=0 tx=0).stop 2023-10-06T03:16:16.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808813f8a0 msgr2=0x7f80880c5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808813f8a0 0x7f80880c5310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f807c011990 tx=0x7f807c008040 comp rx=0 tx=0).stop 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 shutdown_connections 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80880c5850 0x7f808815f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8074066f60 0x7f8074069410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8070003a90 0x7f80880c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 --2- 172.21.15.82:0/1275877224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f808813f8a0 0x7f80880c5310 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 >> 172.21.15.82:0/1275877224 conn(0x7f80880ccfe0 msgr2=0x7f8088140970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 shutdown_connections 2023-10-06T03:16:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.509+0000 7f808c947700 1 -- 172.21.15.82:0/1275877224 wait complete. 2023-10-06T03:16:16.521 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:16.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.638+0000 7fbbafbe8700 1 Processor -- start 2023-10-06T03:16:16.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.638+0000 7fbbafbe8700 1 -- start start 2023-10-06T03:16:16.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbafbe8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbba8159500 0x7fbba81598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbafbe8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80b3fd0 0x7fbba815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbafbe8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba815dd20 con 0x7fbba815d8e0 2023-10-06T03:16:16.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbafbe8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba80b1110 con 0x7fbba8159500 2023-10-06T03:16:16.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbafbe8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80b13b0 con 0x7fbba80b3fd0 2023-10-06T03:16:16.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad984700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbba8159500 0x7fbba81598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad984700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbba8159500 0x7fbba81598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53940/0 (socket says 172.21.15.82:53940) 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad984700 1 -- 172.21.15.82:0/810076380 learned_addr learned my addr 172.21.15.82:0/810076380 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad183700 1 --2- 172.21.15.82:0/810076380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80b3fd0 0x7fbba815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad984700 1 -- 172.21.15.82:0/810076380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80b3fd0 msgr2=0x7fbba815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad984700 1 --2- 172.21.15.82:0/810076380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80b3fd0 0x7fbba815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad984700 1 -- 172.21.15.82:0/810076380 >> v1:172.21.15.134:6789/0 conn(0x7fbba815d8e0 legacy=0x7fbba80cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad984700 1 -- 172.21.15.82:0/810076380 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba80b1690 con 0x7fbba8159500 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad183700 1 --2- 172.21.15.82:0/810076380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80b3fd0 0x7fbba815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbad984700 1 --2- 172.21.15.82:0/810076380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba8159500 0x7fbba81598d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbba40099b0 tx=0x7fbba4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f83fda4c72c211 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.639+0000 7fbbac982700 1 -- 172.21.15.82:0/810076380 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400b820 con 0x7fbba8159500 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbac982700 1 -- 172.21.15.82:0/810076380 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba400b980 con 0x7fbba8159500 2023-10-06T03:16:16.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbac982700 1 -- 172.21.15.82:0/810076380 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400bd20 con 0x7fbba8159500 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbafbe8700 1 -- 172.21.15.82:0/810076380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba8159500 msgr2=0x7fbba81598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/810076380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba8159500 0x7fbba81598d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbba40099b0 tx=0x7fbba4009250 comp rx=0 tx=0).stop 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbafbe8700 1 -- 172.21.15.82:0/810076380 shutdown_connections 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/810076380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba8159500 0x7fbba81598d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/810076380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80b3fd0 0x7fbba815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbafbe8700 1 -- 172.21.15.82:0/810076380 >> 172.21.15.82:0/810076380 conn(0x7fbba8067630 msgr2=0x7fbba8069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbafbe8700 1 -- 172.21.15.82:0/810076380 shutdown_connections 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.640+0000 7fbbafbe8700 1 -- 172.21.15.82:0/810076380 wait complete. 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.641+0000 7fbbafbe8700 1 Processor -- start 2023-10-06T03:16:16.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.641+0000 7fbbafbe8700 1 -- start start 2023-10-06T03:16:16.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbafbe8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba80b3fd0 0x7fbba81506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbafbe8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba8159500 0x7fbba814d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbafbe8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba815d8e0 0x7fbba814e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbafbe8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80b5b40 con 0x7fbba80b3fd0 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbafbe8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba816b350 con 0x7fbba815d8e0 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbafbe8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba816a740 con 0x7fbba8159500 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba80b3fd0 0x7fbba81506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba80b3fd0 0x7fbba81506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53944/0 (socket says 172.21.15.82:53944) 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 -- 172.21.15.82:0/1291229361 learned_addr learned my addr 172.21.15.82:0/1291229361 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 -- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba8159500 msgr2=0x7fbba814d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba8159500 0x7fbba814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 -- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba815d8e0 msgr2=0x7fbba814e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba815d8e0 0x7fbba814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 -- 172.21.15.82:0/1291229361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba40094f0 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.642+0000 7fbbad984700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba80b3fd0 0x7fbba81506e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009290 tx=0x7fbba4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.643+0000 7fbb9dffb700 1 -- 172.21.15.82:0/1291229361 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4011d70 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.643+0000 7fbb9dffb700 1 -- 172.21.15.82:0/1291229361 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba4020070 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.643+0000 7fbb9dffb700 1 -- 172.21.15.82:0/1291229361 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba401b6a0 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.643+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba816aa20 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.643+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba816afe0 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.644+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba8064050 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.644+0000 7fbb9dffb700 1 -- 172.21.15.82:0/1291229361 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbba4022030 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.644+0000 7fbb9dffb700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbb8c066f30 0x7fbb8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.645+0000 7fbb9dffb700 1 -- 172.21.15.82:0/1291229361 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbba40865f0 con 0x7fbba80b3fd0 2023-10-06T03:16:16.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.645+0000 7fbbad183700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbb8c066f30 0x7fbb8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.645+0000 7fbbad183700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbb8c066f30 0x7fbb8c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbba815ccf0 tx=0x7fbb98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.649+0000 7fbb9dffb700 1 -- 172.21.15.82:0/1291229361 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbba4053700 con 0x7fbba80b3fd0 2023-10-06T03:16:16.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.831+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbba8152f10 con 0x7fbba80b3fd0 2023-10-06T03:16:16.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.831+0000 7fbb9dffb700 1 -- 172.21.15.82:0/1291229361 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbba4056d20 con 0x7fbba80b3fd0 2023-10-06T03:16:16.832 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:16.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbb8c066f30 msgr2=0x7fbb8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbb8c066f30 0x7fbb8c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbba815ccf0 tx=0x7fbb98008040 comp rx=0 tx=0).stop 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba80b3fd0 msgr2=0x7fbba81506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba80b3fd0 0x7fbba81506e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009290 tx=0x7fbba4016000 comp rx=0 tx=0).stop 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 shutdown_connections 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba815d8e0 0x7fbba814e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba80b3fd0 0x7fbba81506e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbb8c066f30 0x7fbb8c0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 --2- 172.21.15.82:0/1291229361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba8159500 0x7fbba814d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 >> 172.21.15.82:0/1291229361 conn(0x7fbba8067630 msgr2=0x7fbba80b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 shutdown_connections 2023-10-06T03:16:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.833+0000 7fbbafbe8700 1 -- 172.21.15.82:0/1291229361 wait complete. 2023-10-06T03:16:16.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:16:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.962+0000 7f72f5031700 1 Processor -- start 2023-10-06T03:16:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.962+0000 7f72f5031700 1 -- start start 2023-10-06T03:16:16.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72f5031700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72f0159500 0x7f72f01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72f5031700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72f015dab0 0x7f72f00cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72f5031700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f00b1110 con 0x7f72f00b3fd0 2023-10-06T03:16:16.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72f5031700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f00b13b0 con 0x7f72f0159500 2023-10-06T03:16:16.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72f5031700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f00b1690 con 0x7f72f015dab0 2023-10-06T03:16:16.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72eed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72f0159500 0x7f72f01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72e659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f72f00b3fd0 0x7f72f015d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59406/0 (socket says 172.21.15.82:59406) 2023-10-06T03:16:16.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72e659c700 1 -- 172.21.15.82:0/1119478789 learned_addr learned my addr 172.21.15.82:0/1119478789 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72ef59e700 1 --2- 172.21.15.82:0/1119478789 >> v2:172.21.15.134:3300/0 conn(0x7f72f015dab0 0x7f72f00cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72eed9d700 1 -- 172.21.15.82:0/1119478789 >> v2:172.21.15.134:3300/0 conn(0x7f72f015dab0 msgr2=0x7f72f00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72eed9d700 1 --2- 172.21.15.82:0/1119478789 >> v2:172.21.15.134:3300/0 conn(0x7f72f015dab0 0x7f72f00cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72eed9d700 1 -- 172.21.15.82:0/1119478789 >> v1:172.21.15.82:6789/0 conn(0x7f72f00b3fd0 legacy=0x7f72f015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72eed9d700 1 -- 172.21.15.82:0/1119478789 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f00b1970 con 0x7f72f0159500 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72ee59c700 1 -- 172.21.15.82:0/1119478789 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400636738 0 0) 0x7f72f00b1110 con 0x7f72f00b3fd0 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.963+0000 7f72ef59e700 1 --2- 172.21.15.82:0/1119478789 >> v2:172.21.15.134:3300/0 conn(0x7f72f015dab0 0x7f72f00cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72eed9d700 1 --2- 172.21.15.82:0/1119478789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f01598d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f72f006a270 tx=0x7f72e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eb67a42a1684dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72ee59c700 1 -- 172.21.15.82:0/1119478789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000b6b0 con 0x7f72f0159500 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72ee59c700 1 -- 172.21.15.82:0/1119478789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e000b810 con 0x7f72f0159500 2023-10-06T03:16:16.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72ee59c700 1 -- 172.21.15.82:0/1119478789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000bbb0 con 0x7f72f0159500 2023-10-06T03:16:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72f5031700 1 -- 172.21.15.82:0/1119478789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 msgr2=0x7f72f01598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72f5031700 1 --2- 172.21.15.82:0/1119478789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f01598d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f72f006a270 tx=0x7f72e00091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72f5031700 1 -- 172.21.15.82:0/1119478789 shutdown_connections 2023-10-06T03:16:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72f5031700 1 --2- 172.21.15.82:0/1119478789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f01598d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72f5031700 1 --2- 172.21.15.82:0/1119478789 >> v2:172.21.15.134:3300/0 conn(0x7f72f015dab0 0x7f72f00cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72f5031700 1 -- 172.21.15.82:0/1119478789 >> 172.21.15.82:0/1119478789 conn(0x7f72f0067630 msgr2=0x7f72f0069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72f5031700 1 -- 172.21.15.82:0/1119478789 shutdown_connections 2023-10-06T03:16:16.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.964+0000 7f72f5031700 1 -- 172.21.15.82:0/1119478789 wait complete. 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.965+0000 7f72f5031700 1 Processor -- start 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72f5031700 1 -- start start 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72f5031700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72f00b3fd0 0x7f72f0145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72f5031700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72f5031700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f015dab0 0x7f72f014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72f5031700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f016dd50 con 0x7f72f0159500 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72f5031700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f016ac40 con 0x7f72f015dab0 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72f5031700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f016d420 con 0x7f72f00b3fd0 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72e659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72e659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f014f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53958/0 (socket says 172.21.15.82:53958) 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.966+0000 7f72e659c700 1 -- 172.21.15.82:0/1115013643 learned_addr learned my addr 172.21.15.82:0/1115013643 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72eed9d700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72f00b3fd0 0x7f72f0145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72ef59e700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f015dab0 0x7f72f014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e659c700 1 -- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72f00b3fd0 msgr2=0x7f72f0145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e659c700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72f00b3fd0 0x7f72f0145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e659c700 1 -- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f015dab0 msgr2=0x7f72f014f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e659c700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f015dab0 0x7f72f014f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e659c700 1 -- 172.21.15.82:0/1115013643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0009420 con 0x7f72f0159500 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e659c700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f014f270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f72d800c7e0 tx=0x7f72d8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e77fe700 1 -- 172.21.15.82:0/1115013643 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8005b30 con 0x7f72f0159500 2023-10-06T03:16:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e77fe700 1 -- 172.21.15.82:0/1115013643 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8005c90 con 0x7f72f0159500 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f016d700 con 0x7f72f0159500 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72e77fe700 1 -- 172.21.15.82:0/1115013643 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8007300 con 0x7f72f0159500 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.967+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f0145740 con 0x7f72f0159500 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.968+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f016dec0 con 0x7f72f0159500 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.968+0000 7f72e77fe700 1 -- 172.21.15.82:0/1115013643 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72d801b400 con 0x7f72f0159500 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.969+0000 7f72e77fe700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f72d0066f30 0x7f72d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.969+0000 7f72e77fe700 1 -- 172.21.15.82:0/1115013643 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f72d80841a0 con 0x7f72f0159500 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.969+0000 7f72eed9d700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f72d0066f30 0x7f72d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.969+0000 7f72eed9d700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f72d0066f30 0x7f72d00693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f72e00093f0 tx=0x7f72e0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:16.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:16.973+0000 7f72e77fe700 1 -- 172.21.15.82:0/1115013643 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72d8051330 con 0x7f72f0159500 2023-10-06T03:16:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.155+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72f0064050 con 0x7f72f0159500 2023-10-06T03:16:17.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.156+0000 7f72e77fe700 1 -- 172.21.15.82:0/1115013643 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f72d8054950 con 0x7f72f0159500 2023-10-06T03:16:17.223 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:16:17.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f72d0066f30 msgr2=0x7f72d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f72d0066f30 0x7f72d00693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f72e00093f0 tx=0x7f72e0017000 comp rx=0 tx=0).stop 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 msgr2=0x7f72f014f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f014f270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f72d800c7e0 tx=0x7f72d8007df0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 shutdown_connections 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f015dab0 0x7f72f014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f72d0066f30 0x7f72d00693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72f00b3fd0 0x7f72f0145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 --2- 172.21.15.82:0/1115013643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f0159500 0x7f72f014f270 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 >> 172.21.15.82:0/1115013643 conn(0x7f72f0067630 msgr2=0x7f72f00b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 shutdown_connections 2023-10-06T03:16:17.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.158+0000 7f72f5031700 1 -- 172.21.15.82:0/1115013643 wait complete. 2023-10-06T03:16:17.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:16:17.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.343+0000 7f90a8936700 1 Processor -- start 2023-10-06T03:16:17.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.343+0000 7f90a8936700 1 -- start start 2023-10-06T03:16:17.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a8936700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90a415de80 0x7f90a40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a8936700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90a40b61d0 0x7f90a415d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a8936700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a4069380 con 0x7f90a4142e90 2023-10-06T03:16:17.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a8936700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a4069f20 con 0x7f90a415de80 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a8936700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a4068770 con 0x7f90a40b61d0 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90a415de80 0x7f90a40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90a415de80 0x7f90a40b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35682/0 (socket says 172.21.15.82:35682) 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a2ffd700 1 -- 172.21.15.82:0/3806831245 learned_addr learned my addr 172.21.15.82:0/3806831245 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a3fff700 1 --2- 172.21.15.82:0/3806831245 >> v2:172.21.15.134:3300/0 conn(0x7f90a40b61d0 0x7f90a415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a2ffd700 1 -- 172.21.15.82:0/3806831245 >> v2:172.21.15.134:3300/0 conn(0x7f90a40b61d0 msgr2=0x7f90a415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a2ffd700 1 --2- 172.21.15.82:0/3806831245 >> v2:172.21.15.134:3300/0 conn(0x7f90a40b61d0 0x7f90a415d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a2ffd700 1 -- 172.21.15.82:0/3806831245 >> v1:172.21.15.134:6789/0 conn(0x7f90a4142e90 legacy=0x7f90a4069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a2ffd700 1 -- 172.21.15.82:0/3806831245 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a4068a50 con 0x7f90a415de80 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.344+0000 7f90a2ffd700 1 --2- 172.21.15.82:0/3806831245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a415de80 0x7f90a40b5c90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90a40d0540 tx=0x7f9094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97a293b006bd716 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:17.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a27fc700 1 -- 172.21.15.82:0/3806831245 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400b860 con 0x7f90a415de80 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a27fc700 1 -- 172.21.15.82:0/3806831245 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400b9c0 con 0x7f90a415de80 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a27fc700 1 -- 172.21.15.82:0/3806831245 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400bd60 con 0x7f90a415de80 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a8936700 1 -- 172.21.15.82:0/3806831245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a415de80 msgr2=0x7f90a40b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a8936700 1 --2- 172.21.15.82:0/3806831245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a415de80 0x7f90a40b5c90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90a40d0540 tx=0x7f9094009250 comp rx=0 tx=0).stop 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a8936700 1 -- 172.21.15.82:0/3806831245 shutdown_connections 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a8936700 1 --2- 172.21.15.82:0/3806831245 >> v2:172.21.15.134:3300/0 conn(0x7f90a40b61d0 0x7f90a415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a8936700 1 --2- 172.21.15.82:0/3806831245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a415de80 0x7f90a40b5c90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a8936700 1 -- 172.21.15.82:0/3806831245 >> 172.21.15.82:0/3806831245 conn(0x7f90a40ccfe0 msgr2=0x7f90a40cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a8936700 1 -- 172.21.15.82:0/3806831245 shutdown_connections 2023-10-06T03:16:17.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.345+0000 7f90a8936700 1 -- 172.21.15.82:0/3806831245 wait complete. 2023-10-06T03:16:17.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.346+0000 7f90a8936700 1 Processor -- start 2023-10-06T03:16:17.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.346+0000 7f90a8936700 1 -- start start 2023-10-06T03:16:17.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a8936700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a40b61d0 0x7f90a413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a8936700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90a4142e90 0x7f90a40c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a8936700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90a415de80 0x7f90a413f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a8936700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40c8370 con 0x7f90a40b61d0 2023-10-06T03:16:17.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a8936700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40c5310 con 0x7f90a4142e90 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a8936700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40c55f0 con 0x7f90a415de80 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a40b61d0 0x7f90a413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a40b61d0 0x7f90a413ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35698/0 (socket says 172.21.15.82:35698) 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a37fe700 1 -- 172.21.15.82:0/185251914 learned_addr learned my addr 172.21.15.82:0/185251914 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a2ffd700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90a4142e90 0x7f90a40c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.347+0000 7f90a3fff700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90a415de80 0x7f90a413f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f90a37fe700 1 -- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90a415de80 msgr2=0x7f90a413f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f90a37fe700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90a415de80 0x7f90a413f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f90a37fe700 1 -- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90a4142e90 msgr2=0x7f90a40c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f90a37fe700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90a4142e90 0x7f90a40c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f90a37fe700 1 -- 172.21.15.82:0/185251914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90940094f0 con 0x7f90a40b61d0 2023-10-06T03:16:17.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f90a37fe700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a40b61d0 0x7f90a413ef80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f909800c590 tx=0x7f909800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:17.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f908b7fe700 1 -- 172.21.15.82:0/185251914 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098011590 con 0x7f90a40b61d0 2023-10-06T03:16:17.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f908b7fe700 1 -- 172.21.15.82:0/185251914 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90980116f0 con 0x7f90a40b61d0 2023-10-06T03:16:17.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f908b7fe700 1 -- 172.21.15.82:0/185251914 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098011ab0 con 0x7f90a40b61d0 2023-10-06T03:16:17.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a40c58d0 con 0x7f90a40b61d0 2023-10-06T03:16:17.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.348+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a40b0590 con 0x7f90a40b61d0 2023-10-06T03:16:17.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.349+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a404c3c0 con 0x7f90a40b61d0 2023-10-06T03:16:17.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.349+0000 7f908b7fe700 1 -- 172.21.15.82:0/185251914 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f909801b3b0 con 0x7f90a40b61d0 2023-10-06T03:16:17.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.349+0000 7f908b7fe700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9090066f30 0x7f90900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.350+0000 7f908b7fe700 1 -- 172.21.15.82:0/185251914 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9098083c40 con 0x7f90a40b61d0 2023-10-06T03:16:17.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.350+0000 7f90a2ffd700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9090066f30 0x7f90900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.350+0000 7f90a2ffd700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9090066f30 0x7f90900693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90a40d0540 tx=0x7f9094017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:17.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.354+0000 7f908b7fe700 1 -- 172.21.15.82:0/185251914 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9098050d50 con 0x7f90a40b61d0 2023-10-06T03:16:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.536+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90a40c84b0 con 0x7f90a40b61d0 2023-10-06T03:16:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.537+0000 7f908b7fe700 1 -- 172.21.15.82:0/185251914 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9098017020 con 0x7f90a40b61d0 2023-10-06T03:16:17.538 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:16:17.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9090066f30 msgr2=0x7f90900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9090066f30 0x7f90900693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90a40d0540 tx=0x7f9094017000 comp rx=0 tx=0).stop 2023-10-06T03:16:17.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a40b61d0 msgr2=0x7f90a413ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a40b61d0 0x7f90a413ef80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f909800c590 tx=0x7f909800c950 comp rx=0 tx=0).stop 2023-10-06T03:16:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 shutdown_connections 2023-10-06T03:16:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9090066f30 0x7f90900693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90a415de80 0x7f90a413f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90a40b61d0 0x7f90a413ef80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 --2- 172.21.15.82:0/185251914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90a4142e90 0x7f90a40c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 >> 172.21.15.82:0/185251914 conn(0x7f90a40ccfe0 msgr2=0x7f90a40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 shutdown_connections 2023-10-06T03:16:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.539+0000 7f90a8936700 1 -- 172.21.15.82:0/185251914 wait complete. 2023-10-06T03:16:17.552 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:17.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.666+0000 7f990e560700 1 Processor -- start 2023-10-06T03:16:17.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.666+0000 7f990e560700 1 -- start start 2023-10-06T03:16:17.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.667+0000 7f990e560700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99080c6dc0 0x7f99080ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.667+0000 7f990e560700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99080ae140 con 0x7f99080cbe50 2023-10-06T03:16:17.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.667+0000 7f990e560700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99080cc2a0 con 0x7f99080cdc00 2023-10-06T03:16:17.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.667+0000 7f990e560700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99080ad530 con 0x7f99080c6dc0 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.667+0000 7f99077fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f99080cbe50 0x7f99080c66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38288/0 (socket says 172.21.15.82:38288) 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.667+0000 7f99077fe700 1 -- 172.21.15.82:0/2475296007 learned_addr learned my addr 172.21.15.82:0/2475296007 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481879907 0 0) 0x7f99080ae140 con 0x7f99080cbe50 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98f0003570 con 0x7f99080cbe50 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f990cafd700 1 --2- 172.21.15.82:0/2475296007 >> v2:172.21.15.134:3300/0 conn(0x7f99080c6dc0 0x7f99080ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 421085056 0 0) 0x7f98f0003570 con 0x7f99080cbe50 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 >> v2:172.21.15.134:3300/0 conn(0x7f99080c6dc0 msgr2=0x7f99080ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 --2- 172.21.15.82:0/2475296007 >> v2:172.21.15.134:3300/0 conn(0x7f99080c6dc0 0x7f99080ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 >> v1:172.21.15.134:6789/0 conn(0x7f99080cdc00 legacy=0x7f99080d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99080ad810 con 0x7f99080cbe50 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f98fc001470 con 0x7f99080cbe50 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 >> v1:172.21.15.82:6789/0 conn(0x7f99080cbe50 legacy=0x7f99080c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98f0003a60 0x7f98f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f0004810 0x7f98f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f98f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99080ad530 con 0x7f98f00051c0 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f000c160 con 0x7f98f0004810 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f000c320 con 0x7f98f0003a60 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f990cafd700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f98f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f99077fe700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f0004810 0x7f98f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f9907fff700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98f0003a60 0x7f98f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f990cafd700 1 -- 172.21.15.82:0/2475296007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98f0003a60 msgr2=0x7f98f0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f990cafd700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98f0003a60 0x7f98f0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f990cafd700 1 -- 172.21.15.82:0/2475296007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f0004810 msgr2=0x7f98f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f990cafd700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98f0004810 0x7f98f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f990cafd700 1 -- 172.21.15.82:0/2475296007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0003570 con 0x7f98f00051c0 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.668+0000 7f990cafd700 1 -- 172.21.15.82:0/2475296007 reap_dead start 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f990cafd700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f98f000ba60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f990000e210 tx=0x7f990000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d50c64eaed5dab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990000eac0 con 0x7f98f00051c0 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990000f040 con 0x7f98f00051c0 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f9906ffd700 1 -- 172.21.15.82:0/2475296007 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990000ee70 con 0x7f98f00051c0 2023-10-06T03:16:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f990e560700 1 -- 172.21.15.82:0/2475296007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 msgr2=0x7f98f000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f990e560700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f98f000ba60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f990000e210 tx=0x7f990000b040 comp rx=0 tx=0).stop 2023-10-06T03:16:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f990e560700 1 -- 172.21.15.82:0/2475296007 shutdown_connections 2023-10-06T03:16:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f990e560700 1 --2- 172.21.15.82:0/2475296007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f98f000ba60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f990e560700 1 -- 172.21.15.82:0/2475296007 >> 172.21.15.82:0/2475296007 conn(0x7f9908099990 msgr2=0x7f99080b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f990e560700 1 -- 172.21.15.82:0/2475296007 shutdown_connections 2023-10-06T03:16:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.669+0000 7f990e560700 1 -- 172.21.15.82:0/2475296007 wait complete. 2023-10-06T03:16:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.670+0000 7f990e560700 1 Processor -- start 2023-10-06T03:16:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.670+0000 7f990e560700 1 -- start start 2023-10-06T03:16:17.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f990e560700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f990814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f990e560700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99081489b0 0x7f990809c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f990e560700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f990809cbc0 0x7f9908068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f990e560700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99080ae5e0 con 0x7f98f00051c0 2023-10-06T03:16:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f990e560700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990809ac60 con 0x7f990809cbc0 2023-10-06T03:16:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f990e560700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990809d010 con 0x7f99081489b0 2023-10-06T03:16:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f9907fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f990814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f9907fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f990814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35712/0 (socket says 172.21.15.82:35712) 2023-10-06T03:16:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f9907fff700 1 -- 172.21.15.82:0/3357020300 learned_addr learned my addr 172.21.15.82:0/3357020300 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f9907fff700 1 -- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99081489b0 msgr2=0x7f990809c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f9907fff700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99081489b0 0x7f990809c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f9907fff700 1 -- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f990809cbc0 msgr2=0x7f9908068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f9907fff700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f990809cbc0 0x7f9908068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.671+0000 7f9907fff700 1 -- 172.21.15.82:0/3357020300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990809a3a0 con 0x7f98f00051c0 2023-10-06T03:16:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.672+0000 7f9907fff700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f990814b330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f98f8002970 tx=0x7f98f8007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.672+0000 7f98effff700 1 -- 172.21.15.82:0/3357020300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f800f960 con 0x7f98f00051c0 2023-10-06T03:16:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.672+0000 7f98effff700 1 -- 172.21.15.82:0/3357020300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f800fac0 con 0x7f98f00051c0 2023-10-06T03:16:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.672+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990809a610 con 0x7f98f00051c0 2023-10-06T03:16:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.672+0000 7f98effff700 1 -- 172.21.15.82:0/3357020300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f800fe40 con 0x7f98f00051c0 2023-10-06T03:16:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.672+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990814b870 con 0x7f98f00051c0 2023-10-06T03:16:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.673+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9908064050 con 0x7f98f00051c0 2023-10-06T03:16:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.673+0000 7f98effff700 1 -- 172.21.15.82:0/3357020300 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98f8013600 con 0x7f98f00051c0 2023-10-06T03:16:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.673+0000 7f98effff700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f98f4066f30 0x7f98f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.674+0000 7f98effff700 1 -- 172.21.15.82:0/3357020300 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98f8084ba0 con 0x7f98f00051c0 2023-10-06T03:16:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.674+0000 7f99077fe700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f98f4066f30 0x7f98f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.674+0000 7f99077fe700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f98f4066f30 0x7f98f40693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f98fc000e10 tx=0x7f98fc001e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.678+0000 7f98effff700 1 -- 172.21.15.82:0/3357020300 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98f8051cb0 con 0x7f98f00051c0 2023-10-06T03:16:17.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.860+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9908159880 con 0x7f98f00051c0 2023-10-06T03:16:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.861+0000 7f98effff700 1 -- 172.21.15.82:0/3357020300 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f98f80552d0 con 0x7f98f00051c0 2023-10-06T03:16:17.862 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:17.862 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:17.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f98f4066f30 msgr2=0x7f98f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f98f4066f30 0x7f98f40693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f98fc000e10 tx=0x7f98fc001e50 comp rx=0 tx=0).stop 2023-10-06T03:16:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 msgr2=0x7f990814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f990814b330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f98f8002970 tx=0x7f98f8007d80 comp rx=0 tx=0).stop 2023-10-06T03:16:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 shutdown_connections 2023-10-06T03:16:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f990809cbc0 0x7f9908068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f00051c0 0x7f990814b330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f98f4066f30 0x7f98f40693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 --2- 172.21.15.82:0/3357020300 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99081489b0 0x7f990809c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 >> 172.21.15.82:0/3357020300 conn(0x7f9908099990 msgr2=0x7f99080d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 shutdown_connections 2023-10-06T03:16:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.863+0000 7f990e560700 1 -- 172.21.15.82:0/3357020300 wait complete. 2023-10-06T03:16:17.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:15:49.404080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:15:50.736320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:16:17.877 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:17.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.993+0000 7f75c1541700 1 Processor -- start 2023-10-06T03:16:17.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.993+0000 7f75c1541700 1 -- start start 2023-10-06T03:16:17.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75c1541700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f75bc1598d0 0x7f75bc15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75c1541700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc15d8e0 0x7f75bc0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75c1541700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc15dd20 con 0x7f75bc159500 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75c1541700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0b1110 con 0x7f75bc1598d0 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75c1541700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0b13b0 con 0x7f75bc15d8e0 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75baffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f75bc159500 0x7f75bc0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38304/0 (socket says 172.21.15.82:38304) 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75baffd700 1 -- 172.21.15.82:0/1573104741 learned_addr learned my addr 172.21.15.82:0/1573104741 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174006992 0 0) 0x7f75bc15dd20 con 0x7f75bc159500 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75bb7fe700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc15d8e0 0x7f75bc0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75ba7fc700 1 --2- 172.21.15.82:0/1573104741 >> v2:172.21.15.134:3300/0 conn(0x7f75bc1598d0 0x7f75bc15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a4003570 con 0x7f75bc159500 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1062045440 0 0) 0x7f75a4003570 con 0x7f75bc159500 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc15d8e0 msgr2=0x7f75bc0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc15d8e0 0x7f75bc0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 >> v2:172.21.15.134:3300/0 conn(0x7f75bc1598d0 msgr2=0x7f75bc15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 --2- 172.21.15.82:0/1573104741 >> v2:172.21.15.134:3300/0 conn(0x7f75bc1598d0 0x7f75bc15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0b1690 con 0x7f75bc159500 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f75ac001470 con 0x7f75bc159500 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 >> v1:172.21.15.82:6789/0 conn(0x7f75bc159500 legacy=0x7f75bc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc15d8e0 0x7f75a4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a4003fe0 0x7f75a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a4004d50 0x7f75a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0b1110 con 0x7f75a4004d50 2023-10-06T03:16:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0b13b0 con 0x7f75a4003fe0 2023-10-06T03:16:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.994+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400ba90 con 0x7f75bc15d8e0 2023-10-06T03:16:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75bb7fe700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a4004d50 0x7f75a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75baffd700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc15d8e0 0x7f75a4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75ba7fc700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a4003fe0 0x7f75a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75bb7fe700 1 -- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc15d8e0 msgr2=0x7f75a4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75bb7fe700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc15d8e0 0x7f75a4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75bb7fe700 1 -- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a4003fe0 msgr2=0x7f75a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75bb7fe700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75a4003fe0 0x7f75a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75bb7fe700 1 -- 172.21.15.82:0/1573104741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4003570 con 0x7f75a4004d50 2023-10-06T03:16:18.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75bb7fe700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a4004d50 0x7f75a40051c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f75b400e210 tx=0x7f75b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3ead62a6db4b76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400ea60 con 0x7f75a4004d50 2023-10-06T03:16:18.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b400f040 con 0x7f75a4004d50 2023-10-06T03:16:18.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.995+0000 7f75b9ffb700 1 -- 172.21.15.82:0/1573104741 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400ee10 con 0x7f75a4004d50 2023-10-06T03:16:18.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.996+0000 7f75c1541700 1 -- 172.21.15.82:0/1573104741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a4004d50 msgr2=0x7f75a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.996+0000 7f75c1541700 1 --2- 172.21.15.82:0/1573104741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a4004d50 0x7f75a40051c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f75b400e210 tx=0x7f75b400b040 comp rx=0 tx=0).stop 2023-10-06T03:16:18.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.996+0000 7f75bb7fe700 1 -- 172.21.15.82:0/1573104741 reap_dead start 2023-10-06T03:16:18.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.996+0000 7f75c1541700 1 -- 172.21.15.82:0/1573104741 shutdown_connections 2023-10-06T03:16:18.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.996+0000 7f75c1541700 1 -- 172.21.15.82:0/1573104741 >> 172.21.15.82:0/1573104741 conn(0x7f75bc067630 msgr2=0x7f75bc069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:18.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.996+0000 7f75c1541700 1 -- 172.21.15.82:0/1573104741 shutdown_connections 2023-10-06T03:16:18.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.996+0000 7f75c1541700 1 -- 172.21.15.82:0/1573104741 wait complete. 2023-10-06T03:16:18.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.997+0000 7f75c1541700 1 Processor -- start 2023-10-06T03:16:18.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.997+0000 7f75c1541700 1 -- start start 2023-10-06T03:16:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75c1541700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc151220 0x7f75bc1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75c1541700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc169e50 0x7f75bc150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75c1541700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc152dc0 0x7f75bc067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75c1541700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc16a2c0 con 0x7f75bc152dc0 2023-10-06T03:16:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75c1541700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc159e60 con 0x7f75bc169e50 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75c1541700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc16a4c0 con 0x7f75bc151220 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc152dc0 0x7f75bc067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc152dc0 0x7f75bc067b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35722/0 (socket says 172.21.15.82:35722) 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 -- 172.21.15.82:0/2916670969 learned_addr learned my addr 172.21.15.82:0/2916670969 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75ba7fc700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc169e50 0x7f75bc150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75baffd700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc151220 0x7f75bc1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 -- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc151220 msgr2=0x7f75bc1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc151220 0x7f75bc1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 -- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc169e50 msgr2=0x7f75bc150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc169e50 0x7f75bc150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 -- 172.21.15.82:0/2916670969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc16a7a0 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75bb7fe700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc152dc0 0x7f75bc067b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75b4016000 tx=0x7f75b401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75a2ffd700 1 -- 172.21.15.82:0/2916670969 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400eee0 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75a2ffd700 1 -- 172.21.15.82:0/2916670969 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b4022070 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc16aa80 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75a2ffd700 1 -- 172.21.15.82:0/2916670969 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b401e890 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.998+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc1508c0 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:17.999+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc0b0e30 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.000+0000 7f75a2ffd700 1 -- 172.21.15.82:0/2916670969 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75b4003040 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.000+0000 7f75a2ffd700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f75a8066f30 0x7f75a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.000+0000 7f75a2ffd700 1 -- 172.21.15.82:0/2916670969 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f75b4024070 con 0x7f75bc152dc0 2023-10-06T03:16:18.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.000+0000 7f75baffd700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f75a8066f30 0x7f75a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.001+0000 7f75baffd700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f75a8066f30 0x7f75a80693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0079e0 tx=0x7f75ac001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.004+0000 7f75a2ffd700 1 -- 172.21.15.82:0/2916670969 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75b4053340 con 0x7f75bc152dc0 2023-10-06T03:16:18.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.184+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75bc064050 con 0x7f75bc152dc0 2023-10-06T03:16:18.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.184+0000 7f75a2ffd700 1 -- 172.21.15.82:0/2916670969 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f75b4056960 con 0x7f75bc152dc0 2023-10-06T03:16:18.185 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f75a8066f30 msgr2=0x7f75a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f75a8066f30 0x7f75a80693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0079e0 tx=0x7f75ac001e90 comp rx=0 tx=0).stop 2023-10-06T03:16:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc152dc0 msgr2=0x7f75bc067b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc152dc0 0x7f75bc067b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75b4016000 tx=0x7f75b401a000 comp rx=0 tx=0).stop 2023-10-06T03:16:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 shutdown_connections 2023-10-06T03:16:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc152dc0 0x7f75bc067b50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f75a8066f30 0x7f75a80693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75bc151220 0x7f75bc1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 --2- 172.21.15.82:0/2916670969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc169e50 0x7f75bc150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 >> 172.21.15.82:0/2916670969 conn(0x7f75bc067630 msgr2=0x7f75bc0b5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 shutdown_connections 2023-10-06T03:16:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.186+0000 7f75c1541700 1 -- 172.21.15.82:0/2916670969 wait complete. 2023-10-06T03:16:18.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.316+0000 7f0fd6417700 1 Processor -- start 2023-10-06T03:16:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.316+0000 7f0fd6417700 1 -- start start 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.316+0000 7f0fd6417700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0fd0157b50 0x7f0fd00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.316+0000 7f0fd6417700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 0x7f0fd0157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.316+0000 7f0fd6417700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0fd0158460 0x7f0fd0159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.316+0000 7f0fd6417700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd0159a60 con 0x7f0fd0158460 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.316+0000 7f0fd6417700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd0158e50 con 0x7f0fd0157b50 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.316+0000 7f0fd6417700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0159130 con 0x7f0fd00cdb30 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0fd0158460 0x7f0fd0159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0fd0158460 0x7f0fd0159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35728/0 (socket says 172.21.15.82:35728) 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 -- 172.21.15.82:0/2837246038 learned_addr learned my addr 172.21.15.82:0/2837246038 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fcffff700 1 --2- 172.21.15.82:0/2837246038 >> v2:172.21.15.134:3300/0 conn(0x7f0fd0157b50 0x7f0fd00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fcf7fe700 1 --2- 172.21.15.82:0/2837246038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 0x7f0fd0157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 -- 172.21.15.82:0/2837246038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 msgr2=0x7f0fd0157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 --2- 172.21.15.82:0/2837246038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 0x7f0fd0157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 -- 172.21.15.82:0/2837246038 >> v2:172.21.15.134:3300/0 conn(0x7f0fd0157b50 msgr2=0x7f0fd00cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 --2- 172.21.15.82:0/2837246038 >> v2:172.21.15.134:3300/0 conn(0x7f0fd0157b50 0x7f0fd00cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 -- 172.21.15.82:0/2837246038 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd0159410 con 0x7f0fd0158460 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fd49b4700 1 --2- 172.21.15.82:0/2837246038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd0159ef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0fd006f220 tx=0x7f0fc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421518a0e5b48a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fceffd700 1 -- 172.21.15.82:0/2837246038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800e070 con 0x7f0fd0158460 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fceffd700 1 -- 172.21.15.82:0/2837246038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800b970 con 0x7f0fd0158460 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.317+0000 7f0fceffd700 1 -- 172.21.15.82:0/2837246038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80092e0 con 0x7f0fd0158460 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 -- 172.21.15.82:0/2837246038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 msgr2=0x7f0fd0159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 --2- 172.21.15.82:0/2837246038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd0159ef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0fd006f220 tx=0x7f0fc8009840 comp rx=0 tx=0).stop 2023-10-06T03:16:18.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 -- 172.21.15.82:0/2837246038 shutdown_connections 2023-10-06T03:16:18.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 --2- 172.21.15.82:0/2837246038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd0159ef0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 --2- 172.21.15.82:0/2837246038 >> v2:172.21.15.134:3300/0 conn(0x7f0fd0157b50 0x7f0fd00cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 --2- 172.21.15.82:0/2837246038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 0x7f0fd0157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 -- 172.21.15.82:0/2837246038 >> 172.21.15.82:0/2837246038 conn(0x7f0fd006d890 msgr2=0x7f0fd006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:18.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 -- 172.21.15.82:0/2837246038 shutdown_connections 2023-10-06T03:16:18.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.318+0000 7f0fd6417700 1 -- 172.21.15.82:0/2837246038 wait complete. 2023-10-06T03:16:18.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.319+0000 7f0fd6417700 1 Processor -- start 2023-10-06T03:16:18.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.319+0000 7f0fd6417700 1 -- start start 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd6417700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 0x7f0fd0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd6417700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd0157b50 0x7f0fd0154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd6417700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd01548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd6417700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0149820 con 0x7f0fd0158460 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd6417700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0157960 con 0x7f0fd0157b50 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd6417700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0156d50 con 0x7f0fd00cdb30 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd01548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd01548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35730/0 (socket says 172.21.15.82:35730) 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 -- 172.21.15.82:0/3055344224 learned_addr learned my addr 172.21.15.82:0/3055344224 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fcffff700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 0x7f0fd0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fcf7fe700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd0157b50 0x7f0fd0154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 -- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 msgr2=0x7f0fd0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 0x7f0fd0156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 -- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd0157b50 msgr2=0x7f0fd0154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd0157b50 0x7f0fd0154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 -- 172.21.15.82:0/3055344224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8009ae0 con 0x7f0fd0158460 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd49b4700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd01548a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00afb20 tx=0x7f0fc8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fb7fff700 1 -- 172.21.15.82:0/3055344224 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8008ad0 con 0x7f0fd0158460 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fb7fff700 1 -- 172.21.15.82:0/3055344224 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc8008c50 con 0x7f0fd0158460 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd0157030 con 0x7f0fd0158460 2023-10-06T03:16:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.320+0000 7f0fb7fff700 1 -- 172.21.15.82:0/3055344224 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8026460 con 0x7f0fd0158460 2023-10-06T03:16:18.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.321+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd01575f0 con 0x7f0fd0158460 2023-10-06T03:16:18.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.321+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd0064050 con 0x7f0fd0158460 2023-10-06T03:16:18.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.322+0000 7f0fb7fff700 1 -- 172.21.15.82:0/3055344224 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fc8003040 con 0x7f0fd0158460 2023-10-06T03:16:18.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.322+0000 7f0fb7fff700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0fbc066f30 0x7f0fbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.322+0000 7f0fb7fff700 1 -- 172.21.15.82:0/3055344224 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0fc8085f20 con 0x7f0fd0158460 2023-10-06T03:16:18.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.322+0000 7f0fcffff700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0fbc066f30 0x7f0fbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.323+0000 7f0fcffff700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0fbc066f30 0x7f0fbc0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009db0 tx=0x7f0fc00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.327+0000 7f0fb7fff700 1 -- 172.21.15.82:0/3055344224 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fc80530e0 con 0x7f0fd0158460 2023-10-06T03:16:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.510+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fd0063ae0 con 0x7f0fd0158460 2023-10-06T03:16:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.510+0000 7f0fb7fff700 1 -- 172.21.15.82:0/3055344224 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fc8056700 con 0x7f0fd0158460 2023-10-06T03:16:18.511 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0fbc066f30 msgr2=0x7f0fbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0fbc066f30 0x7f0fbc0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009db0 tx=0x7f0fc00091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 msgr2=0x7f0fd01548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd01548a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00afb20 tx=0x7f0fc8018000 comp rx=0 tx=0).stop 2023-10-06T03:16:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 shutdown_connections 2023-10-06T03:16:18.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0158460 0x7f0fd01548a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0fbc066f30 0x7f0fbc0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd00cdb30 0x7f0fd0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 --2- 172.21.15.82:0/3055344224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd0157b50 0x7f0fd0154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 >> 172.21.15.82:0/3055344224 conn(0x7f0fd006d890 msgr2=0x7f0fd00b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:18.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 shutdown_connections 2023-10-06T03:16:18.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.512+0000 7f0fd6417700 1 -- 172.21.15.82:0/3055344224 wait complete. 2023-10-06T03:16:18.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:16:18.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.641+0000 7fde043f1700 1 Processor -- start 2023-10-06T03:16:18.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.641+0000 7fde043f1700 1 -- start start 2023-10-06T03:16:18.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde043f1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fddfc159500 0x7fddfc1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde043f1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde043f1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc15dd20 con 0x7fddfc15d8e0 2023-10-06T03:16:18.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde043f1700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc0b1110 con 0x7fddfc159500 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde043f1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc0b13b0 con 0x7fddfc0b3fd0 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde0218d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fddfc159500 0x7fddfc1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde0218d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fddfc159500 0x7fddfc1598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35732/0 (socket says 172.21.15.82:35732) 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde0218d700 1 -- 172.21.15.82:0/4068347124 learned_addr learned my addr 172.21.15.82:0/4068347124 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde0198c700 1 --2- 172.21.15.82:0/4068347124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde0218d700 1 -- 172.21.15.82:0/4068347124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 msgr2=0x7fddfc15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.642+0000 7fde0218d700 1 --2- 172.21.15.82:0/4068347124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde0218d700 1 -- 172.21.15.82:0/4068347124 >> v1:172.21.15.134:6789/0 conn(0x7fddfc15d8e0 legacy=0x7fddfc0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde0218d700 1 -- 172.21.15.82:0/4068347124 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc0b1690 con 0x7fddfc159500 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde0198c700 1 --2- 172.21.15.82:0/4068347124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:18.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde0218d700 1 --2- 172.21.15.82:0/4068347124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc1598d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009f20 tx=0x7fddf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a45d7bf7599111c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde0118b700 1 -- 172.21.15.82:0/4068347124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800e070 con 0x7fddfc159500 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde0118b700 1 -- 172.21.15.82:0/4068347124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800ba40 con 0x7fddfc159500 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde0118b700 1 -- 172.21.15.82:0/4068347124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80092e0 con 0x7fddfc159500 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde043f1700 1 -- 172.21.15.82:0/4068347124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 msgr2=0x7fddfc1598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde043f1700 1 --2- 172.21.15.82:0/4068347124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc1598d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009f20 tx=0x7fddf8009840 comp rx=0 tx=0).stop 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde043f1700 1 -- 172.21.15.82:0/4068347124 shutdown_connections 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde043f1700 1 --2- 172.21.15.82:0/4068347124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc1598d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde043f1700 1 --2- 172.21.15.82:0/4068347124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde043f1700 1 -- 172.21.15.82:0/4068347124 >> 172.21.15.82:0/4068347124 conn(0x7fddfc067630 msgr2=0x7fddfc069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:18.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde043f1700 1 -- 172.21.15.82:0/4068347124 shutdown_connections 2023-10-06T03:16:18.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.643+0000 7fde043f1700 1 -- 172.21.15.82:0/4068347124 wait complete. 2023-10-06T03:16:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.644+0000 7fde043f1700 1 Processor -- start 2023-10-06T03:16:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde043f1700 1 -- start start 2023-10-06T03:16:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde043f1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc16da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde043f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde043f1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddfc15d8e0 0x7fddfc068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde043f1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc15b2b0 con 0x7fddfc159500 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde043f1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc16e240 con 0x7fddfc15d8e0 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde043f1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc16e520 con 0x7fddfc0b3fd0 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde0198c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde0198c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35746/0 (socket says 172.21.15.82:35746) 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde0198c700 1 -- 172.21.15.82:0/829818218 learned_addr learned my addr 172.21.15.82:0/829818218 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde0298e700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddfc15d8e0 0x7fddfc068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.645+0000 7fde0218d700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc16da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fde0198c700 1 -- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 msgr2=0x7fddfc16da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fde0198c700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc16da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fde0198c700 1 -- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddfc15d8e0 msgr2=0x7fddfc068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fde0198c700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddfc15d8e0 0x7fddfc068c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fde0198c700 1 -- 172.21.15.82:0/829818218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8009ae0 con 0x7fddfc159500 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fde0198c700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc169b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c830 tx=0x7fddec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fddf27fc700 1 -- 172.21.15.82:0/829818218 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec011600 con 0x7fddfc159500 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fddf27fc700 1 -- 172.21.15.82:0/829818218 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec011760 con 0x7fddfc159500 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc16e800 con 0x7fddfc159500 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fddf27fc700 1 -- 172.21.15.82:0/829818218 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec011b20 con 0x7fddfc159500 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.646+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc152fc0 con 0x7fddfc159500 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.647+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc15b740 con 0x7fddfc159500 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.647+0000 7fddf27fc700 1 -- 172.21.15.82:0/829818218 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddec018360 con 0x7fddfc159500 2023-10-06T03:16:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.648+0000 7fddf27fc700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdde0066f30 0x7fdde00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.648+0000 7fddf27fc700 1 -- 172.21.15.82:0/829818218 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fddec0845d0 con 0x7fddfc159500 2023-10-06T03:16:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.648+0000 7fde0218d700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdde0066f30 0x7fdde00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.649+0000 7fde0218d700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdde0066f30 0x7fdde00693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009880 tx=0x7fddf8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.652+0000 7fddf27fc700 1 -- 172.21.15.82:0/829818218 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddfc15b740 con 0x7fddfc159500 2023-10-06T03:16:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.835+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fddfc15b740 con 0x7fddfc159500 2023-10-06T03:16:18.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.836+0000 7fddf27fc700 1 -- 172.21.15.82:0/829818218 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fddfc15b740 con 0x7fddfc159500 2023-10-06T03:16:18.837 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:16:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdde0066f30 msgr2=0x7fdde00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdde0066f30 0x7fdde00693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009880 tx=0x7fddf8017000 comp rx=0 tx=0).stop 2023-10-06T03:16:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 msgr2=0x7fddfc169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc169b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c830 tx=0x7fddec008040 comp rx=0 tx=0).stop 2023-10-06T03:16:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 shutdown_connections 2023-10-06T03:16:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddfc15d8e0 0x7fddfc068c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdde0066f30 0x7fdde00693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddfc0b3fd0 0x7fddfc16da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 --2- 172.21.15.82:0/829818218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddfc159500 0x7fddfc169b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 >> 172.21.15.82:0/829818218 conn(0x7fddfc067630 msgr2=0x7fddfc14dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 shutdown_connections 2023-10-06T03:16:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.838+0000 7fde043f1700 1 -- 172.21.15.82:0/829818218 wait complete. 2023-10-06T03:16:18.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:16:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.967+0000 7fbae68c8700 1 Processor -- start 2023-10-06T03:16:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.968+0000 7fbae68c8700 1 -- start start 2023-10-06T03:16:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.968+0000 7fbae68c8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae0143290 0x7fbae0159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.968+0000 7fbae68c8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae0067e20 con 0x7fbae0142ec0 2023-10-06T03:16:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.968+0000 7fbae68c8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae015ab10 con 0x7fbae00cf750 2023-10-06T03:16:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.968+0000 7fbae68c8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00677d0 con 0x7fbae0143290 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae58c6700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbae0142ec0 0x7fbae00cf040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38306/0 (socket says 172.21.15.82:38306) 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae58c6700 1 -- 172.21.15.82:0/2995755274 learned_addr learned my addr 172.21.15.82:0/2995755274 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280155931 0 0) 0x7fbae0067e20 con 0x7fbae0142ec0 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbacc003570 con 0x7fbae0142ec0 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae50c5700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae0143290 0x7fbae0159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3308749962 0 0) 0x7fbacc003570 con 0x7fbae0142ec0 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae0143290 msgr2=0x7fbae0159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae0143290 0x7fbae0159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 >> v1:172.21.15.134:6789/0 conn(0x7fbae00cf750 legacy=0x7fbae015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0067ab0 con 0x7fbae0142ec0 2023-10-06T03:16:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fbadc0017f0 con 0x7fbae0142ec0 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 >> v1:172.21.15.82:6789/0 conn(0x7fbae0142ec0 legacy=0x7fbae00cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbacc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae0143290 0x7fbacc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbacc004da0 0x7fbacc0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00677d0 con 0x7fbacc003a90 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc00bc20 con 0x7fbacc004da0 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc00bde0 con 0x7fbae0143290 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae58c6700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbacc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae50c5700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae0143290 0x7fbacc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.969+0000 7fbae60c7700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbacc004da0 0x7fbacc0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae58c6700 1 -- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae0143290 msgr2=0x7fbacc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae58c6700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae0143290 0x7fbacc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae58c6700 1 -- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbacc004da0 msgr2=0x7fbacc0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae58c6700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbacc004da0 0x7fbacc0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae58c6700 1 -- 172.21.15.82:0/2995755274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc003570 con 0x7fbacc003a90 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae58c6700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbacc003ea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbadc002250 tx=0x7fbae0067d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6131f7c6aa79e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0070d0 con 0x7fbacc003a90 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc007230 con 0x7fbacc003a90 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae48c4700 1 -- 172.21.15.82:0/2995755274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0075f0 con 0x7fbacc003a90 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae68c8700 1 -- 172.21.15.82:0/2995755274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 msgr2=0x7fbacc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae68c8700 1 --2- 172.21.15.82:0/2995755274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbacc003ea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbadc002250 tx=0x7fbae0067d90 comp rx=0 tx=0).stop 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae60c7700 1 -- 172.21.15.82:0/2995755274 reap_dead start 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae68c8700 1 -- 172.21.15.82:0/2995755274 shutdown_connections 2023-10-06T03:16:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae68c8700 1 -- 172.21.15.82:0/2995755274 >> 172.21.15.82:0/2995755274 conn(0x7fbae00ccf70 msgr2=0x7fbae00cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae68c8700 1 -- 172.21.15.82:0/2995755274 shutdown_connections 2023-10-06T03:16:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.970+0000 7fbae68c8700 1 -- 172.21.15.82:0/2995755274 wait complete. 2023-10-06T03:16:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae68c8700 1 Processor -- start 2023-10-06T03:16:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae68c8700 1 -- start start 2023-10-06T03:16:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae68c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbae00b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae68c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae00b3b40 0x7fbae00b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae68c8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae00b44f0 0x7fbae00b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae68c8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00b4ea0 con 0x7fbacc003a90 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae68c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00b33d0 con 0x7fbae00b3b40 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae68c8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00b36b0 con 0x7fbae00b44f0 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae58c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbae00b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae58c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbae00b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35764/0 (socket says 172.21.15.82:35764) 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae58c6700 1 -- 172.21.15.82:0/645120184 learned_addr learned my addr 172.21.15.82:0/645120184 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae60c7700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae00b44f0 0x7fbae00b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.972+0000 7fbae50c5700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae00b3b40 0x7fbae00b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae58c6700 1 -- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae00b44f0 msgr2=0x7fbae00b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae58c6700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae00b44f0 0x7fbae00b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae58c6700 1 -- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae00b3b40 msgr2=0x7fbae00b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae58c6700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae00b3b40 0x7fbae00b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae58c6700 1 -- 172.21.15.82:0/645120184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae01595f0 con 0x7fbacc003a90 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae60c7700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae00b44f0 0x7fbae00b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae50c5700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae00b3b40 0x7fbae00b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae58c6700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbae00b0fc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbadc012fb0 tx=0x7fbadc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbad5ffb700 1 -- 172.21.15.82:0/645120184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc007960 con 0x7fbacc003a90 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbad5ffb700 1 -- 172.21.15.82:0/645120184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc022070 con 0x7fbacc003a90 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae00b17f0 con 0x7fbacc003a90 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbad5ffb700 1 -- 172.21.15.82:0/645120184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc007ac0 con 0x7fbacc003a90 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.973+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae00b1db0 con 0x7fbacc003a90 2023-10-06T03:16:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.974+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae004c3c0 con 0x7fbacc003a90 2023-10-06T03:16:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.974+0000 7fbad5ffb700 1 -- 172.21.15.82:0/645120184 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbadc004bb0 con 0x7fbacc003a90 2023-10-06T03:16:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.975+0000 7fbad5ffb700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbac4066f60 0x7fbac4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.975+0000 7fbad5ffb700 1 -- 172.21.15.82:0/645120184 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbadc086750 con 0x7fbacc003a90 2023-10-06T03:16:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.975+0000 7fbae50c5700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbac4066f60 0x7fbac4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.975+0000 7fbae50c5700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbac4066f60 0x7fbac4069410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbad0006dc0 tx=0x7fbad0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:18.979+0000 7fbad5ffb700 1 -- 172.21.15.82:0/645120184 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbadc053860 con 0x7fbacc003a90 2023-10-06T03:16:19.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.161+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbae00682b0 con 0x7fbacc003a90 2023-10-06T03:16:19.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.161+0000 7fbad5ffb700 1 -- 172.21.15.82:0/645120184 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbadc016020 con 0x7fbacc003a90 2023-10-06T03:16:19.162 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:16:19.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbac4066f60 msgr2=0x7fbac4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbac4066f60 0x7fbac4069410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbad0006dc0 tx=0x7fbad0008040 comp rx=0 tx=0).stop 2023-10-06T03:16:19.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 msgr2=0x7fbae00b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbae00b0fc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbadc012fb0 tx=0x7fbadc015000 comp rx=0 tx=0).stop 2023-10-06T03:16:19.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 shutdown_connections 2023-10-06T03:16:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbac4066f60 0x7fbac4069410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae00b44f0 0x7fbae00b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbacc003a90 0x7fbae00b0fc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 --2- 172.21.15.82:0/645120184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae00b3b40 0x7fbae00b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 >> 172.21.15.82:0/645120184 conn(0x7fbae00ccf70 msgr2=0x7fbae0068690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 shutdown_connections 2023-10-06T03:16:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.163+0000 7fbae68c8700 1 -- 172.21.15.82:0/645120184 wait complete. 2023-10-06T03:16:19.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:19.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.289+0000 7f5f9369c700 1 Processor -- start 2023-10-06T03:16:19.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.290+0000 7f5f9369c700 1 -- start start 2023-10-06T03:16:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.290+0000 7f5f9369c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c0cc1a0 0x7f5f8c1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.290+0000 7f5f9369c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c157020 con 0x7f5f8c0cc570 2023-10-06T03:16:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.290+0000 7f5f9369c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c157300 con 0x7f5f8c06f5f0 2023-10-06T03:16:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.290+0000 7f5f9369c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c14d990 con 0x7f5f8c0cc1a0 2023-10-06T03:16:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f91c39700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5f8c0cc570 0x7f5f8c0c7f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38318/0 (socket says 172.21.15.82:38318) 2023-10-06T03:16:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f91c39700 1 -- 172.21.15.82:0/354709897 learned_addr learned my addr 172.21.15.82:0/354709897 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f91438700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c0cc1a0 0x7f5f8c1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420272251 0 0) 0x7f5f8c157020 con 0x7f5f8c0cc570 2023-10-06T03:16:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f78003570 con 0x7f5f8c0cc570 2023-10-06T03:16:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327357506 0 0) 0x7f5f78003570 con 0x7f5f8c0cc570 2023-10-06T03:16:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c0cc1a0 msgr2=0x7f5f8c1569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c0cc1a0 0x7f5f8c1569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 >> v1:172.21.15.134:6789/0 conn(0x7f5f8c06f5f0 legacy=0x7f5f8c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c1575e0 con 0x7f5f8c0cc570 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f5f840017f0 con 0x7f5f8c0cc570 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 >> v1:172.21.15.82:6789/0 conn(0x7f5f8c0cc570 legacy=0x7f5f8c0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f78003a90 0x7f5f78003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c0cc1a0 0x7f5f78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78004d50 0x7f5f780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c14d990 con 0x7f5f78003a90 2023-10-06T03:16:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7800bb70 con 0x7f5f78004d50 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7800bd30 con 0x7f5f8c0cc1a0 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f91438700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f78003a90 0x7f5f78003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f91c39700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78004d50 0x7f5f780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f90c37700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c0cc1a0 0x7f5f78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f91438700 1 -- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c0cc1a0 msgr2=0x7f5f78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.291+0000 7f5f91438700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c0cc1a0 0x7f5f78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f91438700 1 -- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78004d50 msgr2=0x7f5f780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f91438700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78004d50 0x7f5f780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f91438700 1 -- 172.21.15.82:0/354709897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f78003570 con 0x7f5f78003a90 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f91438700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f78003a90 0x7f5f78003ea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009c00 tx=0x7f5f880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4c0a7f155ab986 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800e710 con 0x7f5f78003a90 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8800e870 con 0x7f5f78003a90 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f83fff700 1 -- 172.21.15.82:0/354709897 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800ec30 con 0x7f5f78003a90 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f9369c700 1 -- 172.21.15.82:0/354709897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f78003a90 msgr2=0x7f5f78003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f9369c700 1 --2- 172.21.15.82:0/354709897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f78003a90 0x7f5f78003ea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009c00 tx=0x7f5f880091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f91c39700 1 -- 172.21.15.82:0/354709897 reap_dead start 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f9369c700 1 -- 172.21.15.82:0/354709897 shutdown_connections 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f9369c700 1 -- 172.21.15.82:0/354709897 >> 172.21.15.82:0/354709897 conn(0x7f5f8c06e6a0 msgr2=0x7f5f8c06eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f9369c700 1 -- 172.21.15.82:0/354709897 shutdown_connections 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.292+0000 7f5f9369c700 1 -- 172.21.15.82:0/354709897 wait complete. 2023-10-06T03:16:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.293+0000 7f5f9369c700 1 Processor -- start 2023-10-06T03:16:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.293+0000 7f5f9369c700 1 -- start start 2023-10-06T03:16:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f9369c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78003a90 0x7f5f8c0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f9369c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c16bdc0 0x7f5f8c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f9369c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f8c150220 0x7f5f8c167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f9369c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1506c0 con 0x7f5f8c150220 2023-10-06T03:16:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f9369c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c16c230 con 0x7f5f78003a90 2023-10-06T03:16:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f9369c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c151460 con 0x7f5f8c16bdc0 2023-10-06T03:16:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f91c39700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f8c150220 0x7f5f8c167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f91c39700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f8c150220 0x7f5f8c167d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35784/0 (socket says 172.21.15.82:35784) 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.294+0000 7f5f91c39700 1 -- 172.21.15.82:0/446685513 learned_addr learned my addr 172.21.15.82:0/446685513 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f90c37700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c16bdc0 0x7f5f8c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f91438700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78003a90 0x7f5f8c0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f91c39700 1 -- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c16bdc0 msgr2=0x7f5f8c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f91c39700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c16bdc0 0x7f5f8c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f91c39700 1 -- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78003a90 msgr2=0x7f5f8c0acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f91c39700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78003a90 0x7f5f8c0acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f91c39700 1 -- 172.21.15.82:0/446685513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c151740 con 0x7f5f8c150220 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f91c39700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f8c150220 0x7f5f8c167d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0cc940 tx=0x7f5f840010e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f817fa700 1 -- 172.21.15.82:0/446685513 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84007b30 con 0x7f5f8c150220 2023-10-06T03:16:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f817fa700 1 -- 172.21.15.82:0/446685513 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8400ebc0 con 0x7f5f8c150220 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c1691c0 con 0x7f5f8c150220 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f817fa700 1 -- 172.21.15.82:0/446685513 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84013420 con 0x7f5f8c150220 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.295+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c168ec0 con 0x7f5f8c150220 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.296+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c1696e0 con 0x7f5f8c150220 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.296+0000 7f5f817fa700 1 -- 172.21.15.82:0/446685513 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f84013790 con 0x7f5f8c150220 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.297+0000 7f5f817fa700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.297+0000 7f5f817fa700 1 -- 172.21.15.82:0/446685513 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f84084b40 con 0x7f5f8c150220 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.297+0000 7f5f91438700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.297+0000 7f5f91438700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5f70066f30 0x7f5f700693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f880091e0 tx=0x7f5f8801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.301+0000 7f5f817fa700 1 -- 172.21.15.82:0/446685513 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f8c1696e0 con 0x7f5f8c150220 2023-10-06T03:16:19.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.485+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f8c1696e0 con 0x7f5f8c150220 2023-10-06T03:16:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.486+0000 7f5f817fa700 1 -- 172.21.15.82:0/446685513 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f5f8c1696e0 con 0x7f5f8c150220 2023-10-06T03:16:19.489 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:19.489 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:19.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.488+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5f70066f30 msgr2=0x7f5f700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.488+0000 7f5f9369c700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5f70066f30 0x7f5f700693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f880091e0 tx=0x7f5f8801a000 comp rx=0 tx=0).stop 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.488+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f8c150220 msgr2=0x7f5f8c167d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.488+0000 7f5f9369c700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f8c150220 0x7f5f8c167d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0cc940 tx=0x7f5f840010e0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.488+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 shutdown_connections 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.489+0000 7f5f9369c700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f8c150220 0x7f5f8c167d90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.489+0000 7f5f9369c700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78003a90 0x7f5f8c0acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.489+0000 7f5f9369c700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.489+0000 7f5f9369c700 1 --2- 172.21.15.82:0/446685513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f8c16bdc0 0x7f5f8c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.489+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 >> 172.21.15.82:0/446685513 conn(0x7f5f8c06e6a0 msgr2=0x7f5f8c159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.489+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 shutdown_connections 2023-10-06T03:16:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.489+0000 7f5f9369c700 1 -- 172.21.15.82:0/446685513 wait complete. 2023-10-06T03:16:19.501 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:15:49.404080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:15:50.736320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:16:19.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:19.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.618+0000 7fa9268d0700 1 Processor -- start 2023-10-06T03:16:19.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.618+0000 7fa9268d0700 1 -- start start 2023-10-06T03:16:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa9268d0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa920157b50 0x7fa9200cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa9268d0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920158630 0x7fa920161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa9268d0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa920159a60 con 0x7fa9200cdb30 2023-10-06T03:16:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa9268d0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9200cdfb0 con 0x7fa920157b50 2023-10-06T03:16:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa9268d0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa920158e50 con 0x7fa920158630 2023-10-06T03:16:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa920157b50 0x7fa9200cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa9200cdb30 0x7fa920157f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38330/0 (socket says 172.21.15.82:38330) 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91f7fe700 1 -- 172.21.15.82:0/2134436859 learned_addr learned my addr 172.21.15.82:0/2134436859 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa924e6d700 1 --2- 172.21.15.82:0/2134436859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920158630 0x7fa920161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91ffff700 1 -- 172.21.15.82:0/2134436859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920158630 msgr2=0x7fa920161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91ffff700 1 --2- 172.21.15.82:0/2134436859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920158630 0x7fa920161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91ffff700 1 -- 172.21.15.82:0/2134436859 >> v1:172.21.15.82:6789/0 conn(0x7fa9200cdb30 legacy=0x7fa920157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91ffff700 1 -- 172.21.15.82:0/2134436859 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920159130 con 0x7fa920157b50 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91effd700 1 -- 172.21.15.82:0/2134436859 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282639900 0 0) 0x7fa920159a60 con 0x7fa9200cdb30 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91ffff700 1 --2- 172.21.15.82:0/2134436859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa920157b50 0x7fa9200cd5f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa9100098e0 tx=0x7fa9100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e38e242d858953 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91effd700 1 -- 172.21.15.82:0/2134436859 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910009e80 con 0x7fa920157b50 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.619+0000 7fa91effd700 1 -- 172.21.15.82:0/2134436859 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91000b860 con 0x7fa920157b50 2023-10-06T03:16:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa91effd700 1 -- 172.21.15.82:0/2134436859 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000bbe0 con 0x7fa920157b50 2023-10-06T03:16:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa9268d0700 1 -- 172.21.15.82:0/2134436859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa920157b50 msgr2=0x7fa9200cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2134436859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa920157b50 0x7fa9200cd5f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa9100098e0 tx=0x7fa9100091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa9268d0700 1 -- 172.21.15.82:0/2134436859 shutdown_connections 2023-10-06T03:16:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2134436859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa920157b50 0x7fa9200cd5f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2134436859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920158630 0x7fa920161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa9268d0700 1 -- 172.21.15.82:0/2134436859 >> 172.21.15.82:0/2134436859 conn(0x7fa92006d890 msgr2=0x7fa92006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa9268d0700 1 -- 172.21.15.82:0/2134436859 shutdown_connections 2023-10-06T03:16:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.620+0000 7fa9268d0700 1 -- 172.21.15.82:0/2134436859 wait complete. 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.621+0000 7fa9268d0700 1 Processor -- start 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.621+0000 7fa9268d0700 1 -- start start 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa9268d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9200cdb30 0x7fa9200c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa9268d0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920157b50 0x7fa920168860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa9268d0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920158630 0x7fa920169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa9268d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200ca2e0 con 0x7fa9200cdb30 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa9268d0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9201532b0 con 0x7fa920158630 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa9268d0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa920153e10 con 0x7fa920157b50 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9200cdb30 0x7fa9200c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9200cdb30 0x7fa9200c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35800/0 (socket says 172.21.15.82:35800) 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91ffff700 1 -- 172.21.15.82:0/2754864493 learned_addr learned my addr 172.21.15.82:0/2754864493 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91f7fe700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920157b50 0x7fa920168860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa924e6d700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920158630 0x7fa920169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91ffff700 1 -- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920157b50 msgr2=0x7fa920168860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91ffff700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920157b50 0x7fa920168860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91ffff700 1 -- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920158630 msgr2=0x7fa920169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91ffff700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920158630 0x7fa920169280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91ffff700 1 -- 172.21.15.82:0/2754864493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910009420 con 0x7fa9200cdb30 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.622+0000 7fa91f7fe700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920157b50 0x7fa920168860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.623+0000 7fa91ffff700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9200cdb30 0x7fa9200c9da0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9200afb20 tx=0x7fa910017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.623+0000 7fa917fff700 1 -- 172.21.15.82:0/2754864493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000bbe0 con 0x7fa9200cdb30 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.623+0000 7fa917fff700 1 -- 172.21.15.82:0/2754864493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa910011420 con 0x7fa9200cdb30 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.623+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9201534e0 con 0x7fa9200cdb30 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.623+0000 7fa917fff700 1 -- 172.21.15.82:0/2754864493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9100117e0 con 0x7fa9200cdb30 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.623+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa920153aa0 con 0x7fa9200cdb30 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.624+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa920064050 con 0x7fa9200cdb30 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.624+0000 7fa917fff700 1 -- 172.21.15.82:0/2754864493 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa910011b90 con 0x7fa9200cdb30 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.624+0000 7fa917fff700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa900066f30 0x7fa9000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.625+0000 7fa917fff700 1 -- 172.21.15.82:0/2754864493 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9100860c0 con 0x7fa9200cdb30 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.625+0000 7fa91f7fe700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa900066f30 0x7fa9000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.625+0000 7fa91f7fe700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa900066f30 0x7fa9000693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa920155590 tx=0x7fa908009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.629+0000 7fa917fff700 1 -- 172.21.15.82:0/2754864493 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9100531d0 con 0x7fa9200cdb30 2023-10-06T03:16:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.809+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9200ca530 con 0x7fa9200cdb30 2023-10-06T03:16:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.810+0000 7fa917fff700 1 -- 172.21.15.82:0/2754864493 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9100567f0 con 0x7fa9200cdb30 2023-10-06T03:16:19.810 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa900066f30 msgr2=0x7fa9000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa900066f30 0x7fa9000693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa920155590 tx=0x7fa908009040 comp rx=0 tx=0).stop 2023-10-06T03:16:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9200cdb30 msgr2=0x7fa9200c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9200cdb30 0x7fa9200c9da0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9200afb20 tx=0x7fa910017000 comp rx=0 tx=0).stop 2023-10-06T03:16:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 shutdown_connections 2023-10-06T03:16:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920158630 0x7fa920169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9200cdb30 0x7fa9200c9da0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa900066f30 0x7fa9000693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 --2- 172.21.15.82:0/2754864493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa920157b50 0x7fa920168860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 >> 172.21.15.82:0/2754864493 conn(0x7fa92006d890 msgr2=0x7fa92014f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 shutdown_connections 2023-10-06T03:16:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.812+0000 7fa9268d0700 1 -- 172.21.15.82:0/2754864493 wait complete. 2023-10-06T03:16:19.825 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:19.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.941+0000 7f34d3640700 1 Processor -- start 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.941+0000 7f34d3640700 1 -- start start 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d3640700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34cc15dab0 0x7f34cc0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d3640700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34cc0b1110 con 0x7f34cc159500 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d3640700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34cc0b13b0 con 0x7f34cc1598d0 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d3640700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34cc0b1690 con 0x7f34cc15dab0 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d1bdd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34cc15dab0 0x7f34cc0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d13dc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f34cc159500 0x7f34cc0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38332/0 (socket says 172.21.15.82:38332) 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d13dc700 1 -- 172.21.15.82:0/839742578 learned_addr learned my addr 172.21.15.82:0/839742578 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d1bdd700 1 -- 172.21.15.82:0/839742578 >> v1:172.21.15.134:6789/0 conn(0x7f34cc1598d0 legacy=0x7f34cc15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d1bdd700 1 -- 172.21.15.82:0/839742578 >> v1:172.21.15.82:6789/0 conn(0x7f34cc159500 legacy=0x7f34cc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34c3fff700 1 -- 172.21.15.82:0/839742578 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842019887 0 0) 0x7f34cc0b1110 con 0x7f34cc159500 2023-10-06T03:16:19.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.942+0000 7f34d1bdd700 1 -- 172.21.15.82:0/839742578 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc0b1970 con 0x7f34cc15dab0 2023-10-06T03:16:19.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34d1bdd700 1 --2- 172.21.15.82:0/839742578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc15dab0 0x7f34cc0cf6c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34c40098e0 tx=0x7f34c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5f063a51a976e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34c3fff700 1 -- 172.21.15.82:0/839742578 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4009e80 con 0x7f34cc15dab0 2023-10-06T03:16:19.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34c3fff700 1 -- 172.21.15.82:0/839742578 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c400b820 con 0x7f34cc15dab0 2023-10-06T03:16:19.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34c3fff700 1 -- 172.21.15.82:0/839742578 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c400bba0 con 0x7f34cc15dab0 2023-10-06T03:16:19.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34d3640700 1 -- 172.21.15.82:0/839742578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc15dab0 msgr2=0x7f34cc0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34d3640700 1 --2- 172.21.15.82:0/839742578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc15dab0 0x7f34cc0cf6c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34c40098e0 tx=0x7f34c40091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34d3640700 1 -- 172.21.15.82:0/839742578 shutdown_connections 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34d3640700 1 --2- 172.21.15.82:0/839742578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc15dab0 0x7f34cc0cf6c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34d3640700 1 -- 172.21.15.82:0/839742578 >> 172.21.15.82:0/839742578 conn(0x7f34cc067630 msgr2=0x7f34cc069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34d3640700 1 -- 172.21.15.82:0/839742578 shutdown_connections 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.943+0000 7f34d3640700 1 -- 172.21.15.82:0/839742578 wait complete. 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.944+0000 7f34d3640700 1 Processor -- start 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.944+0000 7f34d3640700 1 -- start start 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d3640700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc159500 0x7f34cc169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d3640700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34cc1598d0 0x7f34cc14d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d3640700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34cc15dab0 0x7f34cc0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d3640700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc14deb0 con 0x7f34cc159500 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d3640700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc1501f0 con 0x7f34cc15dab0 2023-10-06T03:16:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d3640700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc1504d0 con 0x7f34cc1598d0 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d13dc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc159500 0x7f34cc169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d13dc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc159500 0x7f34cc169a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35824/0 (socket says 172.21.15.82:35824) 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.945+0000 7f34d13dc700 1 -- 172.21.15.82:0/3504915185 learned_addr learned my addr 172.21.15.82:0/3504915185 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d13dc700 1 -- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34cc1598d0 msgr2=0x7f34cc14d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d13dc700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34cc1598d0 0x7f34cc14d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d1bdd700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34cc15dab0 0x7f34cc0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d13dc700 1 -- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34cc15dab0 msgr2=0x7f34cc0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d13dc700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34cc15dab0 0x7f34cc0b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d13dc700 1 -- 172.21.15.82:0/3504915185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c4009420 con 0x7f34cc159500 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d13dc700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc159500 0x7f34cc169a10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f34c800cd80 tx=0x7f34c8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34c17fa700 1 -- 172.21.15.82:0/3504915185 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c800ab10 con 0x7f34cc159500 2023-10-06T03:16:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34c17fa700 1 -- 172.21.15.82:0/3504915185 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c800ac70 con 0x7f34cc159500 2023-10-06T03:16:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34cc1507b0 con 0x7f34cc159500 2023-10-06T03:16:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34c17fa700 1 -- 172.21.15.82:0/3504915185 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80070f0 con 0x7f34cc159500 2023-10-06T03:16:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.946+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34cc169f50 con 0x7f34cc159500 2023-10-06T03:16:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.947+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34cc064050 con 0x7f34cc159500 2023-10-06T03:16:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.948+0000 7f34c17fa700 1 -- 172.21.15.82:0/3504915185 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34c80074e0 con 0x7f34cc159500 2023-10-06T03:16:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.948+0000 7f34c17fa700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f34b0066f30 0x7f34b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.948+0000 7f34c17fa700 1 -- 172.21.15.82:0/3504915185 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f34c8084b40 con 0x7f34cc159500 2023-10-06T03:16:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.948+0000 7f34d0bdb700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f34b0066f30 0x7f34b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.949+0000 7f34d0bdb700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f34b0066f30 0x7f34b00693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f34bc007fd0 tx=0x7f34bc007b20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:19.952+0000 7f34c17fa700 1 -- 172.21.15.82:0/3504915185 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34c8051cd0 con 0x7f34cc159500 2023-10-06T03:16:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.133+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34cc0d0420 con 0x7f34cc159500 2023-10-06T03:16:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.134+0000 7f34c17fa700 1 -- 172.21.15.82:0/3504915185 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34c80552f0 con 0x7f34cc159500 2023-10-06T03:16:20.134 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:20.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.135+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f34b0066f30 msgr2=0x7f34b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.135+0000 7f34d3640700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f34b0066f30 0x7f34b00693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f34bc007fd0 tx=0x7f34bc007b20 comp rx=0 tx=0).stop 2023-10-06T03:16:20.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.135+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc159500 msgr2=0x7f34cc169a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.135+0000 7f34d3640700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc159500 0x7f34cc169a10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f34c800cd80 tx=0x7f34c8001ae0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.136+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 shutdown_connections 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.136+0000 7f34d3640700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34cc15dab0 0x7f34cc0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.136+0000 7f34d3640700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34cc159500 0x7f34cc169a10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.136+0000 7f34d3640700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f34b0066f30 0x7f34b00693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.136+0000 7f34d3640700 1 --2- 172.21.15.82:0/3504915185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34cc1598d0 0x7f34cc14d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.136+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 >> 172.21.15.82:0/3504915185 conn(0x7f34cc067630 msgr2=0x7f34cc069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.136+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 shutdown_connections 2023-10-06T03:16:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.136+0000 7f34d3640700 1 -- 172.21.15.82:0/3504915185 wait complete. 2023-10-06T03:16:20.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:16:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.265+0000 7f6496775700 1 Processor -- start 2023-10-06T03:16:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.265+0000 7f6496775700 1 -- start start 2023-10-06T03:16:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.266+0000 7f6496775700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6490157b50 0x7f64900cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.266+0000 7f6496775700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f6490157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.266+0000 7f6496775700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6490159a60 con 0x7f6490158460 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.266+0000 7f6496775700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6490158e50 con 0x7f6490157b50 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.266+0000 7f6496775700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6490159130 con 0x7f64900cdb30 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.266+0000 7f648ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6490157b50 0x7f64900cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.266+0000 7f6494d12700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6490158460 0x7f6490159ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38346/0 (socket says 172.21.15.82:38346) 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.266+0000 7f6494d12700 1 -- 172.21.15.82:0/3408174705 learned_addr learned my addr 172.21.15.82:0/3408174705 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648f7fe700 1 --2- 172.21.15.82:0/3408174705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f6490157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648ffff700 1 -- 172.21.15.82:0/3408174705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 msgr2=0x7f6490157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648ffff700 1 --2- 172.21.15.82:0/3408174705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f6490157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648ffff700 1 -- 172.21.15.82:0/3408174705 >> v1:172.21.15.82:6789/0 conn(0x7f6490158460 legacy=0x7f6490159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648ffff700 1 -- 172.21.15.82:0/3408174705 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490159410 con 0x7f6490157b50 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648effd700 1 -- 172.21.15.82:0/3408174705 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369389727 0 0) 0x7f6490159a60 con 0x7f6490158460 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648f7fe700 1 --2- 172.21.15.82:0/3408174705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f6490157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648ffff700 1 --2- 172.21.15.82:0/3408174705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490157b50 0x7f64900cd5f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f64800098e0 tx=0x7f64800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14c0b9069e9b072 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648effd700 1 -- 172.21.15.82:0/3408174705 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480009e80 con 0x7f6490157b50 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648effd700 1 -- 172.21.15.82:0/3408174705 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648000b860 con 0x7f6490157b50 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f648effd700 1 -- 172.21.15.82:0/3408174705 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000bbe0 con 0x7f6490157b50 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f6496775700 1 -- 172.21.15.82:0/3408174705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490157b50 msgr2=0x7f64900cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.267+0000 7f6496775700 1 --2- 172.21.15.82:0/3408174705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490157b50 0x7f64900cd5f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f64800098e0 tx=0x7f64800091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.268+0000 7f6496775700 1 -- 172.21.15.82:0/3408174705 shutdown_connections 2023-10-06T03:16:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.268+0000 7f6496775700 1 --2- 172.21.15.82:0/3408174705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490157b50 0x7f64900cd5f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.268+0000 7f6496775700 1 --2- 172.21.15.82:0/3408174705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f6490157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.268+0000 7f6496775700 1 -- 172.21.15.82:0/3408174705 >> 172.21.15.82:0/3408174705 conn(0x7f649006d890 msgr2=0x7f649006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.268+0000 7f6496775700 1 -- 172.21.15.82:0/3408174705 shutdown_connections 2023-10-06T03:16:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.268+0000 7f6496775700 1 -- 172.21.15.82:0/3408174705 wait complete. 2023-10-06T03:16:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.269+0000 7f6496775700 1 Processor -- start 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.269+0000 7f6496775700 1 -- start start 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.269+0000 7f6496775700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f64901567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6496775700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490157b50 0x7f6490068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6496775700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490158460 0x7f64901429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6496775700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649006a010 con 0x7f6490158460 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6496775700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490069a50 con 0x7f6490157b50 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6496775700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6490069d30 con 0x7f64900cdb30 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490158460 0x7f64901429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490158460 0x7f64901429e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35838/0 (socket says 172.21.15.82:35838) 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 -- 172.21.15.82:0/2438146260 learned_addr learned my addr 172.21.15.82:0/2438146260 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f648ffff700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f64901567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f648f7fe700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490157b50 0x7f6490068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 -- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 msgr2=0x7f64901567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f64901567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 -- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490157b50 msgr2=0x7f6490068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490157b50 0x7f6490068fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 -- 172.21.15.82:0/2438146260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480009420 con 0x7f6490158460 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f648f7fe700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490157b50 0x7f6490068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6494d12700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490158460 0x7f64901429e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f648800cc10 tx=0x7f6488001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6477fff700 1 -- 172.21.15.82:0/2438146260 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800a880 con 0x7f6490158460 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6477fff700 1 -- 172.21.15.82:0/2438146260 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648800aa00 con 0x7f6490158460 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6477fff700 1 -- 172.21.15.82:0/2438146260 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800adc0 con 0x7f6490158460 2023-10-06T03:16:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649015a020 con 0x7f6490158460 2023-10-06T03:16:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.270+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649006ae20 con 0x7f6490158460 2023-10-06T03:16:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.271+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6490064050 con 0x7f6490158460 2023-10-06T03:16:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.272+0000 7f6477fff700 1 -- 172.21.15.82:0/2438146260 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6488007300 con 0x7f6490158460 2023-10-06T03:16:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.272+0000 7f6477fff700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f647c066f30 0x7f647c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.272+0000 7f6477fff700 1 -- 172.21.15.82:0/2438146260 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6488084970 con 0x7f6490158460 2023-10-06T03:16:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.272+0000 7f648ffff700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f647c066f30 0x7f647c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.273+0000 7f648ffff700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f647c066f30 0x7f647c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64800091e0 tx=0x7f6480017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.276+0000 7f6477fff700 1 -- 172.21.15.82:0/2438146260 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6488051b00 con 0x7f6490158460 2023-10-06T03:16:20.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.459+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f649015a4c0 con 0x7f6490158460 2023-10-06T03:16:20.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.459+0000 7f6477fff700 1 -- 172.21.15.82:0/2438146260 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6488055120 con 0x7f6490158460 2023-10-06T03:16:20.460 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:16:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f647c066f30 msgr2=0x7f647c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f647c066f30 0x7f647c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64800091e0 tx=0x7f6480017000 comp rx=0 tx=0).stop 2023-10-06T03:16:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490158460 msgr2=0x7f64901429e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490158460 0x7f64901429e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f648800cc10 tx=0x7f6488001970 comp rx=0 tx=0).stop 2023-10-06T03:16:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 shutdown_connections 2023-10-06T03:16:20.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490158460 0x7f64901429e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f647c066f30 0x7f647c0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64900cdb30 0x7f64901567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 --2- 172.21.15.82:0/2438146260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490157b50 0x7f6490068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 >> 172.21.15.82:0/2438146260 conn(0x7f649006d890 msgr2=0x7f6490150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:20.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 shutdown_connections 2023-10-06T03:16:20.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.461+0000 7f6496775700 1 -- 172.21.15.82:0/2438146260 wait complete. 2023-10-06T03:16:20.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:16:20.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.590+0000 7f4be0507700 1 Processor -- start 2023-10-06T03:16:20.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.590+0000 7f4be0507700 1 -- start start 2023-10-06T03:16:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.591+0000 7f4be0507700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bd80cdd00 0x7f4bd8157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.591+0000 7f4be0507700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4bd8158460 0x7f4bd8161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.591+0000 7f4be0507700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd8159a60 con 0x7f4bd8157b50 2023-10-06T03:16:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.591+0000 7f4be0507700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd8158e50 con 0x7f4bd80cdd00 2023-10-06T03:16:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.591+0000 7f4be0507700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd8159130 con 0x7f4bd8158460 2023-10-06T03:16:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.591+0000 7f4bddaa2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bd80cdd00 0x7f4bd8157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.591+0000 7f4bde2a3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4bd8157b50 0x7f4bd80cd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38350/0 (socket says 172.21.15.82:38350) 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.591+0000 7f4bde2a3700 1 -- 172.21.15.82:0/1933816309 learned_addr learned my addr 172.21.15.82:0/1933816309 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bddaa2700 1 -- 172.21.15.82:0/1933816309 >> v2:172.21.15.134:3300/0 conn(0x7f4bd8158460 msgr2=0x7f4bd8161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bdeaa4700 1 --2- 172.21.15.82:0/1933816309 >> v2:172.21.15.134:3300/0 conn(0x7f4bd8158460 0x7f4bd8161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bddaa2700 1 --2- 172.21.15.82:0/1933816309 >> v2:172.21.15.134:3300/0 conn(0x7f4bd8158460 0x7f4bd8161110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bdd2a1700 1 -- 172.21.15.82:0/1933816309 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673563137 0 0) 0x7f4bd8159a60 con 0x7f4bd8157b50 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bddaa2700 1 -- 172.21.15.82:0/1933816309 >> v1:172.21.15.82:6789/0 conn(0x7f4bd8157b50 legacy=0x7f4bd80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bddaa2700 1 -- 172.21.15.82:0/1933816309 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8159410 con 0x7f4bd80cdd00 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bddaa2700 1 --2- 172.21.15.82:0/1933816309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80cdd00 0x7f4bd8157f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80b14e0 tx=0x7f4bc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31340ca85b8697fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bdd2a1700 1 -- 172.21.15.82:0/1933816309 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800b6b0 con 0x7f4bd80cdd00 2023-10-06T03:16:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bdd2a1700 1 -- 172.21.15.82:0/1933816309 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc800b810 con 0x7f4bd80cdd00 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4bdd2a1700 1 -- 172.21.15.82:0/1933816309 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800bbb0 con 0x7f4bd80cdd00 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4be0507700 1 -- 172.21.15.82:0/1933816309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80cdd00 msgr2=0x7f4bd8157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.592+0000 7f4be0507700 1 --2- 172.21.15.82:0/1933816309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80cdd00 0x7f4bd8157f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80b14e0 tx=0x7f4bc80091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.593+0000 7f4be0507700 1 -- 172.21.15.82:0/1933816309 shutdown_connections 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.593+0000 7f4be0507700 1 --2- 172.21.15.82:0/1933816309 >> v2:172.21.15.134:3300/0 conn(0x7f4bd8158460 0x7f4bd8161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.593+0000 7f4be0507700 1 --2- 172.21.15.82:0/1933816309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80cdd00 0x7f4bd8157f20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.593+0000 7f4be0507700 1 -- 172.21.15.82:0/1933816309 >> 172.21.15.82:0/1933816309 conn(0x7f4bd806d890 msgr2=0x7f4bd806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.593+0000 7f4be0507700 1 -- 172.21.15.82:0/1933816309 shutdown_connections 2023-10-06T03:16:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.593+0000 7f4be0507700 1 -- 172.21.15.82:0/1933816309 wait complete. 2023-10-06T03:16:20.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4be0507700 1 Processor -- start 2023-10-06T03:16:20.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4be0507700 1 -- start start 2023-10-06T03:16:20.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4be0507700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bd80cdd00 0x7f4bd80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4be0507700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd8157b50 0x7f4bd813fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4be0507700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd8158460 0x7f4bd8156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4be0507700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd806a080 con 0x7f4bd8157b50 2023-10-06T03:16:20.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4be0507700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80b3ea0 con 0x7f4bd8158460 2023-10-06T03:16:20.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4be0507700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd814d510 con 0x7f4bd80cdd00 2023-10-06T03:16:20.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4bddaa2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd8157b50 0x7f4bd813fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4bddaa2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd8157b50 0x7f4bd813fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35862/0 (socket says 172.21.15.82:35862) 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.594+0000 7f4bddaa2700 1 -- 172.21.15.82:0/2015880873 learned_addr learned my addr 172.21.15.82:0/2015880873 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bdeaa4700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd8158460 0x7f4bd8156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bde2a3700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bd80cdd00 0x7f4bd80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bddaa2700 1 -- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bd80cdd00 msgr2=0x7f4bd80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bddaa2700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bd80cdd00 0x7f4bd80b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bddaa2700 1 -- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd8158460 msgr2=0x7f4bd8156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bddaa2700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd8158460 0x7f4bd8156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bddaa2700 1 -- 172.21.15.82:0/2015880873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8009420 con 0x7f4bd8157b50 2023-10-06T03:16:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bde2a3700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bd80cdd00 0x7f4bd80b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bdeaa4700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd8158460 0x7f4bd8156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bddaa2700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd8157b50 0x7f4bd813fdf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80afb20 tx=0x7f4bc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bce7fc700 1 -- 172.21.15.82:0/2015880873 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8011420 con 0x7f4bd8157b50 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bce7fc700 1 -- 172.21.15.82:0/2015880873 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8011580 con 0x7f4bd8157b50 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4bce7fc700 1 -- 172.21.15.82:0/2015880873 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8011920 con 0x7f4bd8157b50 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd8069da0 con 0x7f4bd8157b50 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.595+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd806ab30 con 0x7f4bd8157b50 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.596+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd806a6b0 con 0x7f4bd8157b50 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.596+0000 7f4bce7fc700 1 -- 172.21.15.82:0/2015880873 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bc8011d10 con 0x7f4bd8157b50 2023-10-06T03:16:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.597+0000 7f4bce7fc700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4bbc066f60 0x7f4bbc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.597+0000 7f4bce7fc700 1 -- 172.21.15.82:0/2015880873 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4bc8085cd0 con 0x7f4bd8157b50 2023-10-06T03:16:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.597+0000 7f4bde2a3700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4bbc066f60 0x7f4bbc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.598+0000 7f4bde2a3700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4bbc066f60 0x7f4bbc069410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400d1a0 tx=0x7f4bd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.601+0000 7f4bce7fc700 1 -- 172.21.15.82:0/2015880873 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bd806a6b0 con 0x7f4bd8157b50 2023-10-06T03:16:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.783+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4bd80b1b80 con 0x7f4bd8157b50 2023-10-06T03:16:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.783+0000 7f4bce7fc700 1 -- 172.21.15.82:0/2015880873 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4bc8015020 con 0x7f4bd8157b50 2023-10-06T03:16:20.785 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:16:20.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4bbc066f60 msgr2=0x7f4bbc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4bbc066f60 0x7f4bbc069410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400d1a0 tx=0x7f4bd4009040 comp rx=0 tx=0).stop 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd8157b50 msgr2=0x7f4bd813fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd8157b50 0x7f4bd813fdf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80afb20 tx=0x7f4bc8017000 comp rx=0 tx=0).stop 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 shutdown_connections 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bd8158460 0x7f4bd8156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4bbc066f60 0x7f4bbc069410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bd80cdd00 0x7f4bd80b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 --2- 172.21.15.82:0/2015880873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd8157b50 0x7f4bd813fdf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 >> 172.21.15.82:0/2015880873 conn(0x7f4bd806d890 msgr2=0x7f4bd814ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:20.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 shutdown_connections 2023-10-06T03:16:20.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.785+0000 7f4be0507700 1 -- 172.21.15.82:0/2015880873 wait complete. 2023-10-06T03:16:20.829 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_df (tasks.cephfs.test_quota.TestQuota) That when a client modifies the quota on a directory used 2023-10-06T03:16:20.830 INFO:tasks.cephfs_test_runner:test_remote_update_df (tasks.cephfs.test_quota.TestQuota) 2023-10-06T03:16:20.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df' 2023-10-06T03:16:20.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.944+0000 7fa188a93700 1 Processor -- start 2023-10-06T03:16:20.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.944+0000 7fa188a93700 1 -- start start 2023-10-06T03:16:20.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa188a93700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa18415d930 0x7fa1840d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa188a93700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1840b2ad0 con 0x7fa1841591b0 2023-10-06T03:16:20.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa188a93700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1840b4160 con 0x7fa18415d560 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa188a93700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1840b2230 con 0x7fa18415d930 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa181d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa18415d930 0x7fa1840d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa182d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa1841591b0 0x7fa184159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38366/0 (socket says 172.21.15.82:38366) 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa182d9d700 1 -- 172.21.15.82:0/1287423556 learned_addr learned my addr 172.21.15.82:0/1287423556 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa181d9b700 1 -- 172.21.15.82:0/1287423556 >> v1:172.21.15.134:6789/0 conn(0x7fa18415d560 legacy=0x7fa1840b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa181d9b700 1 -- 172.21.15.82:0/1287423556 >> v1:172.21.15.82:6789/0 conn(0x7fa1841591b0 legacy=0x7fa184159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.945+0000 7fa181d9b700 1 -- 172.21.15.82:0/1287423556 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840b2510 con 0x7fa18415d930 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa181d9b700 1 --2- 172.21.15.82:0/1287423556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa18415d930 0x7fa1840d0030 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa1780098e0 tx=0x7fa1780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413794bc4b2e7bd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa18159a700 1 -- 172.21.15.82:0/1287423556 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa178009e80 con 0x7fa18415d930 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa18159a700 1 -- 172.21.15.82:0/1287423556 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17800b820 con 0x7fa18415d930 2023-10-06T03:16:20.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa18159a700 1 -- 172.21.15.82:0/1287423556 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17800bba0 con 0x7fa18415d930 2023-10-06T03:16:20.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa188a93700 1 -- 172.21.15.82:0/1287423556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa18415d930 msgr2=0x7fa1840d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa188a93700 1 --2- 172.21.15.82:0/1287423556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa18415d930 0x7fa1840d0030 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa1780098e0 tx=0x7fa1780091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa188a93700 1 -- 172.21.15.82:0/1287423556 shutdown_connections 2023-10-06T03:16:20.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa188a93700 1 --2- 172.21.15.82:0/1287423556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa18415d930 0x7fa1840d0030 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa188a93700 1 -- 172.21.15.82:0/1287423556 >> 172.21.15.82:0/1287423556 conn(0x7fa1840d1180 msgr2=0x7fa184069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:20.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa188a93700 1 -- 172.21.15.82:0/1287423556 shutdown_connections 2023-10-06T03:16:20.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.946+0000 7fa188a93700 1 -- 172.21.15.82:0/1287423556 wait complete. 2023-10-06T03:16:20.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.947+0000 7fa188a93700 1 Processor -- start 2023-10-06T03:16:20.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.947+0000 7fa188a93700 1 -- start start 2023-10-06T03:16:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa188a93700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1841591b0 0x7fa18414b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa188a93700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18415d560 0x7fa1840cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa188a93700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18415d930 0x7fa1840cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa188a93700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840cd2a0 con 0x7fa1841591b0 2023-10-06T03:16:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa188a93700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840cc720 con 0x7fa18415d560 2023-10-06T03:16:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa188a93700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840cca00 con 0x7fa18415d930 2023-10-06T03:16:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa18259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1841591b0 0x7fa18414b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa18259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1841591b0 0x7fa18414b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35884/0 (socket says 172.21.15.82:35884) 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa18259c700 1 -- 172.21.15.82:0/2693762456 learned_addr learned my addr 172.21.15.82:0/2693762456 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.948+0000 7fa181d9b700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18415d560 0x7fa1840cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa182d9d700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18415d930 0x7fa1840cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa18259c700 1 -- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18415d930 msgr2=0x7fa1840cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa18259c700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18415d930 0x7fa1840cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa18259c700 1 -- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18415d560 msgr2=0x7fa1840cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa18259c700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18415d560 0x7fa1840cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa18259c700 1 -- 172.21.15.82:0/2693762456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa178009420 con 0x7fa1841591b0 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa182d9d700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18415d930 0x7fa1840cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa18259c700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1841591b0 0x7fa18414b050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c950 tx=0x7fa174002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa1727fc700 1 -- 172.21.15.82:0/2693762456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174012630 con 0x7fa1841591b0 2023-10-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa1727fc700 1 -- 172.21.15.82:0/2693762456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa174012790 con 0x7fa1841591b0 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa1727fc700 1 -- 172.21.15.82:0/2693762456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174012b50 con 0x7fa1841591b0 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1840ccce0 con 0x7fa1841591b0 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.949+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa184169c00 con 0x7fa1841591b0 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.950+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa184064050 con 0x7fa1841591b0 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.950+0000 7fa1727fc700 1 -- 172.21.15.82:0/2693762456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa17400a420 con 0x7fa1841591b0 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.951+0000 7fa1727fc700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa164066fb0 0x7fa164069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.951+0000 7fa1727fc700 1 -- 172.21.15.82:0/2693762456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa174084b70 con 0x7fa1841591b0 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.951+0000 7fa181d9b700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa164066fb0 0x7fa164069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:20.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.951+0000 7fa181d9b700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa164066fb0 0x7fa164069460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1780030c0 tx=0x7fa178016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:20.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:20.955+0000 7fa1727fc700 1 -- 172.21.15.82:0/2693762456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa174051be0 con 0x7fa1841591b0 2023-10-06T03:16:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.212+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]} v 0) v1 -- 0x7fa1840b27f0 con 0x7fa1841591b0 2023-10-06T03:16:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.507+0000 7fa1727fc700 1 -- 172.21.15.82:0/2693762456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]}]=0 v47) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa174055200 con 0x7fa1841591b0 2023-10-06T03:16:21.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa164066fb0 msgr2=0x7fa164069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:21.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa164066fb0 0x7fa164069460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1780030c0 tx=0x7fa178016000 comp rx=0 tx=0).stop 2023-10-06T03:16:21.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1841591b0 msgr2=0x7fa18414b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:21.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1841591b0 0x7fa18414b050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c950 tx=0x7fa174002760 comp rx=0 tx=0).stop 2023-10-06T03:16:21.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 shutdown_connections 2023-10-06T03:16:21.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa164066fb0 0x7fa164069460 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18415d930 0x7fa1840cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1841591b0 0x7fa18414b050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 --2- 172.21.15.82:0/2693762456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18415d560 0x7fa1840cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 >> 172.21.15.82:0/2693762456 conn(0x7fa1840d1180 msgr2=0x7fa184067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 shutdown_connections 2023-10-06T03:16:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.509+0000 7fa188a93700 1 -- 172.21.15.82:0/2693762456 wait complete. 2023-10-06T03:16:21.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:16:21.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.639+0000 7f8c1759e700 1 Processor -- start 2023-10-06T03:16:21.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.639+0000 7f8c1759e700 1 -- start start 2023-10-06T03:16:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c1759e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c18142e90 0x7f8c18069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c1759e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18069d50 0x7f8c1815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c1759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c18069380 con 0x7f8c1815de80 2023-10-06T03:16:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c1759e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c18068770 con 0x7f8c18142e90 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c1759e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18068a50 con 0x7f8c18069d50 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c16d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8c1815de80 0x7f8c180b0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38374/0 (socket says 172.21.15.82:38374) 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c16d9d700 1 -- 172.21.15.82:0/1894991678 learned_addr learned my addr 172.21.15.82:0/1894991678 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c0dd9b700 1 --2- 172.21.15.82:0/1894991678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18069d50 0x7f8c1815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c1659c700 1 --2- 172.21.15.82:0/1894991678 >> v2:172.21.15.134:3300/0 conn(0x7f8c18142e90 0x7f8c18069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c15d9b700 1 -- 172.21.15.82:0/1894991678 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674169213 0 0) 0x7f8c18069380 con 0x7f8c1815de80 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c15d9b700 1 -- 172.21.15.82:0/1894991678 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c04003570 con 0x7f8c1815de80 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c0dd9b700 1 -- 172.21.15.82:0/1894991678 >> v2:172.21.15.134:3300/0 conn(0x7f8c18142e90 msgr2=0x7f8c18069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c15d9b700 1 -- 172.21.15.82:0/1894991678 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1353280800 0 0) 0x7f8c04003570 con 0x7f8c1815de80 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c0dd9b700 1 --2- 172.21.15.82:0/1894991678 >> v2:172.21.15.134:3300/0 conn(0x7f8c18142e90 0x7f8c18069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c0dd9b700 1 -- 172.21.15.82:0/1894991678 >> v1:172.21.15.82:6789/0 conn(0x7f8c1815de80 legacy=0x7f8c180b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c0dd9b700 1 -- 172.21.15.82:0/1894991678 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18068d30 con 0x7f8c18069d50 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.640+0000 7f8c1659c700 1 --2- 172.21.15.82:0/1894991678 >> v2:172.21.15.134:3300/0 conn(0x7f8c18142e90 0x7f8c18069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c0dd9b700 1 --2- 172.21.15.82:0/1894991678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18069d50 0x7f8c1815d290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8c000098e0 tx=0x7f8c000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de909f6e576a6bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c15d9b700 1 -- 172.21.15.82:0/1894991678 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100017f0 con 0x7f8c18069d50 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c15d9b700 1 -- 172.21.15.82:0/1894991678 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c00011420 con 0x7f8c18069d50 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c15d9b700 1 -- 172.21.15.82:0/1894991678 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c000117c0 con 0x7f8c18069d50 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c1759e700 1 -- 172.21.15.82:0/1894991678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18069d50 msgr2=0x7f8c1815d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c1759e700 1 --2- 172.21.15.82:0/1894991678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18069d50 0x7f8c1815d290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8c000098e0 tx=0x7f8c000091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c1759e700 1 -- 172.21.15.82:0/1894991678 shutdown_connections 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c1759e700 1 --2- 172.21.15.82:0/1894991678 >> v2:172.21.15.134:3300/0 conn(0x7f8c18142e90 0x7f8c18069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c1759e700 1 --2- 172.21.15.82:0/1894991678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18069d50 0x7f8c1815d290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c1759e700 1 -- 172.21.15.82:0/1894991678 >> 172.21.15.82:0/1894991678 conn(0x7f8c180ccfe0 msgr2=0x7f8c180cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:21.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c1759e700 1 -- 172.21.15.82:0/1894991678 shutdown_connections 2023-10-06T03:16:21.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.641+0000 7f8c1759e700 1 -- 172.21.15.82:0/1894991678 wait complete. 2023-10-06T03:16:21.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1759e700 1 Processor -- start 2023-10-06T03:16:21.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1759e700 1 -- start start 2023-10-06T03:16:21.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18069d50 0x7f8c180c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:21.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1759e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18142e90 0x7f8c1816d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:21.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1759e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1815de80 0x7f8c1813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180c62e0 con 0x7f8c18069d50 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1759e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180c8bd0 con 0x7f8c1815de80 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1759e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180c65a0 con 0x7f8c18142e90 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18069d50 0x7f8c180c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18069d50 0x7f8c180c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35890/0 (socket says 172.21.15.82:35890) 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.643+0000 7f8c1659c700 1 -- 172.21.15.82:0/4082121645 learned_addr learned my addr 172.21.15.82:0/4082121645 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c1659c700 1 -- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18142e90 msgr2=0x7f8c1816d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c1659c700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18142e90 0x7f8c1816d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c1659c700 1 -- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1815de80 msgr2=0x7f8c1813ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:21.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c1659c700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1815de80 0x7f8c1813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c1659c700 1 -- 172.21.15.82:0/4082121645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c08009420 con 0x7f8c18069d50 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c1659c700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18069d50 0x7f8c180c8fe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800ec80 tx=0x7f8c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c0effd700 1 -- 172.21.15.82:0/4082121645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800c9d0 con 0x7f8c18069d50 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c0effd700 1 -- 172.21.15.82:0/4082121645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0800cb30 con 0x7f8c18069d50 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c00009420 con 0x7f8c18069d50 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c0effd700 1 -- 172.21.15.82:0/4082121645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800ceb0 con 0x7f8c18069d50 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.644+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c180c6b60 con 0x7f8c18069d50 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.645+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1804c3c0 con 0x7f8c18069d50 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.645+0000 7f8c0effd700 1 -- 172.21.15.82:0/4082121645 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c08013680 con 0x7f8c18069d50 2023-10-06T03:16:21.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.646+0000 7f8c0effd700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:21.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.646+0000 7f8c0effd700 1 -- 172.21.15.82:0/4082121645 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c08084ae0 con 0x7f8c18069d50 2023-10-06T03:16:21.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.646+0000 7f8c0dd9b700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:21.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.646+0000 7f8c0dd9b700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8bf8066f30 0x7f8bf80693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c1815e360 tx=0x7f8c00016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:21.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.650+0000 7f8c0effd700 1 -- 172.21.15.82:0/4082121645 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c08051bf0 con 0x7f8c18069d50 2023-10-06T03:16:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.833+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8c18069010 con 0x7f8c18069d50 2023-10-06T03:16:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.837+0000 7f8c0effd700 1 -- 172.21.15.82:0/4082121645 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c08055210 con 0x7f8c18069d50 2023-10-06T03:16:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8bf8066f30 msgr2=0x7f8bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8bf8066f30 0x7f8bf80693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c1815e360 tx=0x7f8c00016000 comp rx=0 tx=0).stop 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18069d50 msgr2=0x7f8c180c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18069d50 0x7f8c180c8fe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800ec80 tx=0x7f8c080091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 shutdown_connections 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1815de80 0x7f8c1813ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18069d50 0x7f8c180c8fe0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 --2- 172.21.15.82:0/4082121645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c18142e90 0x7f8c1816d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 >> 172.21.15.82:0/4082121645 conn(0x7f8c180ccfe0 msgr2=0x7f8c1815c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 shutdown_connections 2023-10-06T03:16:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:21.839+0000 7f8c1759e700 1 -- 172.21.15.82:0/4082121645 wait complete. 2023-10-06T03:16:21.851 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:16:21.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:16:21.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:16:21.939 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:16:21.939 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:16:21.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:21.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T03:16:21.979 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:16:21.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:21.979 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:16:22.034 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:16:22.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:22.035 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T03:16:22.074 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:16:22.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:22.075 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:16:22.131 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T03:16:22.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:22.131 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T03:16:22.167 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:16:22.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:22.167 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T03:16:22.222 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T03:16:22.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:22.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T03:16:22.271 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:16:22.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:22.272 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T03:16:22.287 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:16:22.287 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:22.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.401+0000 7ff05dd44700 1 Processor -- start 2023-10-06T03:16:22.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.401+0000 7ff05dd44700 1 -- start start 2023-10-06T03:16:22.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff05dd44700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff05815d560 0x7ff0580d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff05dd44700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0581591b0 0x7ff058159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff05dd44700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0580b2ad0 con 0x7ff05815d930 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff05dd44700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0580b4160 con 0x7ff0581591b0 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff05dd44700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff058159b70 con 0x7ff05815d560 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff057fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0581591b0 0x7ff058159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff057fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0581591b0 0x7ff058159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35900/0 (socket says 172.21.15.82:35900) 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff057fff700 1 -- 172.21.15.82:0/1980355193 learned_addr learned my addr 172.21.15.82:0/1980355193 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff0577fe700 1 --2- 172.21.15.82:0/1980355193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff05815d560 0x7ff0580d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff057fff700 1 -- 172.21.15.82:0/1980355193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff05815d560 msgr2=0x7ff0580d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff057fff700 1 --2- 172.21.15.82:0/1980355193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff05815d560 0x7ff0580d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff057fff700 1 -- 172.21.15.82:0/1980355193 >> v1:172.21.15.134:6789/0 conn(0x7ff05815d930 legacy=0x7ff0580b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff057fff700 1 -- 172.21.15.82:0/1980355193 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580b2230 con 0x7ff0581591b0 2023-10-06T03:16:22.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff0577fe700 1 --2- 172.21.15.82:0/1980355193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff05815d560 0x7ff0580d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:22.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.402+0000 7ff057fff700 1 --2- 172.21.15.82:0/1980355193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0581591b0 0x7ff058159630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff0500099b0 tx=0x7ff050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b3ed4f9a760228 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:22.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff0567fc700 1 -- 172.21.15.82:0/1980355193 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05000b820 con 0x7ff0581591b0 2023-10-06T03:16:22.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff0567fc700 1 -- 172.21.15.82:0/1980355193 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05000b980 con 0x7ff0581591b0 2023-10-06T03:16:22.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff0567fc700 1 -- 172.21.15.82:0/1980355193 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05000bd20 con 0x7ff0581591b0 2023-10-06T03:16:22.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff05dd44700 1 -- 172.21.15.82:0/1980355193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0581591b0 msgr2=0x7ff058159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff05dd44700 1 --2- 172.21.15.82:0/1980355193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0581591b0 0x7ff058159630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff0500099b0 tx=0x7ff050009250 comp rx=0 tx=0).stop 2023-10-06T03:16:22.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff05dd44700 1 -- 172.21.15.82:0/1980355193 shutdown_connections 2023-10-06T03:16:22.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff05dd44700 1 --2- 172.21.15.82:0/1980355193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0581591b0 0x7ff058159630 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff05dd44700 1 --2- 172.21.15.82:0/1980355193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff05815d560 0x7ff0580d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff05dd44700 1 -- 172.21.15.82:0/1980355193 >> 172.21.15.82:0/1980355193 conn(0x7ff0580d1180 msgr2=0x7ff058069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:22.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff05dd44700 1 -- 172.21.15.82:0/1980355193 shutdown_connections 2023-10-06T03:16:22.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.403+0000 7ff05dd44700 1 -- 172.21.15.82:0/1980355193 wait complete. 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.404+0000 7ff05dd44700 1 Processor -- start 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.404+0000 7ff05dd44700 1 -- start start 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff05dd44700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0581591b0 0x7ff05813f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff05dd44700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff05815d560 0x7ff05815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff05dd44700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05815d930 0x7ff05814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff05dd44700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058153f90 con 0x7ff05815d930 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff05dd44700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05815c650 con 0x7ff05815d560 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff05dd44700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05815ba40 con 0x7ff0581591b0 2023-10-06T03:16:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff057fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05815d930 0x7ff05814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff057fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05815d930 0x7ff05814ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35908/0 (socket says 172.21.15.82:35908) 2023-10-06T03:16:22.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff057fff700 1 -- 172.21.15.82:0/2911372943 learned_addr learned my addr 172.21.15.82:0/2911372943 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:22.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.405+0000 7ff0577fe700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0581591b0 0x7ff05813f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff056ffd700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff05815d560 0x7ff05815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff057fff700 1 -- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0581591b0 msgr2=0x7ff05813f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff057fff700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0581591b0 0x7ff05813f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff057fff700 1 -- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff05815d560 msgr2=0x7ff05815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff057fff700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff05815d560 0x7ff05815afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff057fff700 1 -- 172.21.15.82:0/2911372943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500094f0 con 0x7ff05815d930 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff056ffd700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff05815d560 0x7ff05815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff057fff700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05815d930 0x7ff05814ff80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0500030c0 tx=0x7ff050016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff03f7fe700 1 -- 172.21.15.82:0/2911372943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05001b450 con 0x7ff05815d930 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff03f7fe700 1 -- 172.21.15.82:0/2911372943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050020070 con 0x7ff05815d930 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05815bd20 con 0x7ff05815d930 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff03f7fe700 1 -- 172.21.15.82:0/2911372943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05001b800 con 0x7ff05815d930 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.406+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05815c2e0 con 0x7ff05815d930 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.407+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058064050 con 0x7ff05815d930 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.407+0000 7ff03f7fe700 1 -- 172.21.15.82:0/2911372943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff050022030 con 0x7ff05815d930 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.407+0000 7ff03f7fe700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff044066f30 0x7ff0440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.408+0000 7ff03f7fe700 1 -- 172.21.15.82:0/2911372943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff050086860 con 0x7ff05815d930 2023-10-06T03:16:22.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.408+0000 7ff0577fe700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff044066f30 0x7ff0440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.408+0000 7ff0577fe700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff044066f30 0x7ff0440693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff04800ac00 tx=0x7ff048006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:22.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.412+0000 7ff03f7fe700 1 -- 172.21.15.82:0/2911372943 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff050053970 con 0x7ff05815d930 2023-10-06T03:16:22.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.637+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff058064050 con 0x7ff05815d930 2023-10-06T03:16:22.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.638+0000 7ff03f7fe700 1 -- 172.21.15.82:0/2911372943 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7ff050056f90 con 0x7ff05815d930 2023-10-06T03:16:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:22.639 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:15:51.763473+0000","modified":"2023-10-06T03:15:55.399812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff044066f30 msgr2=0x7ff0440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff044066f30 0x7ff0440693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff04800ac00 tx=0x7ff048006f90 comp rx=0 tx=0).stop 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05815d930 msgr2=0x7ff05814ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05815d930 0x7ff05814ff80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0500030c0 tx=0x7ff050016000 comp rx=0 tx=0).stop 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 shutdown_connections 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05815d930 0x7ff05814ff80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff044066f30 0x7ff0440693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0581591b0 0x7ff05813f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 --2- 172.21.15.82:0/2911372943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff05815d560 0x7ff05815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 >> 172.21.15.82:0/2911372943 conn(0x7ff0580d1180 msgr2=0x7ff0580b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 shutdown_connections 2023-10-06T03:16:22.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.640+0000 7ff05dd44700 1 -- 172.21.15.82:0/2911372943 wait complete. 2023-10-06T03:16:22.642 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-10-06T03:16:22.652 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.765+0000 7fe7a2020700 1 Processor -- start 2023-10-06T03:16:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.765+0000 7fe7a2020700 1 -- start start 2023-10-06T03:16:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe7a2020700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe79c15d560 0x7fe79c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe7a2020700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe7a2020700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c0b2ad0 con 0x7fe79c1591b0 2023-10-06T03:16:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe7a2020700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c0b4160 con 0x7fe79c15d560 2023-10-06T03:16:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe7a2020700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0b1f80 con 0x7fe79c15d930 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe79b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe79c15d560 0x7fe79c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe79b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe79c15d560 0x7fe79c0d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35918/0 (socket says 172.21.15.82:35918) 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe79b7fe700 1 -- 172.21.15.82:0/3907581214 learned_addr learned my addr 172.21.15.82:0/3907581214 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.766+0000 7fe79affd700 1 --2- 172.21.15.82:0/3907581214 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe79b7fe700 1 -- 172.21.15.82:0/3907581214 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 msgr2=0x7fe79c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe79b7fe700 1 --2- 172.21.15.82:0/3907581214 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c0b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe79b7fe700 1 -- 172.21.15.82:0/3907581214 >> v1:172.21.15.134:6789/0 conn(0x7fe79c1591b0 legacy=0x7fe79c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe79b7fe700 1 -- 172.21.15.82:0/3907581214 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c0b2230 con 0x7fe79c15d560 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe79b7fe700 1 --2- 172.21.15.82:0/3907581214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c0d0030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009f20 tx=0x7fe78c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1f9f57dbafcc8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe79a7fc700 1 -- 172.21.15.82:0/3907581214 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00e070 con 0x7fe79c15d560 2023-10-06T03:16:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe79a7fc700 1 -- 172.21.15.82:0/3907581214 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00ba80 con 0x7fe79c15d560 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe79a7fc700 1 -- 172.21.15.82:0/3907581214 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0092e0 con 0x7fe79c15d560 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe7a2020700 1 -- 172.21.15.82:0/3907581214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 msgr2=0x7fe79c0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe7a2020700 1 --2- 172.21.15.82:0/3907581214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c0d0030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009f20 tx=0x7fe78c009840 comp rx=0 tx=0).stop 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe7a2020700 1 -- 172.21.15.82:0/3907581214 shutdown_connections 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe7a2020700 1 --2- 172.21.15.82:0/3907581214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c0d0030 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe7a2020700 1 --2- 172.21.15.82:0/3907581214 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe7a2020700 1 -- 172.21.15.82:0/3907581214 >> 172.21.15.82:0/3907581214 conn(0x7fe79c0d1180 msgr2=0x7fe79c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe7a2020700 1 -- 172.21.15.82:0/3907581214 shutdown_connections 2023-10-06T03:16:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.767+0000 7fe7a2020700 1 -- 172.21.15.82:0/3907581214 wait complete. 2023-10-06T03:16:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe7a2020700 1 Processor -- start 2023-10-06T03:16:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe7a2020700 1 -- start start 2023-10-06T03:16:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe7a2020700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c1591b0 0x7fe79c13f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe7a2020700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe7a2020700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe7a2020700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c13f8a0 con 0x7fe79c15d560 2023-10-06T03:16:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe7a2020700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c13cb70 con 0x7fe79c1591b0 2023-10-06T03:16:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe7a2020700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c13ce50 con 0x7fe79c15d930 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.769+0000 7fe79affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35922/0 (socket says 172.21.15.82:35922) 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79affd700 1 -- 172.21.15.82:0/4241345467 learned_addr learned my addr 172.21.15.82:0/4241345467 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79b7fe700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c1591b0 0x7fe79c13f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79bfff700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79affd700 1 -- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 msgr2=0x7fe79c169d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79affd700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c169d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79affd700 1 -- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c1591b0 msgr2=0x7fe79c13f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79affd700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c1591b0 0x7fe79c13f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79affd700 1 -- 172.21.15.82:0/4241345467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009ae0 con 0x7fe79c15d560 2023-10-06T03:16:22.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79bfff700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe79affd700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c15bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe79000d860 tx=0x7fe790008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe7837fe700 1 -- 172.21.15.82:0/4241345467 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900125f0 con 0x7fe79c15d560 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe7837fe700 1 -- 172.21.15.82:0/4241345467 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe790012750 con 0x7fe79c15d560 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c13d130 con 0x7fe79c15d560 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe7837fe700 1 -- 172.21.15.82:0/4241345467 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790012b10 con 0x7fe79c15d560 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.770+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c13d6f0 con 0x7fe79c15d560 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.771+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c13d8b0 con 0x7fe79c15d560 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.771+0000 7fe7837fe700 1 -- 172.21.15.82:0/4241345467 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe79001e460 con 0x7fe79c15d560 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.772+0000 7fe7837fe700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe788066f60 0x7fe788069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.772+0000 7fe7837fe700 1 -- 172.21.15.82:0/4241345467 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe790084bc0 con 0x7fe79c15d560 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.772+0000 7fe79b7fe700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe788066f60 0x7fe788069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.772+0000 7fe79b7fe700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe788066f60 0x7fe788069410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe79c157910 tx=0x7fe78c018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:22.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.776+0000 7fe7837fe700 1 -- 172.21.15.82:0/4241345467 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe790051cd0 con 0x7fe79c15d560 2023-10-06T03:16:22.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.959+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe79c064050 con 0x7fe79c15d560 2023-10-06T03:16:22.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.960+0000 7fe7837fe700 1 -- 172.21.15.82:0/4241345467 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fe7900552f0 con 0x7fe79c15d560 2023-10-06T03:16:22.961 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:22.961 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:22.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe788066f60 msgr2=0x7fe788069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe788066f60 0x7fe788069410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe79c157910 tx=0x7fe78c018000 comp rx=0 tx=0).stop 2023-10-06T03:16:22.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 msgr2=0x7fe79c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:22.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c15bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe79000d860 tx=0x7fe790008040 comp rx=0 tx=0).stop 2023-10-06T03:16:22.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 shutdown_connections 2023-10-06T03:16:22.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe788066f60 0x7fe788069410 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe79c15d930 0x7fe79c169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79c1591b0 0x7fe79c13f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 --2- 172.21.15.82:0/4241345467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c15d560 0x7fe79c15bf30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:22.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 >> 172.21.15.82:0/4241345467 conn(0x7fe79c0d1180 msgr2=0x7fe79c0b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:22.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 shutdown_connections 2023-10-06T03:16:22.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:22.962+0000 7fe7a2020700 1 -- 172.21.15.82:0/4241345467 wait complete. 2023-10-06T03:16:22.975 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:15:49.404080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:15:50.736320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:16:22.976 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:23.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.092+0000 7f5917894700 1 Processor -- start 2023-10-06T03:16:23.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.092+0000 7f5917894700 1 -- start start 2023-10-06T03:16:23.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5917894700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59101598d0 0x7f591015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5917894700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f591015d8e0 0x7f59100cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5917894700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591015dd20 con 0x7f5910159500 2023-10-06T03:16:23.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5917894700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59100b1110 con 0x7f591015d8e0 2023-10-06T03:16:23.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5917894700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59100b13b0 con 0x7f59101598d0 2023-10-06T03:16:23.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5915630700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5910159500 0x7f59100b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38376/0 (socket says 172.21.15.82:38376) 2023-10-06T03:16:23.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5915630700 1 -- 172.21.15.82:0/2458033312 learned_addr learned my addr 172.21.15.82:0/2458033312 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:23.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317840363 0 0) 0x7f591015dd20 con 0x7f5910159500 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5914e2f700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59101598d0 0x7f591015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58fc003570 con 0x7f5910159500 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5915e31700 1 --2- 172.21.15.82:0/2458033312 >> v2:172.21.15.134:3300/0 conn(0x7f591015d8e0 0x7f59100cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2695031515 0 0) 0x7f58fc003570 con 0x7f5910159500 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59101598d0 msgr2=0x7f591015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59101598d0 0x7f591015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 >> v2:172.21.15.134:3300/0 conn(0x7f591015d8e0 msgr2=0x7f59100cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 --2- 172.21.15.82:0/2458033312 >> v2:172.21.15.134:3300/0 conn(0x7f591015d8e0 0x7f59100cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100b1690 con 0x7f5910159500 2023-10-06T03:16:23.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f590c0017f0 con 0x7f5910159500 2023-10-06T03:16:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 >> v1:172.21.15.82:6789/0 conn(0x7f5910159500 legacy=0x7f59100b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59101598d0 0x7f58fc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58fc003fe0 0x7f58fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc004d50 0x7f58fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59100b1110 con 0x7f58fc003fe0 2023-10-06T03:16:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59100b13b0 con 0x7f58fc004d50 2023-10-06T03:16:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc00ba90 con 0x7f59101598d0 2023-10-06T03:16:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.093+0000 7f5914e2f700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58fc003fe0 0x7f58fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5915630700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59101598d0 0x7f58fc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5915e31700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc004d50 0x7f58fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5914e2f700 1 -- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59101598d0 msgr2=0x7f58fc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5914e2f700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59101598d0 0x7f58fc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5914e2f700 1 -- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc004d50 msgr2=0x7f58fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5914e2f700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc004d50 0x7f58fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5914e2f700 1 -- 172.21.15.82:0/2458033312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc003570 con 0x7f58fc003fe0 2023-10-06T03:16:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5915e31700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc004d50 0x7f58fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5914e2f700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58fc003fe0 0x7f58fc004810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5900009c00 tx=0x7f59000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1260ba784f61e4d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000e6b0 con 0x7f58fc003fe0 2023-10-06T03:16:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590000e810 con 0x7f58fc003fe0 2023-10-06T03:16:23.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.094+0000 7f5907fff700 1 -- 172.21.15.82:0/2458033312 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000ebd0 con 0x7f58fc003fe0 2023-10-06T03:16:23.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.095+0000 7f5917894700 1 -- 172.21.15.82:0/2458033312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58fc003fe0 msgr2=0x7f58fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.095+0000 7f5917894700 1 --2- 172.21.15.82:0/2458033312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58fc003fe0 0x7f58fc004810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5900009c00 tx=0x7f59000091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.095+0000 7f5915e31700 1 -- 172.21.15.82:0/2458033312 reap_dead start 2023-10-06T03:16:23.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.095+0000 7f5917894700 1 -- 172.21.15.82:0/2458033312 shutdown_connections 2023-10-06T03:16:23.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.095+0000 7f5917894700 1 -- 172.21.15.82:0/2458033312 >> 172.21.15.82:0/2458033312 conn(0x7f5910067630 msgr2=0x7f5910069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.095+0000 7f5917894700 1 -- 172.21.15.82:0/2458033312 shutdown_connections 2023-10-06T03:16:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.095+0000 7f5917894700 1 -- 172.21.15.82:0/2458033312 wait complete. 2023-10-06T03:16:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.096+0000 7f5917894700 1 Processor -- start 2023-10-06T03:16:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.096+0000 7f5917894700 1 -- start start 2023-10-06T03:16:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5917894700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58fc003fe0 0x7f5910150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5917894700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f591015b9b0 0x7f5910151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5917894700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5910151ca0 0x7f5910153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5917894700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591015be20 con 0x7f591015b9b0 2023-10-06T03:16:23.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5917894700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59101512d0 con 0x7f5910151ca0 2023-10-06T03:16:23.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5917894700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59101506c0 con 0x7f58fc003fe0 2023-10-06T03:16:23.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f591015b9b0 0x7f5910151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f591015b9b0 0x7f5910151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35932/0 (socket says 172.21.15.82:35932) 2023-10-06T03:16:23.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 -- 172.21.15.82:0/1661405552 learned_addr learned my addr 172.21.15.82:0/1661405552 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:23.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5915630700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58fc003fe0 0x7f5910150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5915e31700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5910151ca0 0x7f5910153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 -- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58fc003fe0 msgr2=0x7f5910150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58fc003fe0 0x7f5910150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 -- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5910151ca0 msgr2=0x7f5910153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5910151ca0 0x7f5910153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 -- 172.21.15.82:0/1661405552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59101509a0 con 0x7f591015b9b0 2023-10-06T03:16:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5914e2f700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f591015b9b0 0x7f5910151760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f59000091e0 tx=0x7f590001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f59057fa700 1 -- 172.21.15.82:0/1661405552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900022070 con 0x7f591015b9b0 2023-10-06T03:16:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f59057fa700 1 -- 172.21.15.82:0/1661405552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590000e980 con 0x7f591015b9b0 2023-10-06T03:16:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5910150c80 con 0x7f591015b9b0 2023-10-06T03:16:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f59057fa700 1 -- 172.21.15.82:0/1661405552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900027470 con 0x7f591015b9b0 2023-10-06T03:16:23.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.097+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591014d9c0 con 0x7f591015b9b0 2023-10-06T03:16:23.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.098+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591015be20 con 0x7f591015b9b0 2023-10-06T03:16:23.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.099+0000 7f59057fa700 1 -- 172.21.15.82:0/1661405552 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f590001c450 con 0x7f591015b9b0 2023-10-06T03:16:23.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.099+0000 7f59057fa700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58f4066f30 0x7f58f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.099+0000 7f59057fa700 1 -- 172.21.15.82:0/1661405552 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5900086270 con 0x7f591015b9b0 2023-10-06T03:16:23.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.099+0000 7f5915630700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58f4066f30 0x7f58f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.099+0000 7f5915630700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58f4066f30 0x7f58f40693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f590c0019a0 tx=0x7f590c006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.103+0000 7f59057fa700 1 -- 172.21.15.82:0/1661405552 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59000534c0 con 0x7f591015b9b0 2023-10-06T03:16:23.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.283+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5910151440 con 0x7f591015b9b0 2023-10-06T03:16:23.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.284+0000 7f59057fa700 1 -- 172.21.15.82:0/1661405552 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59000569a0 con 0x7f591015b9b0 2023-10-06T03:16:23.285 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58f4066f30 msgr2=0x7f58f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58f4066f30 0x7f58f40693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f590c0019a0 tx=0x7f590c006040 comp rx=0 tx=0).stop 2023-10-06T03:16:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f591015b9b0 msgr2=0x7f5910151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f591015b9b0 0x7f5910151760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f59000091e0 tx=0x7f590001a000 comp rx=0 tx=0).stop 2023-10-06T03:16:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 shutdown_connections 2023-10-06T03:16:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5910151ca0 0x7f5910153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58f4066f30 0x7f58f40693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58fc003fe0 0x7f5910150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 --2- 172.21.15.82:0/1661405552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f591015b9b0 0x7f5910151760 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 >> 172.21.15.82:0/1661405552 conn(0x7f5910067630 msgr2=0x7f591015d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 shutdown_connections 2023-10-06T03:16:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.286+0000 7f5917894700 1 -- 172.21.15.82:0/1661405552 wait complete. 2023-10-06T03:16:23.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:23.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.417+0000 7f594c12f700 1 Processor -- start 2023-10-06T03:16:23.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.418+0000 7f594c12f700 1 -- start start 2023-10-06T03:16:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.418+0000 7f594c12f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f594415cb10 0x7f59440af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.418+0000 7f594c12f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440698e0 con 0x7f59440b1690 2023-10-06T03:16:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.418+0000 7f594c12f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594415a260 con 0x7f59440b4000 2023-10-06T03:16:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.418+0000 7f594c12f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5944068fd0 con 0x7f594415cb10 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.418+0000 7f5949ecb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f594415cb10 0x7f59440af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f594a6cc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f59440b1690 0x7f5944069d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38382/0 (socket says 172.21.15.82:38382) 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f594a6cc700 1 -- 172.21.15.82:0/3858384649 learned_addr learned my addr 172.21.15.82:0/3858384649 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f5949ecb700 1 -- 172.21.15.82:0/3858384649 >> v1:172.21.15.134:6789/0 conn(0x7f59440b4000 legacy=0x7f5944159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f5949ecb700 1 -- 172.21.15.82:0/3858384649 >> v1:172.21.15.82:6789/0 conn(0x7f59440b1690 legacy=0x7f5944069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f5949ecb700 1 -- 172.21.15.82:0/3858384649 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59440b0020 con 0x7f594415cb10 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f5948ec9700 1 -- 172.21.15.82:0/3858384649 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280906402 0 0) 0x7f59440698e0 con 0x7f59440b1690 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f5949ecb700 1 --2- 172.21.15.82:0/3858384649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440af780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5940009e60 tx=0x7f5940009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f87594c5fd2579b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f5948ec9700 1 -- 172.21.15.82:0/3858384649 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594000e070 con 0x7f594415cb10 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f5948ec9700 1 -- 172.21.15.82:0/3858384649 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594000bc30 con 0x7f594415cb10 2023-10-06T03:16:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.419+0000 7f5948ec9700 1 -- 172.21.15.82:0/3858384649 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940012430 con 0x7f594415cb10 2023-10-06T03:16:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.420+0000 7f594c12f700 1 -- 172.21.15.82:0/3858384649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 msgr2=0x7f59440af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.420+0000 7f594c12f700 1 --2- 172.21.15.82:0/3858384649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440af780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5940009e60 tx=0x7f5940009780 comp rx=0 tx=0).stop 2023-10-06T03:16:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.420+0000 7f594c12f700 1 -- 172.21.15.82:0/3858384649 shutdown_connections 2023-10-06T03:16:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.420+0000 7f594c12f700 1 --2- 172.21.15.82:0/3858384649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440af780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.420+0000 7f594c12f700 1 -- 172.21.15.82:0/3858384649 >> 172.21.15.82:0/3858384649 conn(0x7f594406d890 msgr2=0x7f594406dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.420+0000 7f594c12f700 1 -- 172.21.15.82:0/3858384649 shutdown_connections 2023-10-06T03:16:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.420+0000 7f594c12f700 1 -- 172.21.15.82:0/3858384649 wait complete. 2023-10-06T03:16:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.421+0000 7f594c12f700 1 Processor -- start 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.421+0000 7f594c12f700 1 -- start start 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.421+0000 7f594c12f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59440b1690 0x7f59440c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.421+0000 7f594c12f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59440b4000 0x7f59440cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.421+0000 7f594c12f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.421+0000 7f594c12f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594414f880 con 0x7f594415cb10 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.421+0000 7f594c12f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440c85c0 con 0x7f59440b1690 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.421+0000 7f594c12f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59440c87d0 con 0x7f59440b4000 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35960/0 (socket says 172.21.15.82:35960) 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 -- 172.21.15.82:0/2133696448 learned_addr learned my addr 172.21.15.82:0/2133696448 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f5949ecb700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59440b1690 0x7f59440c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f59496ca700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59440b4000 0x7f59440cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 -- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59440b4000 msgr2=0x7f59440cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59440b4000 0x7f59440cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 -- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59440b1690 msgr2=0x7f59440c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59440b1690 0x7f59440c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 -- 172.21.15.82:0/2133696448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5940009a20 con 0x7f594415cb10 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f5949ecb700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59440b1690 0x7f59440c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f59496ca700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59440b4000 0x7f59440cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594a6cc700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440cda20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c7e0 tx=0x7f593c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f5939ffb700 1 -- 172.21.15.82:0/2133696448 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c005c00 con 0x7f594415cb10 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f5939ffb700 1 -- 172.21.15.82:0/2133696448 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c005d60 con 0x7f594415cb10 2023-10-06T03:16:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f5939ffb700 1 -- 172.21.15.82:0/2133696448 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c004a80 con 0x7f594415cb10 2023-10-06T03:16:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59440c8ab0 con 0x7f594415cb10 2023-10-06T03:16:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.422+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59440c9070 con 0x7f594415cb10 2023-10-06T03:16:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.423+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5944064050 con 0x7f594415cb10 2023-10-06T03:16:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.423+0000 7f5939ffb700 1 -- 172.21.15.82:0/2133696448 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f593c005030 con 0x7f594415cb10 2023-10-06T03:16:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.424+0000 7f5939ffb700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.424+0000 7f5939ffb700 1 -- 172.21.15.82:0/2133696448 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f593c083ba0 con 0x7f594415cb10 2023-10-06T03:16:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.424+0000 7f5949ecb700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.424+0000 7f5949ecb700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5928066f30 0x7f59280693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5940009e60 tx=0x7f5940018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.428+0000 7f5939ffb700 1 -- 172.21.15.82:0/2133696448 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f593c04b5a0 con 0x7f594415cb10 2023-10-06T03:16:23.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.612+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5944069320 con 0x7f594415cb10 2023-10-06T03:16:23.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.612+0000 7f5939ffb700 1 -- 172.21.15.82:0/2133696448 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f593c050c10 con 0x7f594415cb10 2023-10-06T03:16:23.613 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:23.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5928066f30 msgr2=0x7f59280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5928066f30 0x7f59280693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5940009e60 tx=0x7f5940018000 comp rx=0 tx=0).stop 2023-10-06T03:16:23.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 msgr2=0x7f59440cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440cda20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c7e0 tx=0x7f593c007d90 comp rx=0 tx=0).stop 2023-10-06T03:16:23.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 shutdown_connections 2023-10-06T03:16:23.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f594415cb10 0x7f59440cda20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59440b1690 0x7f59440c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 --2- 172.21.15.82:0/2133696448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59440b4000 0x7f59440cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 >> 172.21.15.82:0/2133696448 conn(0x7f594406d890 msgr2=0x7f5944157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:23.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 shutdown_connections 2023-10-06T03:16:23.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.614+0000 7f594c12f700 1 -- 172.21.15.82:0/2133696448 wait complete. 2023-10-06T03:16:23.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.743+0000 7fa43b31b700 1 Processor -- start 2023-10-06T03:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.743+0000 7fa43b31b700 1 -- start start 2023-10-06T03:16:23.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa43b31b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4341564a0 0x7fa43406e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa43b31b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa4340ab6d0 0x7fa43406eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa43b31b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43415ade0 con 0x7fa4341560d0 2023-10-06T03:16:23.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa43b31b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4340c7180 con 0x7fa4341564a0 2023-10-06T03:16:23.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa43b31b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4340c6850 con 0x7fa4340ab6d0 2023-10-06T03:16:23.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa439b18700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4341564a0 0x7fa43406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa439b18700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4341564a0 0x7fa43406e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35974/0 (socket says 172.21.15.82:35974) 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa439b18700 1 -- 172.21.15.82:0/2748718607 learned_addr learned my addr 172.21.15.82:0/2748718607 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa439b18700 1 -- 172.21.15.82:0/2748718607 >> v2:172.21.15.134:3300/0 conn(0x7fa4340ab6d0 msgr2=0x7fa43406eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa439b18700 1 --2- 172.21.15.82:0/2748718607 >> v2:172.21.15.134:3300/0 conn(0x7fa4340ab6d0 0x7fa43406eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa439b18700 1 -- 172.21.15.82:0/2748718607 >> v1:172.21.15.134:6789/0 conn(0x7fa4341560d0 legacy=0x7fa4340aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa439b18700 1 -- 172.21.15.82:0/2748718607 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340c6b30 con 0x7fa4341564a0 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.744+0000 7fa439b18700 1 --2- 172.21.15.82:0/2748718607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341564a0 0x7fa43406e650 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa4340693c0 tx=0x7fa424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ce72b97a646f05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa439317700 1 -- 172.21.15.82:0/2748718607 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400b820 con 0x7fa4341564a0 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa439317700 1 -- 172.21.15.82:0/2748718607 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42400b980 con 0x7fa4341564a0 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa439317700 1 -- 172.21.15.82:0/2748718607 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400bd20 con 0x7fa4341564a0 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa43b31b700 1 -- 172.21.15.82:0/2748718607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341564a0 msgr2=0x7fa43406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2748718607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341564a0 0x7fa43406e650 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa4340693c0 tx=0x7fa424009250 comp rx=0 tx=0).stop 2023-10-06T03:16:23.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa43b31b700 1 -- 172.21.15.82:0/2748718607 shutdown_connections 2023-10-06T03:16:23.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2748718607 >> v2:172.21.15.134:3300/0 conn(0x7fa4340ab6d0 0x7fa43406eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2748718607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341564a0 0x7fa43406e650 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa43b31b700 1 -- 172.21.15.82:0/2748718607 >> 172.21.15.82:0/2748718607 conn(0x7fa4340cc0e0 msgr2=0x7fa4340cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:23.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa43b31b700 1 -- 172.21.15.82:0/2748718607 shutdown_connections 2023-10-06T03:16:23.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.745+0000 7fa43b31b700 1 -- 172.21.15.82:0/2748718607 wait complete. 2023-10-06T03:16:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.746+0000 7fa43b31b700 1 Processor -- start 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.746+0000 7fa43b31b700 1 -- start start 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa43b31b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4340ab6d0 0x7fa4341590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa43b31b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341560d0 0x7fa434148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa43b31b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4341564a0 0x7fa4341492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa43b31b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa434157700 con 0x7fa4341560d0 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa43b31b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa434142e80 con 0x7fa4340ab6d0 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa43b31b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341439c0 con 0x7fa4341564a0 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa439b18700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341560d0 0x7fa434148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa439b18700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341560d0 0x7fa434148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35976/0 (socket says 172.21.15.82:35976) 2023-10-06T03:16:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa439b18700 1 -- 172.21.15.82:0/2311796983 learned_addr learned my addr 172.21.15.82:0/2311796983 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa43a319700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4340ab6d0 0x7fa4341590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa43ab1a700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4341564a0 0x7fa4341492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa439b18700 1 -- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4341564a0 msgr2=0x7fa4341492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa439b18700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4341564a0 0x7fa4341492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa439b18700 1 -- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4340ab6d0 msgr2=0x7fa4341590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa439b18700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4340ab6d0 0x7fa4341590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.747+0000 7fa439b18700 1 -- 172.21.15.82:0/2311796983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240094f0 con 0x7fa4341560d0 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.748+0000 7fa439b18700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341560d0 0x7fa434148d70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa4240090b0 tx=0x7fa424016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.748+0000 7fa42a7fc700 1 -- 172.21.15.82:0/2311796983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011e20 con 0x7fa4341560d0 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.748+0000 7fa42a7fc700 1 -- 172.21.15.82:0/2311796983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424020070 con 0x7fa4341560d0 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.748+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa434143090 con 0x7fa4341560d0 2023-10-06T03:16:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.748+0000 7fa42a7fc700 1 -- 172.21.15.82:0/2311796983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42401b6a0 con 0x7fa4341560d0 2023-10-06T03:16:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.748+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa434143650 con 0x7fa4341560d0 2023-10-06T03:16:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.749+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa434143b50 con 0x7fa4341560d0 2023-10-06T03:16:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.749+0000 7fa42a7fc700 1 -- 172.21.15.82:0/2311796983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa424022030 con 0x7fa4341560d0 2023-10-06T03:16:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.749+0000 7fa42a7fc700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa418066f30 0x7fa4180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.749+0000 7fa42a7fc700 1 -- 172.21.15.82:0/2311796983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa424086590 con 0x7fa4341560d0 2023-10-06T03:16:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.750+0000 7fa43a319700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa418066f30 0x7fa4180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.750+0000 7fa43a319700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa418066f30 0x7fa4180693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa430009fd0 tx=0x7fa430009620 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.754+0000 7fa42a7fc700 1 -- 172.21.15.82:0/2311796983 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4240536a0 con 0x7fa4341560d0 2023-10-06T03:16:23.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.934+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa434143b50 con 0x7fa4341560d0 2023-10-06T03:16:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.934+0000 7fa42a7fc700 1 -- 172.21.15.82:0/2311796983 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa424056cc0 con 0x7fa4341560d0 2023-10-06T03:16:23.935 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:16:23.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa418066f30 msgr2=0x7fa4180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa418066f30 0x7fa4180693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa430009fd0 tx=0x7fa430009620 comp rx=0 tx=0).stop 2023-10-06T03:16:23.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341560d0 msgr2=0x7fa434148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341560d0 0x7fa434148d70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa4240090b0 tx=0x7fa424016000 comp rx=0 tx=0).stop 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 shutdown_connections 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa418066f30 0x7fa4180693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa4341564a0 0x7fa4341492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4340ab6d0 0x7fa4341590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 --2- 172.21.15.82:0/2311796983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4341560d0 0x7fa434148d70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 >> 172.21.15.82:0/2311796983 conn(0x7fa4340cc0e0 msgr2=0x7fa4340ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 shutdown_connections 2023-10-06T03:16:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:23.936+0000 7fa43b31b700 1 -- 172.21.15.82:0/2311796983 wait complete. 2023-10-06T03:16:23.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:16:24.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.065+0000 7f13e1f12700 1 Processor -- start 2023-10-06T03:16:24.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.065+0000 7f13e1f12700 1 -- start start 2023-10-06T03:16:24.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13e1f12700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13dc157b50 0x7f13dc0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13e1f12700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f13dc158630 0x7f13dc161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13e1f12700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc159a60 con 0x7f13dc0cdb30 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13e1f12700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc0cdfb0 con 0x7f13dc157b50 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13e1f12700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc158e50 con 0x7f13dc158630 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13db7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13dc157b50 0x7f13dc0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13daffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f13dc0cdb30 0x7f13dc157f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38398/0 (socket says 172.21.15.82:38398) 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13daffd700 1 -- 172.21.15.82:0/2874767384 learned_addr learned my addr 172.21.15.82:0/2874767384 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.066+0000 7f13dbfff700 1 --2- 172.21.15.82:0/2874767384 >> v2:172.21.15.134:3300/0 conn(0x7f13dc158630 0x7f13dc161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13db7fe700 1 -- 172.21.15.82:0/2874767384 >> v2:172.21.15.134:3300/0 conn(0x7f13dc158630 msgr2=0x7f13dc161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13db7fe700 1 --2- 172.21.15.82:0/2874767384 >> v2:172.21.15.134:3300/0 conn(0x7f13dc158630 0x7f13dc161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13db7fe700 1 -- 172.21.15.82:0/2874767384 >> v1:172.21.15.82:6789/0 conn(0x7f13dc0cdb30 legacy=0x7f13dc157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13db7fe700 1 -- 172.21.15.82:0/2874767384 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc159130 con 0x7f13dc157b50 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13da7fc700 1 -- 172.21.15.82:0/2874767384 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573226083 0 0) 0x7f13dc159a60 con 0x7f13dc0cdb30 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13db7fe700 1 --2- 172.21.15.82:0/2874767384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc157b50 0x7f13dc0cd5f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0b14e0 tx=0x7f13cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2239b7c56f4cb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13da7fc700 1 -- 172.21.15.82:0/2874767384 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00b6b0 con 0x7f13dc157b50 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13da7fc700 1 -- 172.21.15.82:0/2874767384 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc00b810 con 0x7f13dc157b50 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13da7fc700 1 -- 172.21.15.82:0/2874767384 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00bbb0 con 0x7f13dc157b50 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13e1f12700 1 -- 172.21.15.82:0/2874767384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc157b50 msgr2=0x7f13dc0cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13e1f12700 1 --2- 172.21.15.82:0/2874767384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc157b50 0x7f13dc0cd5f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0b14e0 tx=0x7f13cc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13e1f12700 1 -- 172.21.15.82:0/2874767384 shutdown_connections 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13e1f12700 1 --2- 172.21.15.82:0/2874767384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc157b50 0x7f13dc0cd5f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13e1f12700 1 --2- 172.21.15.82:0/2874767384 >> v2:172.21.15.134:3300/0 conn(0x7f13dc158630 0x7f13dc161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13e1f12700 1 -- 172.21.15.82:0/2874767384 >> 172.21.15.82:0/2874767384 conn(0x7f13dc06d890 msgr2=0x7f13dc06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:24.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13e1f12700 1 -- 172.21.15.82:0/2874767384 shutdown_connections 2023-10-06T03:16:24.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.067+0000 7f13e1f12700 1 -- 172.21.15.82:0/2874767384 wait complete. 2023-10-06T03:16:24.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.069+0000 7f13e1f12700 1 Processor -- start 2023-10-06T03:16:24.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.069+0000 7f13e1f12700 1 -- start start 2023-10-06T03:16:24.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.069+0000 7f13e1f12700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13dc0cdb30 0x7f13dc154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.069+0000 7f13e1f12700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13dc157b50 0x7f13dc1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.069+0000 7f13e1f12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc158630 0x7f13dc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.069+0000 7f13e1f12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc1546d0 con 0x7f13dc158630 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.069+0000 7f13e1f12700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc153ac0 con 0x7f13dc157b50 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.069+0000 7f13e1f12700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc153da0 con 0x7f13dc0cdb30 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc158630 0x7f13dc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc158630 0x7f13dc13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35990/0 (socket says 172.21.15.82:35990) 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 -- 172.21.15.82:0/1958252049 learned_addr learned my addr 172.21.15.82:0/1958252049 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13db7fe700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13dc0cdb30 0x7f13dc154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13daffd700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13dc157b50 0x7f13dc1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 -- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13dc0cdb30 msgr2=0x7f13dc154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13dc0cdb30 0x7f13dc154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 -- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13dc157b50 msgr2=0x7f13dc1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13dc157b50 0x7f13dc1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 -- 172.21.15.82:0/1958252049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc009420 con 0x7f13dc158630 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13dbfff700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc158630 0x7f13dc13a980 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f13d4007f20 tx=0x7f13d4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13c37fe700 1 -- 172.21.15.82:0/1958252049 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d400eca0 con 0x7f13dc158630 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13c37fe700 1 -- 172.21.15.82:0/1958252049 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d400ee20 con 0x7f13dc158630 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc154080 con 0x7f13dc158630 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13c37fe700 1 -- 172.21.15.82:0/1958252049 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4014670 con 0x7f13dc158630 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.070+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc1573b0 con 0x7f13dc158630 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.071+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc154880 con 0x7f13dc158630 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.071+0000 7f13c37fe700 1 -- 172.21.15.82:0/1958252049 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13d40149e0 con 0x7f13dc158630 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.072+0000 7f13c37fe700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13c8066f30 0x7f13c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.072+0000 7f13c37fe700 1 -- 172.21.15.82:0/1958252049 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13d4084dc0 con 0x7f13dc158630 2023-10-06T03:16:24.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.072+0000 7f13db7fe700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13c8066f30 0x7f13c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.072+0000 7f13db7fe700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13c8066f30 0x7f13c80693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0093f0 tx=0x7f13cc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.076+0000 7f13c37fe700 1 -- 172.21.15.82:0/1958252049 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13d4051ed0 con 0x7f13dc158630 2023-10-06T03:16:24.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.257+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13dc064050 con 0x7f13dc158630 2023-10-06T03:16:24.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.257+0000 7f13c37fe700 1 -- 172.21.15.82:0/1958252049 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13d40554f0 con 0x7f13dc158630 2023-10-06T03:16:24.258 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13c8066f30 msgr2=0x7f13c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13c8066f30 0x7f13c80693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0093f0 tx=0x7f13cc017000 comp rx=0 tx=0).stop 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc158630 msgr2=0x7f13dc13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc158630 0x7f13dc13a980 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f13d4007f20 tx=0x7f13d4009860 comp rx=0 tx=0).stop 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 shutdown_connections 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13dc158630 0x7f13dc13a980 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f13c8066f30 0x7f13c80693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f13dc0cdb30 0x7f13dc154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 --2- 172.21.15.82:0/1958252049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13dc157b50 0x7f13dc1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 >> 172.21.15.82:0/1958252049 conn(0x7f13dc06d890 msgr2=0x7f13dc14ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:24.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 shutdown_connections 2023-10-06T03:16:24.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.259+0000 7f13e1f12700 1 -- 172.21.15.82:0/1958252049 wait complete. 2023-10-06T03:16:24.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.384+0000 7f65d7533700 1 Processor -- start 2023-10-06T03:16:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.385+0000 7f65d7533700 1 -- start start 2023-10-06T03:16:24.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.385+0000 7f65d7533700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f65d01596c0 0x7f65d015d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.385+0000 7f65d7533700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d00b09a0 0x7f65d00c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.385+0000 7f65d7533700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d015e3a0 con 0x7f65d015d960 2023-10-06T03:16:24.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.385+0000 7f65d7533700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d00cc470 con 0x7f65d01596c0 2023-10-06T03:16:24.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.385+0000 7f65d7533700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d015dde0 con 0x7f65d00b09a0 2023-10-06T03:16:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d4ace700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d00b09a0 0x7f65d00c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d52cf700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f65d01596c0 0x7f65d015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d4ace700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d00b09a0 0x7f65d00c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:34356/0 (socket says 172.21.15.82:34356) 2023-10-06T03:16:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d4ace700 1 -- 172.21.15.82:0/3661889061 learned_addr learned my addr 172.21.15.82:0/3661889061 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d52cf700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f65d01596c0 0x7f65d015d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39546/0 (socket says 172.21.15.82:39546) 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d5ad0700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f65d015d960 0x7f65d0068fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:48592/0 (socket says 172.21.15.82:48592) 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d4ace700 1 -- 172.21.15.82:0/3661889061 >> v2:172.21.15.134:3300/0 conn(0x7f65d01596c0 msgr2=0x7f65d015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d4ace700 1 --2- 172.21.15.82:0/3661889061 >> v2:172.21.15.134:3300/0 conn(0x7f65d01596c0 0x7f65d015d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d4ace700 1 -- 172.21.15.82:0/3661889061 >> v1:172.21.15.134:6789/0 conn(0x7f65d015d960 legacy=0x7f65d0068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d4ace700 1 -- 172.21.15.82:0/3661889061 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d015e0c0 con 0x7f65d00b09a0 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.386+0000 7f65d4ace700 1 --2- 172.21.15.82:0/3661889061 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d00b09a0 0x7f65d00c8a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65c00099b0 tx=0x7f65c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f122371237b8af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65c7fff700 1 -- 172.21.15.82:0/3661889061 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0009ea0 con 0x7f65d00b09a0 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65c7fff700 1 -- 172.21.15.82:0/3661889061 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c000b860 con 0x7f65d00b09a0 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65c7fff700 1 -- 172.21.15.82:0/3661889061 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000bc00 con 0x7f65d00b09a0 2023-10-06T03:16:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65d7533700 1 -- 172.21.15.82:0/3661889061 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d00b09a0 msgr2=0x7f65d00c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65d7533700 1 --2- 172.21.15.82:0/3661889061 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d00b09a0 0x7f65d00c8a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65c00099b0 tx=0x7f65c0009250 comp rx=0 tx=0).stop 2023-10-06T03:16:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65d7533700 1 -- 172.21.15.82:0/3661889061 shutdown_connections 2023-10-06T03:16:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65d7533700 1 --2- 172.21.15.82:0/3661889061 >> v2:172.21.15.134:3300/0 conn(0x7f65d01596c0 0x7f65d015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65d7533700 1 --2- 172.21.15.82:0/3661889061 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d00b09a0 0x7f65d00c8a40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65d7533700 1 -- 172.21.15.82:0/3661889061 >> 172.21.15.82:0/3661889061 conn(0x7f65d0067630 msgr2=0x7f65d0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65d7533700 1 -- 172.21.15.82:0/3661889061 shutdown_connections 2023-10-06T03:16:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.387+0000 7f65d7533700 1 -- 172.21.15.82:0/3661889061 wait complete. 2023-10-06T03:16:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.388+0000 7f65d7533700 1 Processor -- start 2023-10-06T03:16:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.388+0000 7f65d7533700 1 -- start start 2023-10-06T03:16:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d7533700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d01596c0 0x7f65d016d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d7533700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d00c8f20 0x7f65d015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d7533700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65d01576a0 0x7f65d015f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d7533700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d016d4b0 con 0x7f65d00c8f20 2023-10-06T03:16:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d7533700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d015b640 con 0x7f65d01576a0 2023-10-06T03:16:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d7533700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d016ce60 con 0x7f65d01596c0 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d4ace700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d00c8f20 0x7f65d015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d4ace700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d00c8f20 0x7f65d015adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35992/0 (socket says 172.21.15.82:35992) 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d4ace700 1 -- 172.21.15.82:0/1100707178 learned_addr learned my addr 172.21.15.82:0/1100707178 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d5ad0700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65d01576a0 0x7f65d015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.389+0000 7f65d52cf700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d01596c0 0x7f65d016d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65d4ace700 1 -- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d01596c0 msgr2=0x7f65d016d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65d4ace700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d01596c0 0x7f65d016d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65d4ace700 1 -- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65d01576a0 msgr2=0x7f65d015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65d4ace700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65d01576a0 0x7f65d015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65d4ace700 1 -- 172.21.15.82:0/1100707178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00094f0 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65d4ace700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d00c8f20 0x7f65d015adf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f65d015df20 tx=0x7f65c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65c57fa700 1 -- 172.21.15.82:0/1100707178 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000bbe0 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65c57fa700 1 -- 172.21.15.82:0/1100707178 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c0011420 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d016d140 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65c57fa700 1 -- 172.21.15.82:0/1100707178 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00117c0 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.390+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d015b920 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.391+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d0064050 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.391+0000 7f65c57fa700 1 -- 172.21.15.82:0/1100707178 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65c0011b70 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.392+0000 7f65c57fa700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f65b4066f30 0x7f65b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.392+0000 7f65c57fa700 1 -- 172.21.15.82:0/1100707178 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65c0086020 con 0x7f65d00c8f20 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.392+0000 7f65d52cf700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f65b4066f30 0x7f65b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.392+0000 7f65d52cf700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f65b4066f30 0x7f65b40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009d40 tx=0x7f65cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.396+0000 7f65c57fa700 1 -- 172.21.15.82:0/1100707178 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65c0053130 con 0x7f65d00c8f20 2023-10-06T03:16:24.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.623+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65d016d5f0 con 0x7f65d00c8f20 2023-10-06T03:16:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.623+0000 7f65c57fa700 1 -- 172.21.15.82:0/1100707178 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f65c0056750 con 0x7f65d00c8f20 2023-10-06T03:16:24.624 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:24.624 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:15:51.763473+0000","modified":"2023-10-06T03:15:55.399812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:16:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f65b4066f30 msgr2=0x7f65b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f65b4066f30 0x7f65b40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009d40 tx=0x7f65cc008040 comp rx=0 tx=0).stop 2023-10-06T03:16:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d00c8f20 msgr2=0x7f65d015adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d00c8f20 0x7f65d015adf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f65d015df20 tx=0x7f65c0017000 comp rx=0 tx=0).stop 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 shutdown_connections 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65d01576a0 0x7f65d015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f65b4066f30 0x7f65b40693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65d01596c0 0x7f65d016d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 --2- 172.21.15.82:0/1100707178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d00c8f20 0x7f65d015adf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 >> 172.21.15.82:0/1100707178 conn(0x7f65d0067630 msgr2=0x7f65d00b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 shutdown_connections 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.625+0000 7f65d7533700 1 -- 172.21.15.82:0/1100707178 wait complete. 2023-10-06T03:16:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-10-06T03:16:24.638 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.751+0000 7f9dbf2c6700 1 Processor -- start 2023-10-06T03:16:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.751+0000 7f9dbf2c6700 1 -- start start 2023-10-06T03:16:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.752+0000 7f9dbf2c6700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9db80cbe50 0x7f9db80c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.752+0000 7f9dbf2c6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9db80c6bf0 0x7f9db80ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.752+0000 7f9dbf2c6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db80ae140 con 0x7f9db80cdc00 2023-10-06T03:16:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.752+0000 7f9dbf2c6700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db80c7070 con 0x7f9db80cbe50 2023-10-06T03:16:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.752+0000 7f9dbf2c6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80cc2a0 con 0x7f9db80c6bf0 2023-10-06T03:16:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.752+0000 7f9dbd062700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9db80cdc00 0x7f9db80d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38412/0 (socket says 172.21.15.82:38412) 2023-10-06T03:16:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.752+0000 7f9dbd062700 1 -- 172.21.15.82:0/1714340514 learned_addr learned my addr 172.21.15.82:0/1714340514 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759413369 0 0) 0x7f9db80ae140 con 0x7f9db80cdc00 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da4003570 con 0x7f9db80cdc00 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbd863700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9db80c6bf0 0x7f9db80ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbc861700 1 --2- 172.21.15.82:0/1714340514 >> v2:172.21.15.134:3300/0 conn(0x7f9db80cbe50 0x7f9db80c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1201339880 0 0) 0x7f9da4003570 con 0x7f9db80cdc00 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9db80c6bf0 msgr2=0x7f9db80ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9db80c6bf0 0x7f9db80ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 >> v2:172.21.15.134:3300/0 conn(0x7f9db80cbe50 msgr2=0x7f9db80c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 --2- 172.21.15.82:0/1714340514 >> v2:172.21.15.134:3300/0 conn(0x7f9db80cbe50 0x7f9db80c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80ad530 con 0x7f9db80cdc00 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f9db4001970 con 0x7f9db80cdc00 2023-10-06T03:16:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 >> v1:172.21.15.82:6789/0 conn(0x7f9db80cdc00 legacy=0x7f9db80d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9da4003a60 0x7f9da4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da4004810 0x7f9da4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9db80c6bf0 0x7f9da40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80c7070 con 0x7f9da4004810 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80cc2a0 con 0x7f9da4003a60 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da400ba60 con 0x7f9db80c6bf0 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbc861700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da4004810 0x7f9da4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbd863700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9db80c6bf0 0x7f9da40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbd062700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9da4003a60 0x7f9da4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbc861700 1 -- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9db80c6bf0 msgr2=0x7f9da40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbc861700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9db80c6bf0 0x7f9da40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbc861700 1 -- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9da4003a60 msgr2=0x7f9da4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbc861700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9da4003a60 0x7f9da4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbc861700 1 -- 172.21.15.82:0/1714340514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4003570 con 0x7f9da4004810 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbd062700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9da4003a60 0x7f9da4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.753+0000 7f9dbc861700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da4004810 0x7f9da4004c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009c30 tx=0x7f9da80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3805ab9119bdee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800e710 con 0x7f9da4004810 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da800e870 con 0x7f9da4004810 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9daffff700 1 -- 172.21.15.82:0/1714340514 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800ec30 con 0x7f9da4004810 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/1714340514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da4004810 msgr2=0x7f9da4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9dbf2c6700 1 --2- 172.21.15.82:0/1714340514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da4004810 0x7f9da4004c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009c30 tx=0x7f9da80091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9dbd863700 1 -- 172.21.15.82:0/1714340514 reap_dead start 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/1714340514 shutdown_connections 2023-10-06T03:16:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/1714340514 >> 172.21.15.82:0/1714340514 conn(0x7f9db8099990 msgr2=0x7f9db80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/1714340514 shutdown_connections 2023-10-06T03:16:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.754+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/1714340514 wait complete. 2023-10-06T03:16:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.755+0000 7f9dbf2c6700 1 Processor -- start 2023-10-06T03:16:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.755+0000 7f9dbf2c6700 1 -- start start 2023-10-06T03:16:24.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbf2c6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9da4004810 0x7f9db80ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbf2c6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8155480 0x7f9db816a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbf2c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db81578b0 0x7f9db8157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbf2c6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8156f00 con 0x7f9db81578b0 2023-10-06T03:16:24.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbf2c6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8158270 con 0x7f9db8155480 2023-10-06T03:16:24.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbf2c6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80ca7f0 con 0x7f9da4004810 2023-10-06T03:16:24.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbd863700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db81578b0 0x7f9db8157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbd863700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db81578b0 0x7f9db8157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36010/0 (socket says 172.21.15.82:36010) 2023-10-06T03:16:24.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.756+0000 7f9dbd863700 1 -- 172.21.15.82:0/212362598 learned_addr learned my addr 172.21.15.82:0/212362598 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dbd863700 1 -- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9da4004810 msgr2=0x7f9db80ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dbd863700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9da4004810 0x7f9db80ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dbd863700 1 -- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8155480 msgr2=0x7f9db816a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dbd863700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8155480 0x7f9db816a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dbd863700 1 -- 172.21.15.82:0/212362598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8156a70 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dbd863700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db81578b0 0x7f9db8157d30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006f00 tx=0x7f9db00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dad7fa700 1 -- 172.21.15.82:0/212362598 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0011ed0 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dad7fa700 1 -- 172.21.15.82:0/212362598 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db000f940 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db8155e60 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dad7fa700 1 -- 172.21.15.82:0/212362598 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db000fce0 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.757+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db8156420 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.758+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db8064050 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.758+0000 7f9dad7fa700 1 -- 172.21.15.82:0/212362598 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9db0014650 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.759+0000 7f9dad7fa700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9d9c066f30 0x7f9d9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.759+0000 7f9dad7fa700 1 -- 172.21.15.82:0/212362598 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9db0084bb0 con 0x7f9db81578b0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.759+0000 7f9dbd062700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9d9c066f30 0x7f9d9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:24.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.759+0000 7f9dbd062700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9d9c066f30 0x7f9d9c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9db4001270 tx=0x7f9db4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:24.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.763+0000 7f9dad7fa700 1 -- 172.21.15.82:0/212362598 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9db0051d40 con 0x7f9db81578b0 2023-10-06T03:16:24.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.946+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9db8156c00 con 0x7f9db81578b0 2023-10-06T03:16:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.947+0000 7f9dad7fa700 1 -- 172.21.15.82:0/212362598 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f9db0022090 con 0x7f9db81578b0 2023-10-06T03:16:24.947 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:24.948 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9d9c066f30 msgr2=0x7f9d9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9d9c066f30 0x7f9d9c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9db4001270 tx=0x7f9db4009040 comp rx=0 tx=0).stop 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db81578b0 msgr2=0x7f9db8157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db81578b0 0x7f9db8157d30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006f00 tx=0x7f9db00091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 shutdown_connections 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db81578b0 0x7f9db8157d30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9d9c066f30 0x7f9d9c0693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9da4004810 0x7f9db80ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 --2- 172.21.15.82:0/212362598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9db8155480 0x7f9db816a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 >> 172.21.15.82:0/212362598 conn(0x7f9db8099990 msgr2=0x7f9db806a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 shutdown_connections 2023-10-06T03:16:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:24.949+0000 7f9dbf2c6700 1 -- 172.21.15.82:0/212362598 wait complete. 2023-10-06T03:16:24.962 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:16:24.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.075+0000 7f71bc8c4700 1 Processor -- start 2023-10-06T03:16:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.075+0000 7f71bc8c4700 1 -- start start 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71bc8c4700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71b815d850 0x7f71b80b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71bc8c4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71b80b6170 0x7f71b80b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71bc8c4700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b8069f70 con 0x7f71b815d480 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71bc8c4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80687c0 con 0x7f71b80b6170 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71bc8c4700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b8068aa0 con 0x7f71b815d850 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71b80b6170 0x7f71b80b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71b80b6170 0x7f71b80b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36026/0 (socket says 172.21.15.82:36026) 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b759e700 1 -- 172.21.15.82:0/1368054926 learned_addr learned my addr 172.21.15.82:0/1368054926 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b659c700 1 --2- 172.21.15.82:0/1368054926 >> v2:172.21.15.134:3300/0 conn(0x7f71b815d850 0x7f71b80b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b759e700 1 -- 172.21.15.82:0/1368054926 >> v2:172.21.15.134:3300/0 conn(0x7f71b815d850 msgr2=0x7f71b80b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b759e700 1 --2- 172.21.15.82:0/1368054926 >> v2:172.21.15.134:3300/0 conn(0x7f71b815d850 0x7f71b80b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b759e700 1 -- 172.21.15.82:0/1368054926 >> v1:172.21.15.134:6789/0 conn(0x7f71b815d480 legacy=0x7f71b8069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b759e700 1 -- 172.21.15.82:0/1368054926 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8068d80 con 0x7f71b80b6170 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b759e700 1 --2- 172.21.15.82:0/1368054926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b80b6170 0x7f71b80b0310 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f71b80d0180 tx=0x7f71a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8c962de57fb388 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b5d9b700 1 -- 172.21.15.82:0/1368054926 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800e070 con 0x7f71b80b6170 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b5d9b700 1 -- 172.21.15.82:0/1368054926 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800ba10 con 0x7f71b80b6170 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.076+0000 7f71b5d9b700 1 -- 172.21.15.82:0/1368054926 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80092e0 con 0x7f71b80b6170 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.077+0000 7f71bc8c4700 1 -- 172.21.15.82:0/1368054926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b80b6170 msgr2=0x7f71b80b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.077+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/1368054926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b80b6170 0x7f71b80b0310 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f71b80d0180 tx=0x7f71a8009840 comp rx=0 tx=0).stop 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.077+0000 7f71bc8c4700 1 -- 172.21.15.82:0/1368054926 shutdown_connections 2023-10-06T03:16:25.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.077+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/1368054926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b80b6170 0x7f71b80b0310 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.077+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/1368054926 >> v2:172.21.15.134:3300/0 conn(0x7f71b815d850 0x7f71b80b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.077+0000 7f71bc8c4700 1 -- 172.21.15.82:0/1368054926 >> 172.21.15.82:0/1368054926 conn(0x7f71b80ccf80 msgr2=0x7f71b80cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:25.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.077+0000 7f71bc8c4700 1 -- 172.21.15.82:0/1368054926 shutdown_connections 2023-10-06T03:16:25.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.077+0000 7f71bc8c4700 1 -- 172.21.15.82:0/1368054926 wait complete. 2023-10-06T03:16:25.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.078+0000 7f71bc8c4700 1 Processor -- start 2023-10-06T03:16:25.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.078+0000 7f71bc8c4700 1 -- start start 2023-10-06T03:16:25.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71bc8c4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b80b6170 0x7f71b8140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71bc8c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b815d480 0x7f71b80c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71bc8c4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b815d850 0x7f71b80c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71bc8c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80c7030 con 0x7f71b815d480 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71bc8c4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80c6420 con 0x7f71b815d850 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71bc8c4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80c6700 con 0x7f71b80b6170 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b815d480 0x7f71b80c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b815d480 0x7f71b80c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36032/0 (socket says 172.21.15.82:36032) 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 -- 172.21.15.82:0/3927906068 learned_addr learned my addr 172.21.15.82:0/3927906068 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b6d9d700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b80b6170 0x7f71b8140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b759e700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b815d850 0x7f71b80c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 -- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b80b6170 msgr2=0x7f71b8140660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b80b6170 0x7f71b8140660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 -- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b815d850 msgr2=0x7f71b80c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b815d850 0x7f71b80c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 -- 172.21.15.82:0/3927906068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009ae0 con 0x7f71b815d480 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b6d9d700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b80b6170 0x7f71b8140660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b759e700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b815d850 0x7f71b80c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71b659c700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b815d480 0x7f71b80c97a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c880 tx=0x7f71a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.079+0000 7f71aeffd700 1 -- 172.21.15.82:0/3927906068 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0011600 con 0x7f71b815d480 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.080+0000 7f71aeffd700 1 -- 172.21.15.82:0/3927906068 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a0011780 con 0x7f71b815d480 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.080+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b80c69e0 con 0x7f71b815d480 2023-10-06T03:16:25.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.080+0000 7f71aeffd700 1 -- 172.21.15.82:0/3927906068 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0011b40 con 0x7f71b815d480 2023-10-06T03:16:25.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.080+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b80c87e0 con 0x7f71b815d480 2023-10-06T03:16:25.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.080+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b804c3c0 con 0x7f71b815d480 2023-10-06T03:16:25.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.081+0000 7f71aeffd700 1 -- 172.21.15.82:0/3927906068 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71a0018360 con 0x7f71b815d480 2023-10-06T03:16:25.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.081+0000 7f71aeffd700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7198066f30 0x7f71980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.081+0000 7f71aeffd700 1 -- 172.21.15.82:0/3927906068 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71a0084390 con 0x7f71b815d480 2023-10-06T03:16:25.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.081+0000 7f71b6d9d700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7198066f30 0x7f71980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.082+0000 7f71b6d9d700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7198066f30 0x7f71980693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f71b0006fd0 tx=0x7f71b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.085+0000 7f71aeffd700 1 -- 172.21.15.82:0/3927906068 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71a0054f30 con 0x7f71b815d480 2023-10-06T03:16:25.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.311+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71b8069060 con 0x7f71b815d480 2023-10-06T03:16:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.311+0000 7f71aeffd700 1 -- 172.21.15.82:0/3927906068 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f71a0054ac0 con 0x7f71b815d480 2023-10-06T03:16:25.312 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:25.312 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:15:51.763473+0000","modified":"2023-10-06T03:15:55.399812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7198066f30 msgr2=0x7f71980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7198066f30 0x7f71980693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f71b0006fd0 tx=0x7f71b0008040 comp rx=0 tx=0).stop 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b815d480 msgr2=0x7f71b80c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b815d480 0x7f71b80c97a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c880 tx=0x7f71a0008040 comp rx=0 tx=0).stop 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 shutdown_connections 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b815d850 0x7f71b80c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7198066f30 0x7f71980693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b80b6170 0x7f71b8140660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 --2- 172.21.15.82:0/3927906068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71b815d480 0x7f71b80c97a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 >> 172.21.15.82:0/3927906068 conn(0x7f71b80ccf80 msgr2=0x7f71b80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 shutdown_connections 2023-10-06T03:16:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.314+0000 7f71bc8c4700 1 -- 172.21.15.82:0/3927906068 wait complete. 2023-10-06T03:16:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-10-06T03:16:25.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:25.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.440+0000 7f7416eb6700 1 Processor -- start 2023-10-06T03:16:25.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.440+0000 7f7416eb6700 1 -- start start 2023-10-06T03:16:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f7416eb6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f741015d930 0x7f74100d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f7416eb6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74101591b0 0x7f7410159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f7416eb6700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74100b2ad0 con 0x7f741015d560 2023-10-06T03:16:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f7416eb6700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74100b4160 con 0x7f741015d930 2023-10-06T03:16:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f7416eb6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7410159b70 con 0x7f74101591b0 2023-10-06T03:16:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f741015d930 0x7f74100d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f741015d930 0x7f74100d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36042/0 (socket says 172.21.15.82:36042) 2023-10-06T03:16:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740ffff700 1 -- 172.21.15.82:0/1525942416 learned_addr learned my addr 172.21.15.82:0/1525942416 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f7415453700 1 --2- 172.21.15.82:0/1525942416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74101591b0 0x7f7410159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740ffff700 1 -- 172.21.15.82:0/1525942416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74101591b0 msgr2=0x7f7410159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740ffff700 1 --2- 172.21.15.82:0/1525942416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74101591b0 0x7f7410159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740ffff700 1 -- 172.21.15.82:0/1525942416 >> v1:172.21.15.134:6789/0 conn(0x7f741015d560 legacy=0x7f74100b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740ffff700 1 -- 172.21.15.82:0/1525942416 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100b2230 con 0x7f741015d930 2023-10-06T03:16:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740ffff700 1 --2- 172.21.15.82:0/1525942416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100d0030 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0099b0 tx=0x7f73fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d74a693b5246b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740f7fe700 1 -- 172.21.15.82:0/1525942416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00b820 con 0x7f741015d930 2023-10-06T03:16:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740f7fe700 1 -- 172.21.15.82:0/1525942416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc00b980 con 0x7f741015d930 2023-10-06T03:16:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.441+0000 7f740f7fe700 1 -- 172.21.15.82:0/1525942416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00bd20 con 0x7f741015d930 2023-10-06T03:16:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.442+0000 7f7416eb6700 1 -- 172.21.15.82:0/1525942416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 msgr2=0x7f74100d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.442+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1525942416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100d0030 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0099b0 tx=0x7f73fc009250 comp rx=0 tx=0).stop 2023-10-06T03:16:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.442+0000 7f7416eb6700 1 -- 172.21.15.82:0/1525942416 shutdown_connections 2023-10-06T03:16:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.442+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1525942416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74101591b0 0x7f7410159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.442+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1525942416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100d0030 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.442+0000 7f7416eb6700 1 -- 172.21.15.82:0/1525942416 >> 172.21.15.82:0/1525942416 conn(0x7f74100d1180 msgr2=0x7f7410069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.442+0000 7f7416eb6700 1 -- 172.21.15.82:0/1525942416 shutdown_connections 2023-10-06T03:16:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.442+0000 7f7416eb6700 1 -- 172.21.15.82:0/1525942416 wait complete. 2023-10-06T03:16:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.443+0000 7f7416eb6700 1 Processor -- start 2023-10-06T03:16:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.443+0000 7f7416eb6700 1 -- start start 2023-10-06T03:16:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7416eb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74101591b0 0x7f741014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7416eb6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f741015d560 0x7f74100ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7416eb6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7416eb6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100a8f50 con 0x7f741015d930 2023-10-06T03:16:25.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7416eb6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100a97b0 con 0x7f74101591b0 2023-10-06T03:16:25.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7416eb6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74100aede0 con 0x7f741015d560 2023-10-06T03:16:25.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36056/0 (socket says 172.21.15.82:36056) 2023-10-06T03:16:25.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 -- 172.21.15.82:0/1769675519 learned_addr learned my addr 172.21.15.82:0/1769675519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:25.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 -- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f741015d560 msgr2=0x7f74100ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f740ffff700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f741015d560 0x7f74100ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7414c52700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74101591b0 0x7f741014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f741015d560 0x7f74100ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 -- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74101591b0 msgr2=0x7f741014b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74101591b0 0x7f741014b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 -- 172.21.15.82:0/1769675519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc0094f0 con 0x7f741015d930 2023-10-06T03:16:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7414c52700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74101591b0 0x7f741014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.444+0000 7f7415453700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100b1460 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7408009fa0 tx=0x7f7408009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.445+0000 7f740cff9700 1 -- 172.21.15.82:0/1769675519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800ed20 con 0x7f741015d930 2023-10-06T03:16:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.445+0000 7f740cff9700 1 -- 172.21.15.82:0/1769675519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740800ee80 con 0x7f741015d930 2023-10-06T03:16:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.445+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74100a9160 con 0x7f741015d930 2023-10-06T03:16:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.445+0000 7f740cff9700 1 -- 172.21.15.82:0/1769675519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408014670 con 0x7f741015d930 2023-10-06T03:16:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.445+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7410169a60 con 0x7f741015d930 2023-10-06T03:16:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.446+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74100a9920 con 0x7f741015d930 2023-10-06T03:16:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.446+0000 7f740cff9700 1 -- 172.21.15.82:0/1769675519 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74080149e0 con 0x7f741015d930 2023-10-06T03:16:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.446+0000 7f740cff9700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.446+0000 7f740cff9700 1 -- 172.21.15.82:0/1769675519 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7408084e80 con 0x7f741015d930 2023-10-06T03:16:25.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.447+0000 7f7414c52700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.447+0000 7f7414c52700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73f4066f30 0x7f73f40693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7404002880 tx=0x7f7404009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.450+0000 7f740cff9700 1 -- 172.21.15.82:0/1769675519 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7408051f90 con 0x7f741015d930 2023-10-06T03:16:25.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.675+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7410064050 con 0x7f741015d930 2023-10-06T03:16:25.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.675+0000 7f740cff9700 1 -- 172.21.15.82:0/1769675519 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f74080555b0 con 0x7f741015d930 2023-10-06T03:16:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:25.676 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/24612835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":24612835},{"type":"v1","addr":"172.21.15.82:6833","nonce":24612835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2814699530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2814699530},{"type":"v1","addr":"172.21.15.82:6835","nonce":2814699530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3893570907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3893570907},{"type":"v1","addr":"172.21.15.134:6836","nonce":3893570907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:15:51.763473+0000","modified":"2023-10-06T03:15:55.399812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/585628338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":585628338},{"type":"v1","addr":"172.21.15.134:6837","nonce":585628338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:16:25.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73f4066f30 msgr2=0x7f73f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73f4066f30 0x7f73f40693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7404002880 tx=0x7f7404009040 comp rx=0 tx=0).stop 2023-10-06T03:16:25.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 msgr2=0x7f74100b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100b1460 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7408009fa0 tx=0x7f7408009900 comp rx=0 tx=0).stop 2023-10-06T03:16:25.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 shutdown_connections 2023-10-06T03:16:25.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741015d930 0x7f74100b1460 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74101591b0 0x7f741014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 --2- 172.21.15.82:0/1769675519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f741015d560 0x7f74100ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 >> 172.21.15.82:0/1769675519 conn(0x7f74100d1180 msgr2=0x7f7410067f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:25.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 shutdown_connections 2023-10-06T03:16:25.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.677+0000 7f7416eb6700 1 -- 172.21.15.82:0/1769675519 wait complete. 2023-10-06T03:16:25.679 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-10-06T03:16:25.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.805+0000 7f7961dae700 1 Processor -- start 2023-10-06T03:16:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.805+0000 7f7961dae700 1 -- start start 2023-10-06T03:16:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.805+0000 7f7961dae700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f795c0cc1a0 0x7f795c1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.805+0000 7f7961dae700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c157020 con 0x7f795c06f5f0 2023-10-06T03:16:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.805+0000 7f7961dae700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c157300 con 0x7f795c0cc570 2023-10-06T03:16:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.805+0000 7f7961dae700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c14d990 con 0x7f795c0cc1a0 2023-10-06T03:16:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.805+0000 7f795affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f795c06f5f0 0x7f795c0ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38428/0 (socket says 172.21.15.82:38428) 2023-10-06T03:16:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795affd700 1 -- 172.21.15.82:0/4232905210 learned_addr learned my addr 172.21.15.82:0/4232905210 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795b7fe700 1 --2- 172.21.15.82:0/4232905210 >> v2:172.21.15.134:3300/0 conn(0x7f795c0cc1a0 0x7f795c1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795a7fc700 1 -- 172.21.15.82:0/4232905210 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718950018 0 0) 0x7f795c157020 con 0x7f795c06f5f0 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795a7fc700 1 -- 172.21.15.82:0/4232905210 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7944003570 con 0x7f795c06f5f0 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795a7fc700 1 -- 172.21.15.82:0/4232905210 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952433958 0 0) 0x7f795c157300 con 0x7f795c0cc570 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795a7fc700 1 -- 172.21.15.82:0/4232905210 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f795c157020 con 0x7f795c0cc570 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795b7fe700 1 -- 172.21.15.82:0/4232905210 >> v1:172.21.15.134:6789/0 conn(0x7f795c0cc570 legacy=0x7f795c0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795b7fe700 1 -- 172.21.15.82:0/4232905210 >> v1:172.21.15.82:6789/0 conn(0x7f795c06f5f0 legacy=0x7f795c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795a7fc700 1 -- 172.21.15.82:0/4232905210 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1662133716 0 0) 0x7f7944003570 con 0x7f795c06f5f0 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795b7fe700 1 -- 172.21.15.82:0/4232905210 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c1575e0 con 0x7f795c0cc1a0 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795b7fe700 1 --2- 172.21.15.82:0/4232905210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c0cc1a0 0x7f795c1569d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f794c009e60 tx=0x7f794c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7f9535923f44a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795a7fc700 1 -- 172.21.15.82:0/4232905210 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00e070 con 0x7f795c0cc1a0 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795a7fc700 1 -- 172.21.15.82:0/4232905210 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c00b7a0 con 0x7f795c0cc1a0 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.806+0000 7f795a7fc700 1 -- 172.21.15.82:0/4232905210 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950001470 con 0x7f795c0cc1a0 2023-10-06T03:16:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.807+0000 7f7961dae700 1 -- 172.21.15.82:0/4232905210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c0cc1a0 msgr2=0x7f795c1569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.807+0000 7f7961dae700 1 --2- 172.21.15.82:0/4232905210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c0cc1a0 0x7f795c1569d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f794c009e60 tx=0x7f794c009780 comp rx=0 tx=0).stop 2023-10-06T03:16:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.807+0000 7f7961dae700 1 -- 172.21.15.82:0/4232905210 shutdown_connections 2023-10-06T03:16:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.807+0000 7f7961dae700 1 --2- 172.21.15.82:0/4232905210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c0cc1a0 0x7f795c1569d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.807+0000 7f7961dae700 1 -- 172.21.15.82:0/4232905210 >> 172.21.15.82:0/4232905210 conn(0x7f795c06e6a0 msgr2=0x7f795c06eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.807+0000 7f7961dae700 1 -- 172.21.15.82:0/4232905210 shutdown_connections 2023-10-06T03:16:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.807+0000 7f7961dae700 1 -- 172.21.15.82:0/4232905210 wait complete. 2023-10-06T03:16:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.808+0000 7f7961dae700 1 Processor -- start 2023-10-06T03:16:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.808+0000 7f7961dae700 1 -- start start 2023-10-06T03:16:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f7961dae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c06f5f0 0x7f795c14ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f7961dae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795c0cc1a0 0x7f795c1672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f7961dae700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f795c0cc570 0x7f795c16a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f7961dae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c16a3a0 con 0x7f795c0cc1a0 2023-10-06T03:16:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f7961dae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c167820 con 0x7f795c06f5f0 2023-10-06T03:16:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f7961dae700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0b2b70 con 0x7f795c0cc570 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795c0cc1a0 0x7f795c1672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795c0cc1a0 0x7f795c1672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36072/0 (socket says 172.21.15.82:36072) 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 -- 172.21.15.82:0/2100759143 learned_addr learned my addr 172.21.15.82:0/2100759143 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795b7fe700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c06f5f0 0x7f795c14ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795bfff700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f795c0cc570 0x7f795c16a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 -- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f795c0cc570 msgr2=0x7f795c16a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f795c0cc570 0x7f795c16a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 -- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c06f5f0 msgr2=0x7f795c14ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c06f5f0 0x7f795c14ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 -- 172.21.15.82:0/2100759143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009a20 con 0x7f795c0cc1a0 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.809+0000 7f795affd700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795c0cc1a0 0x7f795c1672e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f795000cb70 tx=0x7f7950001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.810+0000 7f79437fe700 1 -- 172.21.15.82:0/2100759143 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950007e90 con 0x7f795c0cc1a0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.810+0000 7f79437fe700 1 -- 172.21.15.82:0/2100759143 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950007360 con 0x7f795c0cc1a0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.810+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c0b2e50 con 0x7f795c0cc1a0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.810+0000 7f79437fe700 1 -- 172.21.15.82:0/2100759143 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950004830 con 0x7f795c0cc1a0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.810+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c16ad70 con 0x7f795c0cc1a0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.811+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c169e90 con 0x7f795c0cc1a0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.811+0000 7f79437fe700 1 -- 172.21.15.82:0/2100759143 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7950004ba0 con 0x7f795c0cc1a0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.811+0000 7f79437fe700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7948066f30 0x7f79480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.811+0000 7f79437fe700 1 -- 172.21.15.82:0/2100759143 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7950083ec0 con 0x7f795c0cc1a0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.812+0000 7f795b7fe700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7948066f30 0x7f79480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.812+0000 7f795b7fe700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7948066f30 0x7f79480693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f794c0099f0 tx=0x7f794c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.815+0000 7f79437fe700 1 -- 172.21.15.82:0/2100759143 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f795c169e90 con 0x7f795c0cc1a0 2023-10-06T03:16:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.998+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f795c169e90 con 0x7f795c0cc1a0 2023-10-06T03:16:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:25.999+0000 7f79437fe700 1 -- 172.21.15.82:0/2100759143 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f795c169e90 con 0x7f795c0cc1a0 2023-10-06T03:16:26.000 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:26.000 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:15:53.380944+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:15:49.404080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:15:50.736320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7948066f30 msgr2=0x7f79480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7948066f30 0x7f79480693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f794c0099f0 tx=0x7f794c017000 comp rx=0 tx=0).stop 2023-10-06T03:16:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795c0cc1a0 msgr2=0x7f795c1672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795c0cc1a0 0x7f795c1672e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f795000cb70 tx=0x7f7950001b50 comp rx=0 tx=0).stop 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 shutdown_connections 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7948066f30 0x7f79480693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f795c0cc570 0x7f795c16a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f795c06f5f0 0x7f795c14ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 --2- 172.21.15.82:0/2100759143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795c0cc1a0 0x7f795c1672e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 >> 172.21.15.82:0/2100759143 conn(0x7f795c06e6a0 msgr2=0x7f795c14cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 shutdown_connections 2023-10-06T03:16:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.001+0000 7f7961dae700 1 -- 172.21.15.82:0/2100759143 wait complete. 2023-10-06T03:16:26.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:16:26.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.129+0000 7f7a86804700 1 Processor -- start 2023-10-06T03:16:26.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.129+0000 7f7a86804700 1 -- start start 2023-10-06T03:16:26.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.130+0000 7f7a86804700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a8006aad0 0x7f7a800b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.130+0000 7f7a86804700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7a800cce20 0x7f7a801504a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.130+0000 7f7a86804700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 0x7f7a801509e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.130+0000 7f7a86804700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a80069c10 con 0x7f7a8006aad0 2023-10-06T03:16:26.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.130+0000 7f7a86804700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a80150f20 con 0x7f7a800cce20 2023-10-06T03:16:26.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.130+0000 7f7a86804700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80069070 con 0x7f7a800b3040 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a8006aad0 0x7f7a800b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a8006aad0 0x7f7a800b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36076/0 (socket says 172.21.15.82:36076) 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 -- 172.21.15.82:0/4127892896 learned_addr learned my addr 172.21.15.82:0/4127892896 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a86003700 1 --2- 172.21.15.82:0/4127892896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 0x7f7a801509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85001700 1 --2- 172.21.15.82:0/4127892896 >> v2:172.21.15.134:3300/0 conn(0x7f7a800cce20 0x7f7a801504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 -- 172.21.15.82:0/4127892896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 msgr2=0x7f7a801509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 --2- 172.21.15.82:0/4127892896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 0x7f7a801509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 -- 172.21.15.82:0/4127892896 >> v2:172.21.15.134:3300/0 conn(0x7f7a800cce20 msgr2=0x7f7a801504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 --2- 172.21.15.82:0/4127892896 >> v2:172.21.15.134:3300/0 conn(0x7f7a800cce20 0x7f7a801504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 -- 172.21.15.82:0/4127892896 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800692e0 con 0x7f7a8006aad0 2023-10-06T03:16:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a85802700 1 --2- 172.21.15.82:0/4127892896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800b2b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7a800acda0 tx=0x7f7a7c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fc6fb67223598b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a84800700 1 -- 172.21.15.82:0/4127892896 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00dc50 con 0x7f7a8006aad0 2023-10-06T03:16:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a84800700 1 -- 172.21.15.82:0/4127892896 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00ddb0 con 0x7f7a8006aad0 2023-10-06T03:16:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.131+0000 7f7a84800700 1 -- 172.21.15.82:0/4127892896 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0196d0 con 0x7f7a8006aad0 2023-10-06T03:16:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 -- 172.21.15.82:0/4127892896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 msgr2=0x7f7a800b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 --2- 172.21.15.82:0/4127892896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800b2b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7a800acda0 tx=0x7f7a7c00b4f0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 -- 172.21.15.82:0/4127892896 shutdown_connections 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 --2- 172.21.15.82:0/4127892896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800b2b00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 --2- 172.21.15.82:0/4127892896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 0x7f7a801509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 --2- 172.21.15.82:0/4127892896 >> v2:172.21.15.134:3300/0 conn(0x7f7a800cce20 0x7f7a801504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 -- 172.21.15.82:0/4127892896 >> 172.21.15.82:0/4127892896 conn(0x7f7a8006e590 msgr2=0x7f7a8006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 -- 172.21.15.82:0/4127892896 shutdown_connections 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.132+0000 7f7a86804700 1 -- 172.21.15.82:0/4127892896 wait complete. 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.133+0000 7f7a86804700 1 Processor -- start 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.133+0000 7f7a86804700 1 -- start start 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a86804700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a86804700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 0x7f7a80148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a86804700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a800cce20 0x7f7a800c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a86804700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800c3b60 con 0x7f7a8006aad0 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a86804700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800c3550 con 0x7f7a800cce20 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a86804700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800c5f50 con 0x7f7a800b3040 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36084/0 (socket says 172.21.15.82:36084) 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 -- 172.21.15.82:0/2923056933 learned_addr learned my addr 172.21.15.82:0/2923056933 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 -- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 msgr2=0x7f7a80148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 0x7f7a80148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 -- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a800cce20 msgr2=0x7f7a800c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a800cce20 0x7f7a800c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 -- 172.21.15.82:0/2923056933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c00b790 con 0x7f7a8006aad0 2023-10-06T03:16:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.134+0000 7f7a85802700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800c77b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a80067720 tx=0x7f7a7c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.135+0000 7f7a75ffb700 1 -- 172.21.15.82:0/2923056933 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c010680 con 0x7f7a8006aad0 2023-10-06T03:16:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.135+0000 7f7a75ffb700 1 -- 172.21.15.82:0/2923056933 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c0107e0 con 0x7f7a8006aad0 2023-10-06T03:16:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.135+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a800c37f0 con 0x7f7a8006aad0 2023-10-06T03:16:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.135+0000 7f7a75ffb700 1 -- 172.21.15.82:0/2923056933 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c010ba0 con 0x7f7a8006aad0 2023-10-06T03:16:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.135+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a800c6230 con 0x7f7a8006aad0 2023-10-06T03:16:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.136+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8004c3c0 con 0x7f7a8006aad0 2023-10-06T03:16:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.136+0000 7f7a75ffb700 1 -- 172.21.15.82:0/2923056933 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a7c02c430 con 0x7f7a8006aad0 2023-10-06T03:16:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.136+0000 7f7a75ffb700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7a64066f30 0x7f7a640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.137+0000 7f7a75ffb700 1 -- 172.21.15.82:0/2923056933 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a7c014070 con 0x7f7a8006aad0 2023-10-06T03:16:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.137+0000 7f7a85001700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7a64066f30 0x7f7a640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.137+0000 7f7a85001700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7a64066f30 0x7f7a640693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a80068e00 tx=0x7f7a70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:26.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.141+0000 7f7a75ffb700 1 -- 172.21.15.82:0/2923056933 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a7c053560 con 0x7f7a8006aad0 2023-10-06T03:16:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.364+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7a800695c0 con 0x7f7a8006aad0 2023-10-06T03:16:26.365 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-10-06T03:16:26.365+0000 7fbfe891d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:16:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.368+0000 7f7a75ffb700 1 -- 172.21.15.82:0/2923056933 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7a7c056b80 con 0x7f7a8006aad0 2023-10-06T03:16:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7a64066f30 msgr2=0x7f7a640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7a64066f30 0x7f7a640693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a80068e00 tx=0x7f7a70008040 comp rx=0 tx=0).stop 2023-10-06T03:16:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 msgr2=0x7f7a800c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800c77b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a80067720 tx=0x7f7a7c01b000 comp rx=0 tx=0).stop 2023-10-06T03:16:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 shutdown_connections 2023-10-06T03:16:26.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a800cce20 0x7f7a800c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8006aad0 0x7f7a800c77b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7a64066f30 0x7f7a640693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 --2- 172.21.15.82:0/2923056933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a800b3040 0x7f7a80148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 >> 172.21.15.82:0/2923056933 conn(0x7f7a8006e590 msgr2=0x7f7a800ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:26.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 shutdown_connections 2023-10-06T03:16:26.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.370+0000 7f7a86804700 1 -- 172.21.15.82:0/2923056933 wait complete. 2023-10-06T03:16:26.373 INFO:tasks.ceph.mds.b.smithi134.stderr: -1668> 2023-10-06T03:15:56.475+0000 7fefd0ce5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:16:26.373 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:16:26.383 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:16:26.395 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-10-06T03:16:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.498+0000 7fe7726d0700 1 Processor -- start 2023-10-06T03:16:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.498+0000 7fe7726d0700 1 -- start start 2023-10-06T03:16:26.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe7726d0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe76c159500 0x7fe76c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe7726d0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe76c0b3fd0 0x7fe76c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe7726d0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c15dd20 con 0x7fe76c15d8e0 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe7726d0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c0b1110 con 0x7fe76c159500 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe7726d0700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c0b13b0 con 0x7fe76c0b3fd0 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe76bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe76c159500 0x7fe76c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe770c6d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe76c15d8e0 0x7fe76c0cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38430/0 (socket says 172.21.15.82:38430) 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe770c6d700 1 -- 172.21.15.82:0/2220584117 learned_addr learned my addr 172.21.15.82:0/2220584117 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.499+0000 7fe76b7fe700 1 --2- 172.21.15.82:0/2220584117 >> v2:172.21.15.134:3300/0 conn(0x7fe76c0b3fd0 0x7fe76c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76bfff700 1 -- 172.21.15.82:0/2220584117 >> v2:172.21.15.134:3300/0 conn(0x7fe76c0b3fd0 msgr2=0x7fe76c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76bfff700 1 --2- 172.21.15.82:0/2220584117 >> v2:172.21.15.134:3300/0 conn(0x7fe76c0b3fd0 0x7fe76c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76bfff700 1 -- 172.21.15.82:0/2220584117 >> v1:172.21.15.82:6789/0 conn(0x7fe76c15d8e0 legacy=0x7fe76c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76bfff700 1 -- 172.21.15.82:0/2220584117 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0b1690 con 0x7fe76c159500 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76affd700 1 -- 172.21.15.82:0/2220584117 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196594241 0 0) 0x7fe76c15dd20 con 0x7fe76c15d8e0 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76bfff700 1 --2- 172.21.15.82:0/2220584117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c159500 0x7fe76c1598d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe76c063430 tx=0x7fe75c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f461116fcfff272f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76affd700 1 -- 172.21.15.82:0/2220584117 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011630 con 0x7fe76c159500 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76affd700 1 -- 172.21.15.82:0/2220584117 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c011790 con 0x7fe76c159500 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe76affd700 1 -- 172.21.15.82:0/2220584117 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011b30 con 0x7fe76c159500 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe7726d0700 1 -- 172.21.15.82:0/2220584117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c159500 msgr2=0x7fe76c1598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.500+0000 7fe7726d0700 1 --2- 172.21.15.82:0/2220584117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c159500 0x7fe76c1598d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe76c063430 tx=0x7fe75c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.501+0000 7fe7726d0700 1 -- 172.21.15.82:0/2220584117 shutdown_connections 2023-10-06T03:16:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.501+0000 7fe7726d0700 1 --2- 172.21.15.82:0/2220584117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c159500 0x7fe76c1598d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.501+0000 7fe7726d0700 1 --2- 172.21.15.82:0/2220584117 >> v2:172.21.15.134:3300/0 conn(0x7fe76c0b3fd0 0x7fe76c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.501+0000 7fe7726d0700 1 -- 172.21.15.82:0/2220584117 >> 172.21.15.82:0/2220584117 conn(0x7fe76c067630 msgr2=0x7fe76c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.501+0000 7fe7726d0700 1 -- 172.21.15.82:0/2220584117 shutdown_connections 2023-10-06T03:16:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.501+0000 7fe7726d0700 1 -- 172.21.15.82:0/2220584117 wait complete. 2023-10-06T03:16:26.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.502+0000 7fe7726d0700 1 Processor -- start 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.502+0000 7fe7726d0700 1 -- start start 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.502+0000 7fe7726d0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76c0b3fd0 0x7fe76c068410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.502+0000 7fe7726d0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76c159500 0x7fe76c14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.502+0000 7fe7726d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c15d8e0 0x7fe76c1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.502+0000 7fe7726d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c14ab10 con 0x7fe76c15d8e0 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.502+0000 7fe7726d0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c068950 con 0x7fe76c0b3fd0 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.502+0000 7fe7726d0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c069490 con 0x7fe76c159500 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c15d8e0 0x7fe76c1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c15d8e0 0x7fe76c1552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36106/0 (socket says 172.21.15.82:36106) 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 -- 172.21.15.82:0/1879692048 learned_addr learned my addr 172.21.15.82:0/1879692048 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe76bfff700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76c0b3fd0 0x7fe76c068410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe76b7fe700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76c159500 0x7fe76c14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 -- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76c159500 msgr2=0x7fe76c14a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76c159500 0x7fe76c14a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 -- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76c0b3fd0 msgr2=0x7fe76c068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76c0b3fd0 0x7fe76c068410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 -- 172.21.15.82:0/1879692048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c009420 con 0x7fe76c15d8e0 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe76bfff700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76c0b3fd0 0x7fe76c068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe76b7fe700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76c159500 0x7fe76c14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe770c6d700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c15d8e0 0x7fe76c1552d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe76400cbf0 tx=0x7fe7640019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe753fff700 1 -- 172.21.15.82:0/1879692048 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76400a9c0 con 0x7fe76c15d8e0 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe753fff700 1 -- 172.21.15.82:0/1879692048 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76400ab20 con 0x7fe76c15d8e0 2023-10-06T03:16:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe753fff700 1 -- 172.21.15.82:0/1879692048 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7640070f0 con 0x7fe76c15d8e0 2023-10-06T03:16:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c068bf0 con 0x7fe76c15d8e0 2023-10-06T03:16:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.503+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c0691b0 con 0x7fe76c15d8e0 2023-10-06T03:16:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.504+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c14acc0 con 0x7fe76c15d8e0 2023-10-06T03:16:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.505+0000 7fe753fff700 1 -- 172.21.15.82:0/1879692048 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe764007520 con 0x7fe76c15d8e0 2023-10-06T03:16:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.505+0000 7fe753fff700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe758066f30 0x7fe7580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.505+0000 7fe753fff700 1 -- 172.21.15.82:0/1879692048 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe764084ae0 con 0x7fe76c15d8e0 2023-10-06T03:16:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.505+0000 7fe76bfff700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe758066f30 0x7fe7580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.506+0000 7fe76bfff700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe758066f30 0x7fe7580693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0093f0 tx=0x7fe75c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.509+0000 7fe753fff700 1 -- 172.21.15.82:0/1879692048 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe76c14acc0 con 0x7fe76c15d8e0 2023-10-06T03:16:26.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:26.735+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe76c064050 con 0x7fe76c15d8e0 2023-10-06T03:16:27.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.369+0000 7fe753fff700 1 -- 172.21.15.82:0/1879692048 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe764051c20 con 0x7fe76c15d8e0 2023-10-06T03:16:27.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe758066f30 msgr2=0x7fe7580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:27.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe758066f30 0x7fe7580693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0093f0 tx=0x7fe75c017000 comp rx=0 tx=0).stop 2023-10-06T03:16:27.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c15d8e0 msgr2=0x7fe76c1552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:27.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c15d8e0 0x7fe76c1552d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe76400cbf0 tx=0x7fe7640019b0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 shutdown_connections 2023-10-06T03:16:27.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c15d8e0 0x7fe76c1552d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76c0b3fd0 0x7fe76c068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe758066f30 0x7fe7580693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 --2- 172.21.15.82:0/1879692048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76c159500 0x7fe76c14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 >> 172.21.15.82:0/1879692048 conn(0x7fe76c067630 msgr2=0x7fe76c14d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 shutdown_connections 2023-10-06T03:16:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.371+0000 7fe7726d0700 1 -- 172.21.15.82:0/1879692048 wait complete. 2023-10-06T03:16:27.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:16:27.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.502+0000 7fc910a0f700 1 Processor -- start 2023-10-06T03:16:27.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.502+0000 7fc910a0f700 1 -- start start 2023-10-06T03:16:27.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc910a0f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0b55b0 0x7fc90c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:27.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc910a0f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc90c0cf800 0x7fc90c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:27.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc910a0f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c0cbed0 con 0x7fc90c0d0f00 2023-10-06T03:16:27.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc910a0f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c159d40 con 0x7fc90c0cf800 2023-10-06T03:16:27.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc910a0f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0cc750 con 0x7fc90c0b55b0 2023-10-06T03:16:27.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc909d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc90c0cf800 0x7fc90c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:27.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc90ad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc90c0d0f00 0x7fc90c0ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47754/0 (socket says 172.21.15.82:47754) 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc90ad9d700 1 -- 172.21.15.82:0/699771941 learned_addr learned my addr 172.21.15.82:0/699771941 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc909d9b700 1 -- 172.21.15.82:0/699771941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0b55b0 msgr2=0x7fc90c0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc909d9b700 1 --2- 172.21.15.82:0/699771941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0b55b0 0x7fc90c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc909d9b700 1 -- 172.21.15.82:0/699771941 >> v1:172.21.15.82:6789/0 conn(0x7fc90c0d0f00 legacy=0x7fc90c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc909d9b700 1 -- 172.21.15.82:0/699771941 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0b5ec0 con 0x7fc90c0cf800 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc90959a700 1 -- 172.21.15.82:0/699771941 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335605373 0 0) 0x7fc90c0cbed0 con 0x7fc90c0d0f00 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc909d9b700 1 --2- 172.21.15.82:0/699771941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0b5980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9000098e0 tx=0x7fc9000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3048b1a52822e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc90959a700 1 -- 172.21.15.82:0/699771941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900009e80 con 0x7fc90c0cf800 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc90959a700 1 -- 172.21.15.82:0/699771941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000b860 con 0x7fc90c0cf800 2023-10-06T03:16:27.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.503+0000 7fc90959a700 1 -- 172.21.15.82:0/699771941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000bbe0 con 0x7fc90c0cf800 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.504+0000 7fc910a0f700 1 -- 172.21.15.82:0/699771941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 msgr2=0x7fc90c0b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.504+0000 7fc910a0f700 1 --2- 172.21.15.82:0/699771941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0b5980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9000098e0 tx=0x7fc9000091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.504+0000 7fc910a0f700 1 -- 172.21.15.82:0/699771941 shutdown_connections 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.504+0000 7fc910a0f700 1 --2- 172.21.15.82:0/699771941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0b55b0 0x7fc90c0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.504+0000 7fc910a0f700 1 --2- 172.21.15.82:0/699771941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0b5980 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.504+0000 7fc910a0f700 1 -- 172.21.15.82:0/699771941 >> 172.21.15.82:0/699771941 conn(0x7fc90c08a050 msgr2=0x7fc90c099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.504+0000 7fc910a0f700 1 -- 172.21.15.82:0/699771941 shutdown_connections 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.504+0000 7fc910a0f700 1 -- 172.21.15.82:0/699771941 wait complete. 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.505+0000 7fc910a0f700 1 Processor -- start 2023-10-06T03:16:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.505+0000 7fc910a0f700 1 -- start start 2023-10-06T03:16:27.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc910a0f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc90c0b55b0 0x7fc90c169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:27.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc910a0f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:27.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc910a0f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0d0f00 0x7fc90c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:27.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc910a0f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0b02f0 con 0x7fc90c0cf800 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc910a0f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0b0590 con 0x7fc90c0b55b0 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc910a0f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0b0870 con 0x7fc90c0d0f00 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47388/0 (socket says 172.21.15.82:47388) 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 -- 172.21.15.82:0/781414049 learned_addr learned my addr 172.21.15.82:0/781414049 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc90ad9d700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0d0f00 0x7fc90c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc90a59c700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc90c0b55b0 0x7fc90c169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 -- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0d0f00 msgr2=0x7fc90c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0d0f00 0x7fc90c159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 -- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc90c0b55b0 msgr2=0x7fc90c169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc90c0b55b0 0x7fc90c169790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 -- 172.21.15.82:0/781414049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009420 con 0x7fc90c0cf800 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc909d9b700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0afdb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc90000b3c0 tx=0x7fc900017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.506+0000 7fc8fa7fc700 1 -- 172.21.15.82:0/781414049 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000bbe0 con 0x7fc90c0cf800 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.507+0000 7fc8fa7fc700 1 -- 172.21.15.82:0/781414049 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc900006af0 con 0x7fc90c0cf800 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.507+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c0b0b50 con 0x7fc90c0cf800 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.507+0000 7fc8fa7fc700 1 -- 172.21.15.82:0/781414049 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900011670 con 0x7fc90c0cf800 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.507+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c0b1110 con 0x7fc90c0cf800 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.508+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90c0b1300 con 0x7fc90c0cf800 2023-10-06T03:16:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.508+0000 7fc8fa7fc700 1 -- 172.21.15.82:0/781414049 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc900011a60 con 0x7fc90c0cf800 2023-10-06T03:16:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.508+0000 7fc8fa7fc700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8ec066f30 0x7fc8ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.508+0000 7fc8fa7fc700 1 -- 172.21.15.82:0/781414049 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc900086070 con 0x7fc90c0cf800 2023-10-06T03:16:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.508+0000 7fc90a59c700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8ec066f30 0x7fc8ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.509+0000 7fc90a59c700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8ec066f30 0x7fc8ec0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc90c0ce6d0 tx=0x7fc8fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.512+0000 7fc8fa7fc700 1 -- 172.21.15.82:0/781414049 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc900053130 con 0x7fc90c0cf800 2023-10-06T03:16:27.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:27.695+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc90c0717c0 con 0x7fc90c0cf800 2023-10-06T03:16:27.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:16:27.749 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:16:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.533+0000 7fc8fa7fc700 1 -- 172.21.15.82:0/781414049 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc900056750 con 0x7fc90c0cf800 2023-10-06T03:16:28.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8ec066f30 msgr2=0x7fc8ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:28.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8ec066f30 0x7fc8ec0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc90c0ce6d0 tx=0x7fc8fc008040 comp rx=0 tx=0).stop 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 msgr2=0x7fc90c0afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0afdb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc90000b3c0 tx=0x7fc900017000 comp rx=0 tx=0).stop 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 shutdown_connections 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8ec066f30 0x7fc8ec0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc90c0d0f00 0x7fc90c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc90c0b55b0 0x7fc90c169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 --2- 172.21.15.82:0/781414049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc90c0cf800 0x7fc90c0afdb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.536+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 >> 172.21.15.82:0/781414049 conn(0x7fc90c08a050 msgr2=0x7fc90c0c6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.537+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 shutdown_connections 2023-10-06T03:16:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.537+0000 7fc910a0f700 1 -- 172.21.15.82:0/781414049 wait complete. 2023-10-06T03:16:28.539 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:16:28.551 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:16:28.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.675+0000 7f7f9d539700 1 Processor -- start 2023-10-06T03:16:28.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.675+0000 7f7f9d539700 1 -- start start 2023-10-06T03:16:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9d539700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f980c7f70 0x7f7f98150480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9d539700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7f981509c0 0x7f7f98159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9d539700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9806d8e0 con 0x7f7f980c7ba0 2023-10-06T03:16:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9d539700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9806dbc0 con 0x7f7f981509c0 2023-10-06T03:16:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9d539700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f98157240 con 0x7f7f980c7f70 2023-10-06T03:16:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9cd38700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7f981509c0 0x7f7f98159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f97fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7f980c7ba0 0x7f7f98156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47770/0 (socket says 172.21.15.82:47770) 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f97fff700 1 -- 172.21.15.82:0/1327655475 learned_addr learned my addr 172.21.15.82:0/1327655475 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f977fe700 1 --2- 172.21.15.82:0/1327655475 >> v2:172.21.15.134:3300/0 conn(0x7f7f980c7f70 0x7f7f98150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9cd38700 1 -- 172.21.15.82:0/1327655475 >> v2:172.21.15.134:3300/0 conn(0x7f7f980c7f70 msgr2=0x7f7f98150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9cd38700 1 --2- 172.21.15.82:0/1327655475 >> v2:172.21.15.134:3300/0 conn(0x7f7f980c7f70 0x7f7f98150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9cd38700 1 -- 172.21.15.82:0/1327655475 >> v1:172.21.15.82:6789/0 conn(0x7f7f980c7ba0 legacy=0x7f7f98156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9cd38700 1 -- 172.21.15.82:0/1327655475 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98157520 con 0x7f7f981509c0 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f9cd38700 1 --2- 172.21.15.82:0/1327655475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f98159fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7f980b2200 tx=0x7f7f90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f596c24523051dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f96ffd700 1 -- 172.21.15.82:0/1327655475 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000e070 con 0x7f7f981509c0 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f96ffd700 1 -- 172.21.15.82:0/1327655475 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9000bc30 con 0x7f7f981509c0 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.676+0000 7f7f96ffd700 1 -- 172.21.15.82:0/1327655475 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90012430 con 0x7f7f981509c0 2023-10-06T03:16:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.677+0000 7f7f9d539700 1 -- 172.21.15.82:0/1327655475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 msgr2=0x7f7f98159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.677+0000 7f7f9d539700 1 --2- 172.21.15.82:0/1327655475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f98159fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7f980b2200 tx=0x7f7f90009780 comp rx=0 tx=0).stop 2023-10-06T03:16:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.677+0000 7f7f9d539700 1 -- 172.21.15.82:0/1327655475 shutdown_connections 2023-10-06T03:16:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.677+0000 7f7f9d539700 1 --2- 172.21.15.82:0/1327655475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f98159fa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.677+0000 7f7f9d539700 1 --2- 172.21.15.82:0/1327655475 >> v2:172.21.15.134:3300/0 conn(0x7f7f980c7f70 0x7f7f98150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.677+0000 7f7f9d539700 1 -- 172.21.15.82:0/1327655475 >> 172.21.15.82:0/1327655475 conn(0x7f7f980c8c70 msgr2=0x7f7f980c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.677+0000 7f7f9d539700 1 -- 172.21.15.82:0/1327655475 shutdown_connections 2023-10-06T03:16:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.677+0000 7f7f9d539700 1 -- 172.21.15.82:0/1327655475 wait complete. 2023-10-06T03:16:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.678+0000 7f7f9d539700 1 Processor -- start 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.678+0000 7f7f9d539700 1 -- start start 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9d539700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f980c7ba0 0x7f7f98159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9d539700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f980c7f70 0x7f7f98068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9d539700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f980ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9d539700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98158cf0 con 0x7f7f981509c0 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9d539700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98158f40 con 0x7f7f980c7f70 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9d539700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98159220 con 0x7f7f980c7ba0 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9cd38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f980ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9cd38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f980ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47400/0 (socket says 172.21.15.82:47400) 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9cd38700 1 -- 172.21.15.82:0/2996430462 learned_addr learned my addr 172.21.15.82:0/2996430462 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f977fe700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f980c7f70 0x7f7f98068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f97fff700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f980c7ba0 0x7f7f98159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9cd38700 1 -- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f980c7ba0 msgr2=0x7f7f98159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9cd38700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f980c7ba0 0x7f7f98159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9cd38700 1 -- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f980c7f70 msgr2=0x7f7f98068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9cd38700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f980c7f70 0x7f7f98068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.679+0000 7f7f9cd38700 1 -- 172.21.15.82:0/2996430462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90009a20 con 0x7f7f981509c0 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.680+0000 7f7f9cd38700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f980ac7e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7f90013000 tx=0x7f7f90019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.680+0000 7f7f7ffff700 1 -- 172.21.15.82:0/2996430462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9001e630 con 0x7f7f981509c0 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.680+0000 7f7f7ffff700 1 -- 172.21.15.82:0/2996430462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9001e7f0 con 0x7f7f981509c0 2023-10-06T03:16:28.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.680+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f98159500 con 0x7f7f981509c0 2023-10-06T03:16:28.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.680+0000 7f7f7ffff700 1 -- 172.21.15.82:0/2996430462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9001ebb0 con 0x7f7f981509c0 2023-10-06T03:16:28.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.680+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f98159ac0 con 0x7f7f981509c0 2023-10-06T03:16:28.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.681+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f98159e30 con 0x7f7f981509c0 2023-10-06T03:16:28.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.681+0000 7f7f7ffff700 1 -- 172.21.15.82:0/2996430462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f90024070 con 0x7f7f981509c0 2023-10-06T03:16:28.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.681+0000 7f7f7ffff700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:28.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.682+0000 7f7f7ffff700 1 -- 172.21.15.82:0/2996430462 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f7f90086d80 con 0x7f7f981509c0 2023-10-06T03:16:28.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.682+0000 7f7f97fff700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:28.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.682+0000 7f7f97fff700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7f84066f30 0x7f7f840693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7f88001820 tx=0x7f7f88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:28.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.686+0000 7f7f7ffff700 1 -- 172.21.15.82:0/2996430462 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f90053ff0 con 0x7f7f981509c0 2023-10-06T03:16:28.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:28.868+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f98064050 con 0x7f7f981509c0 2023-10-06T03:16:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.546+0000 7f7f7ffff700 1 -- 172.21.15.82:0/2996430462 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7f90057610 con 0x7f7f981509c0 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7f84066f30 msgr2=0x7f7f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7f84066f30 0x7f7f840693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7f88001820 tx=0x7f7f88009040 comp rx=0 tx=0).stop 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 msgr2=0x7f7f980ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f980ac7e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7f90013000 tx=0x7f7f90019000 comp rx=0 tx=0).stop 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 shutdown_connections 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f981509c0 0x7f7f980ac7e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f980c7ba0 0x7f7f98159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 --2- 172.21.15.82:0/2996430462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f980c7f70 0x7f7f98068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 >> 172.21.15.82:0/2996430462 conn(0x7f7f980c8c70 msgr2=0x7f7f980cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 shutdown_connections 2023-10-06T03:16:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.550+0000 7f7f9d539700 1 -- 172.21.15.82:0/2996430462 wait complete. 2023-10-06T03:16:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-10-06T03:16:29.567 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:16:29.567 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:16:29.567 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:16:29.567 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:16:29.568 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:16:29.568 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:16:29.568 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:16:29.568 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:16:29.568 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:16:29.568 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:16:29.568 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:16:29.569 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:16:29.569 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:16:29.569 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:16:29.569 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:16:29.569 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:16:29.577 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:16:29.577 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:16:29.578 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:16:29.578 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:16:29.582 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:16:29.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:16:29.582 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:16:29.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:16:29.620 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:16:29.620 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:29.620 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:16:29.621 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:29.624 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:16:29.624 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:29.625 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:16:29.625 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:29.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:16:29.695 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-10-06T03:16:29.695 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-10-06T03:16:29.706 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-10-06T03:16:29.707 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-10-06T03:16:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.745+0000 7f88530d1700 1 Processor -- start 2023-10-06T03:16:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.745+0000 7f88530d1700 1 -- start start 2023-10-06T03:16:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.746+0000 7f88530d1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fee0 0x7f884c0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.746+0000 7f88530d1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f884c06f270 0x7f884c0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.746+0000 7f88530d1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0c87a0 con 0x7f884c13fb10 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.746+0000 7f88530d1700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c06adb0 con 0x7f884c06f270 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.746+0000 7f88530d1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c06b090 con 0x7f884c13fee0 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.746+0000 7f885166e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f884c06f270 0x7f884c0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.746+0000 7f885166e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f884c06f270 0x7f884c0c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47440/0 (socket says 172.21.15.82:47440) 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.746+0000 7f885166e700 1 -- 172.21.15.82:0/3425013226 learned_addr learned my addr 172.21.15.82:0/3425013226 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f884bfff700 1 --2- 172.21.15.82:0/3425013226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fee0 0x7f884c0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f885166e700 1 -- 172.21.15.82:0/3425013226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fee0 msgr2=0x7f884c0c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f885166e700 1 --2- 172.21.15.82:0/3425013226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fee0 0x7f884c0c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f885166e700 1 -- 172.21.15.82:0/3425013226 >> v1:172.21.15.134:6789/0 conn(0x7f884c13fb10 legacy=0x7f884c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f885166e700 1 -- 172.21.15.82:0/3425013226 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c06b370 con 0x7f884c06f270 2023-10-06T03:16:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f885166e700 1 --2- 172.21.15.82:0/3425013226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c0c7f00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f884400bc50 tx=0x7f884400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120139d7d4f4948f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f884b7fe700 1 -- 172.21.15.82:0/3425013226 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400be60 con 0x7f884c06f270 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f884b7fe700 1 -- 172.21.15.82:0/3425013226 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884400ddc0 con 0x7f884c06f270 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.747+0000 7f884b7fe700 1 -- 172.21.15.82:0/3425013226 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440106a0 con 0x7f884c06f270 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.748+0000 7f88530d1700 1 -- 172.21.15.82:0/3425013226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 msgr2=0x7f884c0c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.748+0000 7f88530d1700 1 --2- 172.21.15.82:0/3425013226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c0c7f00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f884400bc50 tx=0x7f884400b4f0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.748+0000 7f88530d1700 1 -- 172.21.15.82:0/3425013226 shutdown_connections 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.748+0000 7f88530d1700 1 --2- 172.21.15.82:0/3425013226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c0c7f00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.748+0000 7f88530d1700 1 --2- 172.21.15.82:0/3425013226 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fee0 0x7f884c0c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.748+0000 7f88530d1700 1 -- 172.21.15.82:0/3425013226 >> 172.21.15.82:0/3425013226 conn(0x7f884c06e760 msgr2=0x7f884c06eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.748+0000 7f88530d1700 1 -- 172.21.15.82:0/3425013226 shutdown_connections 2023-10-06T03:16:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.748+0000 7f88530d1700 1 -- 172.21.15.82:0/3425013226 wait complete. 2023-10-06T03:16:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.749+0000 7f88530d1700 1 Processor -- start 2023-10-06T03:16:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.749+0000 7f88530d1700 1 -- start start 2023-10-06T03:16:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f88530d1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f88530d1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fb10 0x7f884c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f88530d1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f884c13fee0 0x7f884c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f88530d1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c1591f0 con 0x7f884c06f270 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f88530d1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c157810 con 0x7f884c13fee0 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f88530d1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c158330 con 0x7f884c13fb10 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47450/0 (socket says 172.21.15.82:47450) 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 -- 172.21.15.82:0/1971089097 learned_addr learned my addr 172.21.15.82:0/1971089097 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f884bfff700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fb10 0x7f884c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f885166e700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f884c13fee0 0x7f884c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 -- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fb10 msgr2=0x7f884c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fb10 0x7f884c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 -- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f884c13fee0 msgr2=0x7f884c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f884c13fee0 0x7f884c0cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 -- 172.21.15.82:0/1971089097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884400b790 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8850e6d700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c157a50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f883c00b630 tx=0x7f883c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8848ff9700 1 -- 172.21.15.82:0/1971089097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00f510 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8848ff9700 1 -- 172.21.15.82:0/1971089097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00f690 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c158610 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f8848ff9700 1 -- 172.21.15.82:0/1971089097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00fa50 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.750+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c158e80 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.751+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c064050 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.752+0000 7f8848ff9700 1 -- 172.21.15.82:0/1971089097 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f883c01a400 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.752+0000 7f8848ff9700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.752+0000 7f8848ff9700 1 -- 172.21.15.82:0/1971089097 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f883c083d80 con 0x7f884c06f270 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.752+0000 7f884bfff700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.753+0000 7f884bfff700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f884000f610 tx=0x7f88400077f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.756+0000 7f8848ff9700 1 -- 172.21.15.82:0/1971089097 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f883c051210 con 0x7f884c06f270 2023-10-06T03:16:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:29.953+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f884c0cce00 con 0x7f884c06f270 2023-10-06T03:16:30.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.561+0000 7f8848ff9700 1 -- 172.21.15.82:0/1971089097 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f883c058e60 con 0x7f884c06f270 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8838066f30 msgr2=0x7f88380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f884000f610 tx=0x7f88400077f0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 msgr2=0x7f884c157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c157a50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f883c00b630 tx=0x7f883c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 shutdown_connections 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f884c13fee0 0x7f884c0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c06f270 0x7f884c157a50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 --2- 172.21.15.82:0/1971089097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f884c13fb10 0x7f884c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 >> 172.21.15.82:0/1971089097 conn(0x7f884c06e760 msgr2=0x7f884c0b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 shutdown_connections 2023-10-06T03:16:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.564+0000 7f88530d1700 1 -- 172.21.15.82:0/1971089097 wait complete. 2023-10-06T03:16:30.567 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-10-06T03:16:30.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:16:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.691+0000 7f96f35dd700 1 Processor -- start 2023-10-06T03:16:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.691+0000 7f96f35dd700 1 -- start start 2023-10-06T03:16:30.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f35dd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec15d930 0x7f96ec0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f35dd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96ec1591b0 0x7f96ec159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f35dd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec0b2ad0 con 0x7f96ec15d560 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f35dd700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec0b4160 con 0x7f96ec1591b0 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f35dd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec159b70 con 0x7f96ec15d930 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f1379700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f96ec15d560 0x7f96ec0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47796/0 (socket says 172.21.15.82:47796) 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f1379700 1 -- 172.21.15.82:0/3995888944 learned_addr learned my addr 172.21.15.82:0/3995888944 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152159484 0 0) 0x7f96ec0b2ad0 con 0x7f96ec15d560 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d4003570 con 0x7f96ec15d560 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f1b7a700 1 --2- 172.21.15.82:0/3995888944 >> v2:172.21.15.134:3300/0 conn(0x7f96ec1591b0 0x7f96ec159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f0b78700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec15d930 0x7f96ec0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 939169813 0 0) 0x7f96d4003570 con 0x7f96ec15d560 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec15d930 msgr2=0x7f96ec0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec15d930 0x7f96ec0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 >> v2:172.21.15.134:3300/0 conn(0x7f96ec1591b0 msgr2=0x7f96ec159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 --2- 172.21.15.82:0/3995888944 >> v2:172.21.15.134:3300/0 conn(0x7f96ec1591b0 0x7f96ec159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec0b2230 con 0x7f96ec15d560 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f96e40017f0 con 0x7f96ec15d560 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96f1b7a700 1 --2- 172.21.15.82:0/3995888944 >> v2:172.21.15.134:3300/0 conn(0x7f96ec1591b0 0x7f96ec159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 >> v1:172.21.15.82:6789/0 conn(0x7f96ec15d560 legacy=0x7f96ec0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96d4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec15d930 0x7f96d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d4004d50 0x7f96d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0b4160 con 0x7f96d4003a60 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec159b70 con 0x7f96d4004d50 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.692+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d400bb90 con 0x7f96ec15d930 2023-10-06T03:16:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1379700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96d4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f0b78700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec15d930 0x7f96d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1b7a700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d4004d50 0x7f96d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1379700 1 -- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec15d930 msgr2=0x7f96d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1379700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec15d930 0x7f96d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1379700 1 -- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d4004d50 msgr2=0x7f96d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1379700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d4004d50 0x7f96d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1379700 1 -- 172.21.15.82:0/3995888944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4003570 con 0x7f96d4003a60 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1b7a700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d4004d50 0x7f96d40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96f1379700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96d4003e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96e400a970 tx=0x7f96ec0d0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5ab5079cddd83d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e40070d0 con 0x7f96d4003a60 2023-10-06T03:16:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e4007270 con 0x7f96d4003a60 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.693+0000 7f96ebfff700 1 -- 172.21.15.82:0/3995888944 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4007630 con 0x7f96d4003a60 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.694+0000 7f96f35dd700 1 -- 172.21.15.82:0/3995888944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 msgr2=0x7f96d4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.694+0000 7f96f35dd700 1 --2- 172.21.15.82:0/3995888944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96d4003e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96e400a970 tx=0x7f96ec0d0570 comp rx=0 tx=0).stop 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.694+0000 7f96f1b7a700 1 -- 172.21.15.82:0/3995888944 reap_dead start 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.694+0000 7f96f35dd700 1 -- 172.21.15.82:0/3995888944 shutdown_connections 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.694+0000 7f96f35dd700 1 -- 172.21.15.82:0/3995888944 >> 172.21.15.82:0/3995888944 conn(0x7f96ec0d1180 msgr2=0x7f96ec069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.694+0000 7f96f35dd700 1 -- 172.21.15.82:0/3995888944 shutdown_connections 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.694+0000 7f96f35dd700 1 -- 172.21.15.82:0/3995888944 wait complete. 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.695+0000 7f96f35dd700 1 Processor -- start 2023-10-06T03:16:30.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.695+0000 7f96f35dd700 1 -- start start 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f35dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96ec15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f35dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ec159ce0 0x7f96ec14f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f35dd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec069280 0x7f96ec069700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f35dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec069c40 con 0x7f96d4003a60 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f35dd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec151930 con 0x7f96ec159ce0 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f35dd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec15ad20 con 0x7f96ec069280 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96ec15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96ec15c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47474/0 (socket says 172.21.15.82:47474) 2023-10-06T03:16:30.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 -- 172.21.15.82:0/2070753624 learned_addr learned my addr 172.21.15.82:0/2070753624 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1b7a700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec069280 0x7f96ec069700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f0b78700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ec159ce0 0x7f96ec14f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 -- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec069280 msgr2=0x7f96ec069700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec069280 0x7f96ec069700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 -- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ec159ce0 msgr2=0x7f96ec14f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ec159ce0 0x7f96ec14f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 -- 172.21.15.82:0/2070753624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec151bf0 con 0x7f96d4003a60 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f0b78700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ec159ce0 0x7f96ec14f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f1379700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96ec15c310 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f96e4007200 tx=0x7f96e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96e97fa700 1 -- 172.21.15.82:0/2070753624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4001ac0 con 0x7f96d4003a60 2023-10-06T03:16:30.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96e97fa700 1 -- 172.21.15.82:0/2070753624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e401f440 con 0x7f96d4003a60 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec14f9a0 con 0x7f96d4003a60 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96e97fa700 1 -- 172.21.15.82:0/2070753624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e401f5f0 con 0x7f96d4003a60 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.696+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec15a760 con 0x7f96d4003a60 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.697+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec064050 con 0x7f96d4003a60 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.698+0000 7f96e97fa700 1 -- 172.21.15.82:0/2070753624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96e4025020 con 0x7f96d4003a60 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.698+0000 7f96e97fa700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96d8066f30 0x7f96d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.698+0000 7f96e97fa700 1 -- 172.21.15.82:0/2070753624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f96e4086940 con 0x7f96d4003a60 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.698+0000 7f96f0b78700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96d8066f30 0x7f96d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:30.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.699+0000 7f96f0b78700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96d8066f30 0x7f96d80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96e0006f00 tx=0x7f96e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:30.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.702+0000 7f96e97fa700 1 -- 172.21.15.82:0/2070753624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96e4053da0 con 0x7f96d4003a60 2023-10-06T03:16:30.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.964+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f96ec0b2510 con 0x7f96d4003a60 2023-10-06T03:16:30.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.965+0000 7f96e97fa700 1 -- 172.21.15.82:0/2070753624 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f96e40573c0 con 0x7f96d4003a60 2023-10-06T03:16:30.967 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:30.967 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:16:30.967 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-10-06T03:16:30.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.967 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-10-06T03:16:30.967 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l724PDBAAKY5FzGqpcmJ9nM/VzdTluA==", 2023-10-06T03:16:30.967 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.967 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l2iFnFxAAnxKQmAHZarx6LfCeKkON3A==", 2023-10-06T03:16:30.968 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lTOzVEhAACwLXU1KFGLhLFDFKzj6g3Q==", 2023-10-06T03:16:30.969 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-10-06T03:16:30.970 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9le7I7HhAArFktlgVJrQpOrrUTVk22Xw==", 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC3ex9lSwhPNRAAEuYJnr5peNQ+adzmaiVfuA==", 2023-10-06T03:16:30.971 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC6ex9lZ7t5MhAAm8vw3nhRW4ZVUaf1Ta7ytg==", 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.972 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC9ex9lZyKZMhAAmnaJ8C9oe6oQYNe9flPP/w==", 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:30.973 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDAex9lXgMXMRAABl0OhmR0JLg6lg2t0i34sg==", 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDGex9lsr9wLxAAQ41BKVQ/dy5Z9EOm/16qDw==", 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.978 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-10-06T03:16:30.978 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDJex9l7He2LRAA8Xan1h5Sm60wJtAQP/FLzA==", 2023-10-06T03:16:30.979 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.979 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:30.979 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:30.979 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDMex9ldA63KxAAenPCZN/PLtQdV14ELvSBWg==", 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDPex9lyQ7RLRAAzKpuBd2pcmtTiku1klhAew==", 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.981 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lylUIIhAA6GrLOJ3Kp6n7xUJ3VoBUiQ==", 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-10-06T03:16:30.982 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l8UthKhAALxBTh0SRcmfHtgEIOjSuLA==", 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l5shkJxAA+IYYf2SQk8x/hSeuLH3NRQ==", 2023-10-06T03:16:30.983 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.984 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:30.984 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:16:30.984 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:16:30.984 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:16:30.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.984 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9ljArALxAA7shG1AhpdCbRGUzZR4HHng==", 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-10-06T03:16:30.985 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQCzex9lU7IULBAABmDwAP9lztKEz35R80eZRA==", 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mds", 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDVex9lb6b4IBAAHeHIFzhPfzbiaWaRm90UEg==", 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.986 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDVex9lFbH4IBAAsB4H5EsyO6ZXAW4sOxOVDg==", 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-osd", 2023-10-06T03:16:30.987 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDVex9lJLn4IBAAbEontdaDMRVP4Ya1n4R87Q==", 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDVex9lbsD4IBAAvvwIf8uEA6/QEgv51nH8Ag==", 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDVex9lhsf4IBAAHVbdSTEOIymyvjcYp/1GWQ==", 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDVex9l/s74IBAAk9o9D6GnynThiCICAMROKg==", 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T03:16:30.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.990 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-10-06T03:16:30.990 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lsmYMCRAA1BY9VAWL0YXlNJAmkjau9w==", 2023-10-06T03:16:30.990 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.990 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:16:30.990 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-10-06T03:16:30.991 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.991 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:30.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:30.992 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-10-06T03:16:30.992 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l8Dr/BBAA/cTmol+xUbQ2HOUtowC/Zw==", 2023-10-06T03:16:30.992 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:30.992 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:16:30.993 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-10-06T03:16:30.993 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:30.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:30.993 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-10-06T03:16:30.993 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:16:30.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96d8066f30 msgr2=0x7f96d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:30.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96d8066f30 0x7f96d80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96e0006f00 tx=0x7f96e0008040 comp rx=0 tx=0).stop 2023-10-06T03:16:30.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 msgr2=0x7f96ec15c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:30.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96ec15c310 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f96e4007200 tx=0x7f96e4016000 comp rx=0 tx=0).stop 2023-10-06T03:16:30.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 shutdown_connections 2023-10-06T03:16:30.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96d8066f30 0x7f96d80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ec069280 0x7f96ec069700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96d4003a60 0x7f96ec15c310 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 --2- 172.21.15.82:0/2070753624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ec159ce0 0x7f96ec14f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 >> 172.21.15.82:0/2070753624 conn(0x7f96ec0d1180 msgr2=0x7f96ec067d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 shutdown_connections 2023-10-06T03:16:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:30.967+0000 7f96f35dd700 1 -- 172.21.15.82:0/2070753624 wait complete. 2023-10-06T03:16:30.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T03:16:31.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.109+0000 7f434f59e700 1 Processor -- start 2023-10-06T03:16:31.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.109+0000 7f434f59e700 1 -- start start 2023-10-06T03:16:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434f59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4350143260 0x7f435015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434f59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4350069380 con 0x7f435015de80 2023-10-06T03:16:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434f59e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4350069f20 con 0x7f4350142e90 2023-10-06T03:16:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434f59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43500b63a0 con 0x7f4350143260 2023-10-06T03:16:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4350143260 0x7f435015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434dd9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f435015de80 0x7f43500b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47804/0 (socket says 172.21.15.82:47804) 2023-10-06T03:16:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434dd9b700 1 -- 172.21.15.82:0/1403218205 learned_addr learned my addr 172.21.15.82:0/1403218205 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434ed9d700 1 -- 172.21.15.82:0/1403218205 >> v1:172.21.15.134:6789/0 conn(0x7f4350142e90 legacy=0x7f4350069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434ed9d700 1 -- 172.21.15.82:0/1403218205 >> v1:172.21.15.82:6789/0 conn(0x7f435015de80 legacy=0x7f43500b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434d59a700 1 -- 172.21.15.82:0/1403218205 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025967838 0 0) 0x7f4350069380 con 0x7f435015de80 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434ed9d700 1 -- 172.21.15.82:0/1403218205 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350068770 con 0x7f4350143260 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.110+0000 7f434ed9d700 1 --2- 172.21.15.82:0/1403218205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4350143260 0x7f435015d290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4348009e60 tx=0x7f4348009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0273f5c00c82d11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434d59a700 1 -- 172.21.15.82:0/1403218205 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434800e070 con 0x7f4350143260 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434d59a700 1 -- 172.21.15.82:0/1403218205 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434800bbf0 con 0x7f4350143260 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434d59a700 1 -- 172.21.15.82:0/1403218205 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348012430 con 0x7f4350143260 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434f59e700 1 -- 172.21.15.82:0/1403218205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4350143260 msgr2=0x7f435015d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434f59e700 1 --2- 172.21.15.82:0/1403218205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4350143260 0x7f435015d290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4348009e60 tx=0x7f4348009780 comp rx=0 tx=0).stop 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434f59e700 1 -- 172.21.15.82:0/1403218205 shutdown_connections 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434f59e700 1 --2- 172.21.15.82:0/1403218205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4350143260 0x7f435015d290 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434f59e700 1 -- 172.21.15.82:0/1403218205 >> 172.21.15.82:0/1403218205 conn(0x7f43500ccfe0 msgr2=0x7f43500cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:31.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434f59e700 1 -- 172.21.15.82:0/1403218205 shutdown_connections 2023-10-06T03:16:31.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.111+0000 7f434f59e700 1 -- 172.21.15.82:0/1403218205 wait complete. 2023-10-06T03:16:31.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.112+0000 7f434f59e700 1 Processor -- start 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.112+0000 7f434f59e700 1 -- start start 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434f59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4350142e90 0x7f435015ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434f59e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4350143260 0x7f43500c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f435015de80 0x7f43500c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500c5850 con 0x7f435015de80 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434f59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435015b320 con 0x7f4350142e90 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434f59e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435015b600 con 0x7f4350143260 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f435015de80 0x7f43500c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f435015de80 0x7f43500c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47496/0 (socket says 172.21.15.82:47496) 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434ed9d700 1 -- 172.21.15.82:0/1071118597 learned_addr learned my addr 172.21.15.82:0/1071118597 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434e59c700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4350142e90 0x7f435015ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434dd9b700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4350143260 0x7f43500c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434ed9d700 1 -- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4350143260 msgr2=0x7f43500c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434ed9d700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4350143260 0x7f43500c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434ed9d700 1 -- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4350142e90 msgr2=0x7f435015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434ed9d700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4350142e90 0x7f435015ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.113+0000 7f434ed9d700 1 -- 172.21.15.82:0/1071118597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4348009a20 con 0x7f435015de80 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.114+0000 7f434ed9d700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f435015de80 0x7f43500c5f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4350088d50 tx=0x7f4348018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.114+0000 7f433e7fc700 1 -- 172.21.15.82:0/1071118597 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434801e710 con 0x7f435015de80 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.114+0000 7f433e7fc700 1 -- 172.21.15.82:0/1071118597 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434801e890 con 0x7f435015de80 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.114+0000 7f433e7fc700 1 -- 172.21.15.82:0/1071118597 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434801ec50 con 0x7f435015de80 2023-10-06T03:16:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.114+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435015b8e0 con 0x7f435015de80 2023-10-06T03:16:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.114+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435015bea0 con 0x7f435015de80 2023-10-06T03:16:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.115+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435015c090 con 0x7f435015de80 2023-10-06T03:16:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.115+0000 7f433e7fc700 1 -- 172.21.15.82:0/1071118597 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4348024070 con 0x7f435015de80 2023-10-06T03:16:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.115+0000 7f433e7fc700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.116+0000 7f433e7fc700 1 -- 172.21.15.82:0/1071118597 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4348086f70 con 0x7f435015de80 2023-10-06T03:16:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.116+0000 7f434e59c700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.116+0000 7f434e59c700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4330066f30 0x7f43300693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4340003870 tx=0x7f4340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.120+0000 7f433e7fc700 1 -- 172.21.15.82:0/1071118597 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43480b85a0 con 0x7f435015de80 2023-10-06T03:16:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.375+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f435004c3c0 con 0x7f435015de80 2023-10-06T03:16:31.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.378+0000 7f433e7fc700 1 -- 172.21.15.82:0/1071118597 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4348054480 con 0x7f435015de80 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4330066f30 msgr2=0x7f43300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4330066f30 0x7f43300693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4340003870 tx=0x7f4340009040 comp rx=0 tx=0).stop 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f435015de80 msgr2=0x7f43500c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f435015de80 0x7f43500c5f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4350088d50 tx=0x7f4348018000 comp rx=0 tx=0).stop 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 shutdown_connections 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f435015de80 0x7f43500c5f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4350142e90 0x7f435015ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 --2- 172.21.15.82:0/1071118597 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4350143260 0x7f43500c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 >> 172.21.15.82:0/1071118597 conn(0x7f43500ccfe0 msgr2=0x7f435015d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 shutdown_connections 2023-10-06T03:16:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.380+0000 7f434f59e700 1 -- 172.21.15.82:0/1071118597 wait complete. 2023-10-06T03:16:31.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T03:16:31.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.506+0000 7f8c8132f700 1 Processor -- start 2023-10-06T03:16:31.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.506+0000 7f8c8132f700 1 -- start start 2023-10-06T03:16:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c8132f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8c7c0b4000 0x7f8c7c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c8132f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c7c0b1690 0x7f8c7c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c8132f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c0698e0 con 0x7f8c7c15cb10 2023-10-06T03:16:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c8132f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c0b2050 con 0x7f8c7c0b4000 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c8132f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c068fd0 con 0x7f8c7c0b1690 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c727fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8c7c0b4000 0x7f8c7c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c7affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8c7c15cb10 0x7f8c7c0af780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47812/0 (socket says 172.21.15.82:47812) 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c7affd700 1 -- 172.21.15.82:0/3502701649 learned_addr learned my addr 172.21.15.82:0/3502701649 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c727fc700 1 -- 172.21.15.82:0/3502701649 >> v2:172.21.15.134:3300/0 conn(0x7f8c7c0b1690 msgr2=0x7f8c7c0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c7b7fe700 1 --2- 172.21.15.82:0/3502701649 >> v2:172.21.15.134:3300/0 conn(0x7f8c7c0b1690 0x7f8c7c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c7a7fc700 1 -- 172.21.15.82:0/3502701649 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665671768 0 0) 0x7f8c7c0698e0 con 0x7f8c7c15cb10 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c727fc700 1 --2- 172.21.15.82:0/3502701649 >> v2:172.21.15.134:3300/0 conn(0x7f8c7c0b1690 0x7f8c7c0b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c727fc700 1 -- 172.21.15.82:0/3502701649 >> v1:172.21.15.82:6789/0 conn(0x7f8c7c15cb10 legacy=0x7f8c7c0af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c727fc700 1 -- 172.21.15.82:0/3502701649 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0b0020 con 0x7f8c7c0b4000 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c7b7fe700 1 --2- 172.21.15.82:0/3502701649 >> v2:172.21.15.134:3300/0 conn(0x7f8c7c0b1690 0x7f8c7c0b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.507+0000 7f8c727fc700 1 --2- 172.21.15.82:0/3502701649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0b4000 0x7f8c7c159b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c069850 tx=0x7f8c640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3549ef6e3ce57b67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c7a7fc700 1 -- 172.21.15.82:0/3502701649 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400b6b0 con 0x7f8c7c0b4000 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c7a7fc700 1 -- 172.21.15.82:0/3502701649 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6400b810 con 0x7f8c7c0b4000 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c7a7fc700 1 -- 172.21.15.82:0/3502701649 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400bbb0 con 0x7f8c7c0b4000 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c8132f700 1 -- 172.21.15.82:0/3502701649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0b4000 msgr2=0x7f8c7c159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c8132f700 1 --2- 172.21.15.82:0/3502701649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0b4000 0x7f8c7c159b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c069850 tx=0x7f8c640091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c8132f700 1 -- 172.21.15.82:0/3502701649 shutdown_connections 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c8132f700 1 --2- 172.21.15.82:0/3502701649 >> v2:172.21.15.134:3300/0 conn(0x7f8c7c0b1690 0x7f8c7c0b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c8132f700 1 --2- 172.21.15.82:0/3502701649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0b4000 0x7f8c7c159b50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c8132f700 1 -- 172.21.15.82:0/3502701649 >> 172.21.15.82:0/3502701649 conn(0x7f8c7c06d890 msgr2=0x7f8c7c06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c8132f700 1 -- 172.21.15.82:0/3502701649 shutdown_connections 2023-10-06T03:16:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.508+0000 7f8c8132f700 1 -- 172.21.15.82:0/3502701649 wait complete. 2023-10-06T03:16:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.509+0000 7f8c8132f700 1 Processor -- start 2023-10-06T03:16:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.509+0000 7f8c8132f700 1 -- start start 2023-10-06T03:16:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c8132f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c7c0b1690 0x7f8c7c0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c8132f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7c0b4000 0x7f8c7c169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c8132f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c15cb10 0x7f8c7c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c8132f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0a5890 con 0x7f8c7c15cb10 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c8132f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0a5560 con 0x7f8c7c0b1690 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c8132f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c16a4e0 con 0x7f8c7c0b4000 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c7b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c15cb10 0x7f8c7c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c7b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c15cb10 0x7f8c7c1571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47516/0 (socket says 172.21.15.82:47516) 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c7b7fe700 1 -- 172.21.15.82:0/2101216806 learned_addr learned my addr 172.21.15.82:0/2101216806 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c727fc700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7c0b4000 0x7f8c7c169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.510+0000 7f8c7affd700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c7c0b1690 0x7f8c7c0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c7b7fe700 1 -- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7c0b4000 msgr2=0x7f8c7c169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c7b7fe700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7c0b4000 0x7f8c7c169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c7b7fe700 1 -- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c7c0b1690 msgr2=0x7f8c7c0ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c7b7fe700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c7c0b1690 0x7f8c7c0ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c7b7fe700 1 -- 172.21.15.82:0/2101216806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64009420 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c7b7fe700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c15cb10 0x7f8c7c1571d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400a380 tx=0x7f8c74007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c737fe700 1 -- 172.21.15.82:0/2101216806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400ae10 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c737fe700 1 -- 172.21.15.82:0/2101216806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7400d650 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c16a7c0 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c737fe700 1 -- 172.21.15.82:0/2101216806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400da10 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.511+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c16a0b0 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.512+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c064050 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.512+0000 7f8c737fe700 1 -- 172.21.15.82:0/2101216806 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c7401e3b0 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.512+0000 7f8c737fe700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8c5c066f30 0x7f8c5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.513+0000 7f8c737fe700 1 -- 172.21.15.82:0/2101216806 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8c74084d90 con 0x7f8c7c15cb10 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.513+0000 7f8c7affd700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8c5c066f30 0x7f8c5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.513+0000 7f8c7affd700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8c5c066f30 0x7f8c5c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0ce8b0 tx=0x7f8c6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.517+0000 7f8c737fe700 1 -- 172.21.15.82:0/2101216806 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c740521f0 con 0x7f8c7c15cb10 2023-10-06T03:16:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.784+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8c7c069290 con 0x7f8c7c15cb10 2023-10-06T03:16:31.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.787+0000 7f8c737fe700 1 -- 172.21.15.82:0/2101216806 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8c7401a0a0 con 0x7f8c7c15cb10 2023-10-06T03:16:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8c5c066f30 msgr2=0x7f8c5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8c5c066f30 0x7f8c5c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0ce8b0 tx=0x7f8c6c009040 comp rx=0 tx=0).stop 2023-10-06T03:16:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c15cb10 msgr2=0x7f8c7c1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c15cb10 0x7f8c7c1571d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400a380 tx=0x7f8c74007900 comp rx=0 tx=0).stop 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 shutdown_connections 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c15cb10 0x7f8c7c1571d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c7c0b1690 0x7f8c7c0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8c5c066f30 0x7f8c5c0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 --2- 172.21.15.82:0/2101216806 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7c0b4000 0x7f8c7c169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 >> 172.21.15.82:0/2101216806 conn(0x7f8c7c06d890 msgr2=0x7f8c7c158020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 shutdown_connections 2023-10-06T03:16:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.789+0000 7f8c8132f700 1 -- 172.21.15.82:0/2101216806 wait complete. 2023-10-06T03:16:31.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T03:16:31.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.916+0000 7fe220bd2700 1 Processor -- start 2023-10-06T03:16:31.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.916+0000 7fe220bd2700 1 -- start start 2023-10-06T03:16:31.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe220bd2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe21c0cf910 0x7fe21c0cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe220bd2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe21c1598d0 0x7fe21c0cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe220bd2700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c0cb7c0 con 0x7fe21c159500 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe220bd2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c0cba90 con 0x7fe21c0cf910 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe220bd2700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c0cbd70 con 0x7fe21c1598d0 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe211d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe21c0cf910 0x7fe21c0cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe21a59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe21c159500 0x7fe21c0cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47818/0 (socket says 172.21.15.82:47818) 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe21a59c700 1 -- 172.21.15.82:0/1741833040 learned_addr learned my addr 172.21.15.82:0/1741833040 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe211d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe21c0cf910 0x7fe21c0cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47520/0 (socket says 172.21.15.82:47520) 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe21ad9d700 1 --2- 172.21.15.82:0/1741833040 >> v2:172.21.15.134:3300/0 conn(0x7fe21c1598d0 0x7fe21c0cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe211d9b700 1 -- 172.21.15.82:0/1741833040 >> v2:172.21.15.134:3300/0 conn(0x7fe21c1598d0 msgr2=0x7fe21c0cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe211d9b700 1 --2- 172.21.15.82:0/1741833040 >> v2:172.21.15.134:3300/0 conn(0x7fe21c1598d0 0x7fe21c0cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe211d9b700 1 -- 172.21.15.82:0/1741833040 >> v1:172.21.15.82:6789/0 conn(0x7fe21c159500 legacy=0x7fe21c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.917+0000 7fe219d9b700 1 -- 172.21.15.82:0/1741833040 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356781984 0 0) 0x7fe21c0cb7c0 con 0x7fe21c159500 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe211d9b700 1 -- 172.21.15.82:0/1741833040 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0cc050 con 0x7fe21c0cf910 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe211d9b700 1 --2- 172.21.15.82:0/1741833040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c0cf910 0x7fe21c0cad40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe21c06a1d0 tx=0x7fe2040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb74cc7474668b3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe219d9b700 1 -- 172.21.15.82:0/1741833040 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20400b6b0 con 0x7fe21c0cf910 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe219d9b700 1 -- 172.21.15.82:0/1741833040 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20400b810 con 0x7fe21c0cf910 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe219d9b700 1 -- 172.21.15.82:0/1741833040 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20400bbb0 con 0x7fe21c0cf910 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe220bd2700 1 -- 172.21.15.82:0/1741833040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c0cf910 msgr2=0x7fe21c0cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1741833040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c0cf910 0x7fe21c0cad40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe21c06a1d0 tx=0x7fe2040091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe220bd2700 1 -- 172.21.15.82:0/1741833040 shutdown_connections 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1741833040 >> v2:172.21.15.134:3300/0 conn(0x7fe21c1598d0 0x7fe21c0cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1741833040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c0cf910 0x7fe21c0cad40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe220bd2700 1 -- 172.21.15.82:0/1741833040 >> 172.21.15.82:0/1741833040 conn(0x7fe21c0cd090 msgr2=0x7fe21c0cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:31.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe220bd2700 1 -- 172.21.15.82:0/1741833040 shutdown_connections 2023-10-06T03:16:31.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.918+0000 7fe220bd2700 1 -- 172.21.15.82:0/1741833040 wait complete. 2023-10-06T03:16:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.919+0000 7fe220bd2700 1 Processor -- start 2023-10-06T03:16:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe220bd2700 1 -- start start 2023-10-06T03:16:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe220bd2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe21c0cf910 0x7fe21c146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe220bd2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe21c159500 0x7fe21c0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe220bd2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c1598d0 0x7fe21c1696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe220bd2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c15a600 con 0x7fe21c1598d0 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe220bd2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c16a640 con 0x7fe21c159500 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe220bd2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c15a2d0 con 0x7fe21c0cf910 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe21ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c1598d0 0x7fe21c1696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe21ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c1598d0 0x7fe21c1696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47528/0 (socket says 172.21.15.82:47528) 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.920+0000 7fe21ad9d700 1 -- 172.21.15.82:0/1478555330 learned_addr learned my addr 172.21.15.82:0/1478555330 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe211d9b700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe21c159500 0x7fe21c0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe21a59c700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe21c0cf910 0x7fe21c146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe21ad9d700 1 -- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe21c0cf910 msgr2=0x7fe21c146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe21ad9d700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe21c0cf910 0x7fe21c146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe21ad9d700 1 -- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe21c159500 msgr2=0x7fe21c0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe21ad9d700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe21c159500 0x7fe21c0b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe21ad9d700 1 -- 172.21.15.82:0/1478555330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009420 con 0x7fe21c1598d0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe21ad9d700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c1598d0 0x7fe21c1696a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe214007f20 tx=0x7fe214009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe212ffd700 1 -- 172.21.15.82:0/1478555330 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21400eca0 con 0x7fe21c1598d0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe212ffd700 1 -- 172.21.15.82:0/1478555330 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21400ee20 con 0x7fe21c1598d0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c16a080 con 0x7fe21c1598d0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe212ffd700 1 -- 172.21.15.82:0/1478555330 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214014670 con 0x7fe21c1598d0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.921+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c1474d0 con 0x7fe21c1598d0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.922+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21c064050 con 0x7fe21c1598d0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.922+0000 7fe212ffd700 1 -- 172.21.15.82:0/1478555330 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2140149e0 con 0x7fe21c1598d0 2023-10-06T03:16:31.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.923+0000 7fe212ffd700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe1fc066f30 0x7fe1fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:31.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.923+0000 7fe212ffd700 1 -- 172.21.15.82:0/1478555330 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe214084bb0 con 0x7fe21c1598d0 2023-10-06T03:16:31.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.923+0000 7fe21a59c700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe1fc066f30 0x7fe1fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:31.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.923+0000 7fe21a59c700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe1fc066f30 0x7fe1fc0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0011e0 tx=0x7fe20c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:31.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:31.927+0000 7fe212ffd700 1 -- 172.21.15.82:0/1478555330 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe214051f70 con 0x7fe21c1598d0 2023-10-06T03:16:32.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.183+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe21c0d0050 con 0x7fe21c1598d0 2023-10-06T03:16:32.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.188+0000 7fe212ffd700 1 -- 172.21.15.82:0/1478555330 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe214055590 con 0x7fe21c1598d0 2023-10-06T03:16:32.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe1fc066f30 msgr2=0x7fe1fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe1fc066f30 0x7fe1fc0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0011e0 tx=0x7fe20c009040 comp rx=0 tx=0).stop 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c1598d0 msgr2=0x7fe21c1696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c1598d0 0x7fe21c1696a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe214007f20 tx=0x7fe214009860 comp rx=0 tx=0).stop 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 shutdown_connections 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe21c1598d0 0x7fe21c1696a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe1fc066f30 0x7fe1fc0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe21c0cf910 0x7fe21c146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.190+0000 7fe220bd2700 1 --2- 172.21.15.82:0/1478555330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe21c159500 0x7fe21c0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.191+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 >> 172.21.15.82:0/1478555330 conn(0x7fe21c0cd090 msgr2=0x7fe21c152cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.191+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 shutdown_connections 2023-10-06T03:16:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.191+0000 7fe220bd2700 1 -- 172.21.15.82:0/1478555330 wait complete. 2023-10-06T03:16:32.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T03:16:32.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.319+0000 7f20b9ae7700 1 Processor -- start 2023-10-06T03:16:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.319+0000 7f20b9ae7700 1 -- start start 2023-10-06T03:16:32.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b9ae7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b413fee0 0x7f20b40c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b9ae7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b40c87a0 con 0x7f20b406f270 2023-10-06T03:16:32.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b9ae7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b406adb0 con 0x7f20b413fb10 2023-10-06T03:16:32.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b9ae7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b406b090 con 0x7f20b413fee0 2023-10-06T03:16:32.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b3fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f20b406f270 0x7f20b40cb2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47822/0 (socket says 172.21.15.82:47822) 2023-10-06T03:16:32.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b3fff700 1 -- 172.21.15.82:0/3122148557 learned_addr learned my addr 172.21.15.82:0/3122148557 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:32.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b2ffd700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b413fee0 0x7f20b40c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034509943 0 0) 0x7f20b40c87a0 con 0x7f20b406f270 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f209c003570 con 0x7f20b406f270 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3542543280 0 0) 0x7f209c003570 con 0x7f20b406f270 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b413fee0 msgr2=0x7f20b40c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b413fee0 0x7f20b40c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 >> v1:172.21.15.134:6789/0 conn(0x7f20b413fb10 legacy=0x7f20b406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b406b370 con 0x7f20b406f270 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f20ac0017f0 con 0x7f20b406f270 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 >> v1:172.21.15.82:6789/0 conn(0x7f20b406f270 legacy=0x7f20b40cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c003a90 0x7f209c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b413fee0 0x7f209c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f209c004d50 0x7f209c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b406b090 con 0x7f209c004d50 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c00bb70 con 0x7f209c003a90 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.320+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c00bd30 con 0x7f20b413fee0 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b3fff700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f209c004d50 0x7f209c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b2ffd700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b413fee0 0x7f209c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b37fe700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c003a90 0x7f209c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b3fff700 1 -- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b413fee0 msgr2=0x7f209c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b3fff700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b413fee0 0x7f209c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b3fff700 1 -- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c003a90 msgr2=0x7f209c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:32.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b3fff700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c003a90 0x7f209c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b3fff700 1 -- 172.21.15.82:0/3122148557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c003570 con 0x7f209c004d50 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b37fe700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c003a90 0x7f209c003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b3fff700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f209c004d50 0x7f209c0051c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00a930 tx=0x7f20ac0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91ce9524dc47b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0070d0 con 0x7f209c004d50 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac007230 con 0x7f209c004d50 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.321+0000 7f20b27fc700 1 -- 172.21.15.82:0/3122148557 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0075d0 con 0x7f209c004d50 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.322+0000 7f20b9ae7700 1 -- 172.21.15.82:0/3122148557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f209c004d50 msgr2=0x7f209c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.322+0000 7f20b9ae7700 1 --2- 172.21.15.82:0/3122148557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f209c004d50 0x7f209c0051c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00a930 tx=0x7f20ac0021d0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.322+0000 7f20b3fff700 1 -- 172.21.15.82:0/3122148557 reap_dead start 2023-10-06T03:16:32.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.322+0000 7f20b9ae7700 1 -- 172.21.15.82:0/3122148557 shutdown_connections 2023-10-06T03:16:32.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.322+0000 7f20b9ae7700 1 -- 172.21.15.82:0/3122148557 >> 172.21.15.82:0/3122148557 conn(0x7f20b406e760 msgr2=0x7f20b406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:32.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.322+0000 7f20b9ae7700 1 -- 172.21.15.82:0/3122148557 shutdown_connections 2023-10-06T03:16:32.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.322+0000 7f20b9ae7700 1 -- 172.21.15.82:0/3122148557 wait complete. 2023-10-06T03:16:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.323+0000 7f20b9ae7700 1 Processor -- start 2023-10-06T03:16:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.323+0000 7f20b9ae7700 1 -- start start 2023-10-06T03:16:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b9ae7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c004d50 0x7f20b41582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b9ae7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b40c7220 0x7f20b413e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b9ae7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b40c5500 0x7f20b40c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b9ae7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40c50b0 con 0x7f20b40c7220 2023-10-06T03:16:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b9ae7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40b26e0 con 0x7f209c004d50 2023-10-06T03:16:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b9ae7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40b29a0 con 0x7f20b40c5500 2023-10-06T03:16:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b40c7220 0x7f20b413e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b40c7220 0x7f20b413e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47552/0 (socket says 172.21.15.82:47552) 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 -- 172.21.15.82:0/1080163321 learned_addr learned my addr 172.21.15.82:0/1080163321 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b3fff700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b40c5500 0x7f20b40c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b37fe700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c004d50 0x7f20b41582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 -- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b40c5500 msgr2=0x7f20b40c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b40c5500 0x7f20b40c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 -- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c004d50 msgr2=0x7f20b41582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c004d50 0x7f20b41582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 -- 172.21.15.82:0/1080163321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b40b2c80 con 0x7f20b40c7220 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b37fe700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c004d50 0x7f20b41582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b2ffd700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b40c7220 0x7f20b413e280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006ac0 tx=0x7f20a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f209b7fe700 1 -- 172.21.15.82:0/1080163321 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800f940 con 0x7f20b40c7220 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f209b7fe700 1 -- 172.21.15.82:0/1080163321 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800faa0 con 0x7f20b40c7220 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b40b2f60 con 0x7f20b40c7220 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f209b7fe700 1 -- 172.21.15.82:0/1080163321 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800fe20 con 0x7f20b40c7220 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.324+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b413e7c0 con 0x7f20b40c7220 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.325+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b4064050 con 0x7f20b40c7220 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.326+0000 7f209b7fe700 1 -- 172.21.15.82:0/1080163321 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20a8014650 con 0x7f20b40c7220 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.326+0000 7f209b7fe700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20a0066f30 0x7f20a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.326+0000 7f209b7fe700 1 -- 172.21.15.82:0/1080163321 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f20a8018030 con 0x7f20b40c7220 2023-10-06T03:16:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.326+0000 7f20b37fe700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20a0066f30 0x7f20a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.327+0000 7f20b37fe700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20a0066f30 0x7f20a00693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20b4168560 tx=0x7f20a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:32.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.330+0000 7f209b7fe700 1 -- 172.21.15.82:0/1080163321 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20a80521f0 con 0x7f20b40c7220 2023-10-06T03:16:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.590+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f20b40cce00 con 0x7f20b40c7220 2023-10-06T03:16:32.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.595+0000 7f209b7fe700 1 -- 172.21.15.82:0/1080163321 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f20a8055810 con 0x7f20b40c7220 2023-10-06T03:16:32.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20a0066f30 msgr2=0x7f20a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20a0066f30 0x7f20a00693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20b4168560 tx=0x7f20a4009040 comp rx=0 tx=0).stop 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b40c7220 msgr2=0x7f20b413e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b40c7220 0x7f20b413e280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006ac0 tx=0x7f20a80091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 shutdown_connections 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f20a0066f30 0x7f20a00693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20b40c5500 0x7f20b40c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209c004d50 0x7f20b41582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 --2- 172.21.15.82:0/1080163321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b40c7220 0x7f20b413e280 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 >> 172.21.15.82:0/1080163321 conn(0x7f20b406e760 msgr2=0x7f20b406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 shutdown_connections 2023-10-06T03:16:32.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.597+0000 7f20b9ae7700 1 -- 172.21.15.82:0/1080163321 wait complete. 2023-10-06T03:16:32.611 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T03:16:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.727+0000 7f8eeb978700 1 Processor -- start 2023-10-06T03:16:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.727+0000 7f8eeb978700 1 -- start start 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8eeb978700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ee4159500 0x7f8ee41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8eeb978700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 0x7f8ee415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8eeb978700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee415dd20 con 0x7f8ee415d8e0 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8eeb978700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee40b1110 con 0x7f8ee4159500 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8eeb978700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40b13b0 con 0x7f8ee40b3fd0 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee9714700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ee4159500 0x7f8ee41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee9f15700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8ee415d8e0 0x7f8ee40cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47830/0 (socket says 172.21.15.82:47830) 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee9f15700 1 -- 172.21.15.82:0/630703729 learned_addr learned my addr 172.21.15.82:0/630703729 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee8f13700 1 --2- 172.21.15.82:0/630703729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 0x7f8ee415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee9714700 1 -- 172.21.15.82:0/630703729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 msgr2=0x7f8ee415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee9714700 1 --2- 172.21.15.82:0/630703729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 0x7f8ee415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee9714700 1 -- 172.21.15.82:0/630703729 >> v1:172.21.15.82:6789/0 conn(0x7f8ee415d8e0 legacy=0x7f8ee40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8edbfff700 1 -- 172.21.15.82:0/630703729 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596179866 0 0) 0x7f8ee415dd20 con 0x7f8ee415d8e0 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee9714700 1 -- 172.21.15.82:0/630703729 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40b1690 con 0x7f8ee4159500 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8ee9714700 1 --2- 172.21.15.82:0/630703729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee41598d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00098e0 tx=0x7f8ee00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f631c6e2a38b93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8edbfff700 1 -- 172.21.15.82:0/630703729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0009e80 con 0x7f8ee4159500 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8edbfff700 1 -- 172.21.15.82:0/630703729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee000b860 con 0x7f8ee4159500 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.728+0000 7f8edbfff700 1 -- 172.21.15.82:0/630703729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000bbe0 con 0x7f8ee4159500 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.729+0000 7f8eeb978700 1 -- 172.21.15.82:0/630703729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 msgr2=0x7f8ee41598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.729+0000 7f8eeb978700 1 --2- 172.21.15.82:0/630703729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee41598d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00098e0 tx=0x7f8ee00091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.729+0000 7f8eeb978700 1 -- 172.21.15.82:0/630703729 shutdown_connections 2023-10-06T03:16:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.729+0000 7f8eeb978700 1 --2- 172.21.15.82:0/630703729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee41598d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.729+0000 7f8eeb978700 1 --2- 172.21.15.82:0/630703729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 0x7f8ee415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.729+0000 7f8eeb978700 1 -- 172.21.15.82:0/630703729 >> 172.21.15.82:0/630703729 conn(0x7f8ee4067630 msgr2=0x7f8ee4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.729+0000 7f8eeb978700 1 -- 172.21.15.82:0/630703729 shutdown_connections 2023-10-06T03:16:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.729+0000 7f8eeb978700 1 -- 172.21.15.82:0/630703729 wait complete. 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.730+0000 7f8eeb978700 1 Processor -- start 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.730+0000 7f8eeb978700 1 -- start start 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8eeb978700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 0x7f8ee4139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8eeb978700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee4068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8eeb978700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee415d8e0 0x7f8ee4150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8eeb978700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415af90 con 0x7f8ee4159500 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8eeb978700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4139cc0 con 0x7f8ee415d8e0 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8eeb978700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415a380 con 0x7f8ee40b3fd0 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee8f13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee4068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee8f13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee4068c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47566/0 (socket says 172.21.15.82:47566) 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee8f13700 1 -- 172.21.15.82:0/1824165562 learned_addr learned my addr 172.21.15.82:0/1824165562 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee9714700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 0x7f8ee4139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee9f15700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee415d8e0 0x7f8ee4150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee8f13700 1 -- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 msgr2=0x7f8ee4139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee8f13700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 0x7f8ee4139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee8f13700 1 -- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee415d8e0 msgr2=0x7f8ee4150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee8f13700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee415d8e0 0x7f8ee4150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.731+0000 7f8ee8f13700 1 -- 172.21.15.82:0/1824165562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0009420 con 0x7f8ee4159500 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.732+0000 7f8ee8f13700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee4068c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400d890 tx=0x7f8ed4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.732+0000 7f8ed97fa700 1 -- 172.21.15.82:0/1824165562 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40125f0 con 0x7f8ee4159500 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.732+0000 7f8ed97fa700 1 -- 172.21.15.82:0/1824165562 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed4012770 con 0x7f8ee4159500 2023-10-06T03:16:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.732+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee415a660 con 0x7f8ee4159500 2023-10-06T03:16:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.732+0000 7f8ed97fa700 1 -- 172.21.15.82:0/1824165562 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4012b30 con 0x7f8ee4159500 2023-10-06T03:16:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.732+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee415ac20 con 0x7f8ee4159500 2023-10-06T03:16:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.733+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee415b100 con 0x7f8ee4159500 2023-10-06T03:16:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.733+0000 7f8ed97fa700 1 -- 172.21.15.82:0/1824165562 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ed401e460 con 0x7f8ee4159500 2023-10-06T03:16:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.733+0000 7f8ed97fa700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.733+0000 7f8ed97fa700 1 -- 172.21.15.82:0/1824165562 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8ed4084a40 con 0x7f8ee4159500 2023-10-06T03:16:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.734+0000 7f8ee9714700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.734+0000 7f8ee9714700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ec8066f30 0x7f8ec80693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00091e0 tx=0x7f8ee0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:32.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.737+0000 7f8ed97fa700 1 -- 172.21.15.82:0/1824165562 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ed4086e60 con 0x7f8ee4159500 2023-10-06T03:16:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.993+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8ee4064050 con 0x7f8ee4159500 2023-10-06T03:16:33.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:32.998+0000 7f8ed97fa700 1 -- 172.21.15.82:0/1824165562 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8ed4051ea0 con 0x7f8ee4159500 2023-10-06T03:16:33.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ec8066f30 msgr2=0x7f8ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ec8066f30 0x7f8ec80693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00091e0 tx=0x7f8ee0017000 comp rx=0 tx=0).stop 2023-10-06T03:16:33.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 msgr2=0x7f8ee4068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee4068c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400d890 tx=0x7f8ed4008040 comp rx=0 tx=0).stop 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 shutdown_connections 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee415d8e0 0x7f8ee4150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ee40b3fd0 0x7f8ee4139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 --2- 172.21.15.82:0/1824165562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ee4159500 0x7f8ee4068c50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 >> 172.21.15.82:0/1824165562 conn(0x7f8ee4067630 msgr2=0x7f8ee40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 shutdown_connections 2023-10-06T03:16:33.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.000+0000 7f8eeb978700 1 -- 172.21.15.82:0/1824165562 wait complete. 2023-10-06T03:16:33.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T03:16:33.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.127+0000 7f2a52a22700 1 Processor -- start 2023-10-06T03:16:33.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.127+0000 7f2a52a22700 1 -- start start 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a52a22700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c159500 0x7f2a4c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a52a22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2a4c0b3fd0 0x7f2a4c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a52a22700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c15dd20 con 0x7f2a4c15d8e0 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a52a22700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b1110 con 0x7f2a4c0b3fd0 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a52a22700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b13b0 con 0x7f2a4c159500 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2a4c0b3fd0 0x7f2a4c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2a4c0b3fd0 0x7f2a4c15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47572/0 (socket says 172.21.15.82:47572) 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4b7fe700 1 -- 172.21.15.82:0/2920297985 learned_addr learned my addr 172.21.15.82:0/2920297985 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4b7fe700 1 -- 172.21.15.82:0/2920297985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c159500 msgr2=0x7f2a4c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4b7fe700 1 --2- 172.21.15.82:0/2920297985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c159500 0x7f2a4c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4b7fe700 1 -- 172.21.15.82:0/2920297985 >> v1:172.21.15.134:6789/0 conn(0x7f2a4c15d8e0 legacy=0x7f2a4c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4b7fe700 1 -- 172.21.15.82:0/2920297985 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0b1690 con 0x7f2a4c0b3fd0 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4b7fe700 1 --2- 172.21.15.82:0/2920297985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c0b3fd0 0x7f2a4c15d3a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2a400099b0 tx=0x7f2a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f75d226c2c4dfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4affd700 1 -- 172.21.15.82:0/2920297985 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000b820 con 0x7f2a4c0b3fd0 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4affd700 1 -- 172.21.15.82:0/2920297985 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4000b980 con 0x7f2a4c0b3fd0 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.128+0000 7f2a4affd700 1 -- 172.21.15.82:0/2920297985 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000bd20 con 0x7f2a4c0b3fd0 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.129+0000 7f2a52a22700 1 -- 172.21.15.82:0/2920297985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c0b3fd0 msgr2=0x7f2a4c15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.129+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2920297985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c0b3fd0 0x7f2a4c15d3a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2a400099b0 tx=0x7f2a40009250 comp rx=0 tx=0).stop 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.129+0000 7f2a52a22700 1 -- 172.21.15.82:0/2920297985 shutdown_connections 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.129+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2920297985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c159500 0x7f2a4c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.129+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2920297985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c0b3fd0 0x7f2a4c15d3a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.129+0000 7f2a52a22700 1 -- 172.21.15.82:0/2920297985 >> 172.21.15.82:0/2920297985 conn(0x7f2a4c067630 msgr2=0x7f2a4c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:33.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.129+0000 7f2a52a22700 1 -- 172.21.15.82:0/2920297985 shutdown_connections 2023-10-06T03:16:33.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.129+0000 7f2a52a22700 1 -- 172.21.15.82:0/2920297985 wait complete. 2023-10-06T03:16:33.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.130+0000 7f2a52a22700 1 Processor -- start 2023-10-06T03:16:33.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.130+0000 7f2a52a22700 1 -- start start 2023-10-06T03:16:33.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a52a22700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a4c0b3fd0 0x7f2a4c14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a52a22700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c159500 0x7f2a4c15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a52a22700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c15d8e0 0x7f2a4c143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a52a22700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1501a0 con 0x7f2a4c159500 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a52a22700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c15c090 con 0x7f2a4c0b3fd0 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a52a22700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c15c370 con 0x7f2a4c15d8e0 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a4b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c159500 0x7f2a4c15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a4b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c159500 0x7f2a4c15b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47574/0 (socket says 172.21.15.82:47574) 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a4b7fe700 1 -- 172.21.15.82:0/2851427451 learned_addr learned my addr 172.21.15.82:0/2851427451 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a50fbf700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c15d8e0 0x7f2a4c143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a4b7fe700 1 -- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c15d8e0 msgr2=0x7f2a4c143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a4b7fe700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c15d8e0 0x7f2a4c143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a4b7fe700 1 -- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a4c0b3fd0 msgr2=0x7f2a4c14cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a4b7fe700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a4c0b3fd0 0x7f2a4c14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.131+0000 7f2a4b7fe700 1 -- 172.21.15.82:0/2851427451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400094f0 con 0x7f2a4c159500 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.132+0000 7f2a4b7fe700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c159500 0x7f2a4c15b860 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009290 tx=0x7f2a40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.132+0000 7f2a33fff700 1 -- 172.21.15.82:0/2851427451 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40026480 con 0x7f2a4c159500 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.132+0000 7f2a33fff700 1 -- 172.21.15.82:0/2851427451 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4001f070 con 0x7f2a4c159500 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.132+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c15c650 con 0x7f2a4c159500 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.132+0000 7f2a33fff700 1 -- 172.21.15.82:0/2851427451 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40026850 con 0x7f2a4c159500 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.132+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c15c930 con 0x7f2a4c159500 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.133+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c064050 con 0x7f2a4c159500 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.133+0000 7f2a33fff700 1 -- 172.21.15.82:0/2851427451 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a4001a440 con 0x7f2a4c159500 2023-10-06T03:16:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.134+0000 7f2a33fff700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2a38066fb0 0x7f2a38069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.134+0000 7f2a33fff700 1 -- 172.21.15.82:0/2851427451 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2a40021070 con 0x7f2a4c159500 2023-10-06T03:16:33.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.134+0000 7f2a4bfff700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2a38066fb0 0x7f2a38069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.134+0000 7f2a4bfff700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2a38066fb0 0x7f2a38069460 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c006fd0 tx=0x7f2a3c006db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.138+0000 7f2a33fff700 1 -- 172.21.15.82:0/2851427451 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a40053a60 con 0x7f2a4c159500 2023-10-06T03:16:33.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.400+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2a4c0b1970 con 0x7f2a4c159500 2023-10-06T03:16:33.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.406+0000 7f2a33fff700 1 -- 172.21.15.82:0/2851427451 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2a40086020 con 0x7f2a4c159500 2023-10-06T03:16:33.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2a38066fb0 msgr2=0x7f2a38069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2a38066fb0 0x7f2a38069460 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c006fd0 tx=0x7f2a3c006db0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c159500 msgr2=0x7f2a4c15b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c159500 0x7f2a4c15b860 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009290 tx=0x7f2a40016000 comp rx=0 tx=0).stop 2023-10-06T03:16:33.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 shutdown_connections 2023-10-06T03:16:33.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2a38066fb0 0x7f2a38069460 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a4c15d8e0 0x7f2a4c143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a4c0b3fd0 0x7f2a4c14cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 --2- 172.21.15.82:0/2851427451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c159500 0x7f2a4c15b860 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 >> 172.21.15.82:0/2851427451 conn(0x7f2a4c067630 msgr2=0x7f2a4c15d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:33.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 shutdown_connections 2023-10-06T03:16:33.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.408+0000 7f2a52a22700 1 -- 172.21.15.82:0/2851427451 wait complete. 2023-10-06T03:16:33.422 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.534+0000 7f9e12121700 1 Processor -- start 2023-10-06T03:16:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.534+0000 7f9e12121700 1 -- start start 2023-10-06T03:16:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.534+0000 7f9e12121700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15d560 0x7f9e0c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.534+0000 7f9e12121700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9e0c1591b0 0x7f9e0c159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.534+0000 7f9e12121700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c0b2ad0 con 0x7f9e0c15d930 2023-10-06T03:16:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.534+0000 7f9e12121700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c0b4160 con 0x7f9e0c1591b0 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.534+0000 7f9e12121700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c159b70 con 0x7f9e0c15d560 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e0c15d930 0x7f9e0c0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47832/0 (socket says 172.21.15.82:47832) 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0affd700 1 -- 172.21.15.82:0/2001973828 learned_addr learned my addr 172.21.15.82:0/2001973828 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0b7fe700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15d560 0x7f9e0c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0bfff700 1 --2- 172.21.15.82:0/2001973828 >> v2:172.21.15.134:3300/0 conn(0x7f9e0c1591b0 0x7f9e0c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117318042 0 0) 0x7f9e0c0b2ad0 con 0x7f9e0c15d930 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df8003570 con 0x7f9e0c15d930 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4074484035 0 0) 0x7f9df8003570 con 0x7f9e0c15d930 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15d560 msgr2=0x7f9e0c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15d560 0x7f9e0c0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 >> v2:172.21.15.134:3300/0 conn(0x7f9e0c1591b0 msgr2=0x7f9e0c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 --2- 172.21.15.82:0/2001973828 >> v2:172.21.15.134:3300/0 conn(0x7f9e0c1591b0 0x7f9e0c159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0b2230 con 0x7f9e0c15d930 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f9df4001470 con 0x7f9e0c15d930 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0bfff700 1 --2- 172.21.15.82:0/2001973828 >> v2:172.21.15.134:3300/0 conn(0x7f9e0c1591b0 0x7f9e0c159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 >> v1:172.21.15.82:6789/0 conn(0x7f9e0c15d930 legacy=0x7f9e0c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df8003a60 0x7f9df8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df8004810 0x7f9df8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df80051c0 0x7f9df800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0b4160 con 0x7f9df8003a60 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c159b70 con 0x7f9df80051c0 2023-10-06T03:16:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df800bfa0 con 0x7f9df8004810 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0b7fe700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15d560 0x7f9e0c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0b7fe700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df8003a60 0x7f9df8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0bfff700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df80051c0 0x7f9df800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.535+0000 7f9e0affd700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df8004810 0x7f9df8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0affd700 1 -- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df80051c0 msgr2=0x7f9df800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0affd700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df80051c0 0x7f9df800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0affd700 1 -- 172.21.15.82:0/2001973828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df8003a60 msgr2=0x7f9df8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0affd700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df8003a60 0x7f9df8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0affd700 1 -- 172.21.15.82:0/2001973828 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8003570 con 0x7f9df8004810 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0bfff700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df80051c0 0x7f9df800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0b7fe700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df8003a60 0x7f9df8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0affd700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df8004810 0x7f9df8004c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c3f0 tx=0x7f9e0c0d0570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37187caf750e6ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400cc20 con 0x7f9df8004810 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df400cdc0 con 0x7f9df8004810 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0a7fc700 1 -- 172.21.15.82:0/2001973828 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4005b70 con 0x7f9df8004810 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e12121700 1 -- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df8004810 msgr2=0x7f9df8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e12121700 1 --2- 172.21.15.82:0/2001973828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df8004810 0x7f9df8004c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c3f0 tx=0x7f9e0c0d0570 comp rx=0 tx=0).stop 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.536+0000 7f9e0bfff700 1 -- 172.21.15.82:0/2001973828 reap_dead start 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.537+0000 7f9e12121700 1 -- 172.21.15.82:0/2001973828 shutdown_connections 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.537+0000 7f9e12121700 1 -- 172.21.15.82:0/2001973828 >> 172.21.15.82:0/2001973828 conn(0x7f9e0c0d1180 msgr2=0x7f9e0c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.537+0000 7f9e12121700 1 -- 172.21.15.82:0/2001973828 shutdown_connections 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.537+0000 7f9e12121700 1 -- 172.21.15.82:0/2001973828 wait complete. 2023-10-06T03:16:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.538+0000 7f9e12121700 1 Processor -- start 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.538+0000 7f9e12121700 1 -- start start 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.538+0000 7f9e12121700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df8004810 0x7f9e0c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.538+0000 7f9e12121700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15a2e0 0x7f9e0c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.538+0000 7f9e12121700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0c0ae530 0x7f9e0c0ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.538+0000 7f9e12121700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0aeef0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.538+0000 7f9e12121700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15c180 con 0x7f9df8004810 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.538+0000 7f9e12121700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15c3f0 con 0x7f9e0c15a2e0 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0c0ae530 0x7f9e0c0ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0c0ae530 0x7f9e0c0ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47582/0 (socket says 172.21.15.82:47582) 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 -- 172.21.15.82:0/2191089365 learned_addr learned my addr 172.21.15.82:0/2191089365 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0affd700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15a2e0 0x7f9e0c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0b7fe700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df8004810 0x7f9e0c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 -- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15a2e0 msgr2=0x7f9e0c15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15a2e0 0x7f9e0c15a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 -- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df8004810 msgr2=0x7f9e0c150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df8004810 0x7f9e0c150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 -- 172.21.15.82:0/2191089365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c15c6d0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0affd700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15a2e0 0x7f9e0c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0b7fe700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df8004810 0x7f9e0c150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e0bfff700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0c0ae530 0x7f9e0c0ae9b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e040094d0 tx=0x7f9e0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e037fe700 1 -- 172.21.15.82:0/2191089365 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0400e040 con 0x7f9e0c0ae530 2023-10-06T03:16:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e037fe700 1 -- 172.21.15.82:0/2191089365 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0400f040 con 0x7f9e0c0ae530 2023-10-06T03:16:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c15c9b0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e037fe700 1 -- 172.21.15.82:0/2191089365 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04015660 con 0x7f9e0c0ae530 2023-10-06T03:16:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.539+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c1508b0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.540+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c15ced0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.541+0000 7f9e037fe700 1 -- 172.21.15.82:0/2191089365 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e040159d0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.541+0000 7f9e037fe700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9dec066f30 0x7f9dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.541+0000 7f9e037fe700 1 -- 172.21.15.82:0/2191089365 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9e04084d50 con 0x7f9e0c0ae530 2023-10-06T03:16:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.541+0000 7f9e0b7fe700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9dec066f30 0x7f9dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.542+0000 7f9e0b7fe700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9dec066f30 0x7f9dec0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0097c0 tx=0x7f9dfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.545+0000 7f9e037fe700 1 -- 172.21.15.82:0/2191089365 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e0c15ced0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.730+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e0c15ced0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.731+0000 7f9e037fe700 1 -- 172.21.15.82:0/2191089365 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f9e0c15ced0 con 0x7f9e0c0ae530 2023-10-06T03:16:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:33.733 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:16:30.567028+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9dec066f30 msgr2=0x7f9dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9dec066f30 0x7f9dec0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0097c0 tx=0x7f9dfc008040 comp rx=0 tx=0).stop 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0c0ae530 msgr2=0x7f9e0c0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0c0ae530 0x7f9e0c0ae9b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e040094d0 tx=0x7f9e0400b040 comp rx=0 tx=0).stop 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 shutdown_connections 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0c0ae530 0x7f9e0c0ae9b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df8004810 0x7f9e0c150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9dec066f30 0x7f9dec0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 --2- 172.21.15.82:0/2191089365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e0c15a2e0 0x7f9e0c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 >> 172.21.15.82:0/2191089365 conn(0x7f9e0c0d1180 msgr2=0x7f9e0c157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 shutdown_connections 2023-10-06T03:16:33.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.733+0000 7f9e12121700 1 -- 172.21.15.82:0/2191089365 wait complete. 2023-10-06T03:16:33.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:16:33.748 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.863+0000 7fadbf113700 1 Processor -- start 2023-10-06T03:16:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.863+0000 7fadbf113700 1 -- start start 2023-10-06T03:16:33.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.863+0000 7fadbf113700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fadb80b4000 0x7fadb8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.863+0000 7fadbf113700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadb80b1690 0x7fadb80b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.863+0000 7fadbf113700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80698e0 con 0x7fadb815cb10 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.863+0000 7fadbf113700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb80b2050 con 0x7fadb80b1690 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.863+0000 7fadbf113700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb8068fd0 con 0x7fadb80b4000 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadbd6b0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadb80b1690 0x7fadb80b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadbceaf700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fadb815cb10 0x7fadb80af780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47834/0 (socket says 172.21.15.82:47834) 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadbceaf700 1 -- 172.21.15.82:0/1758240001 learned_addr learned my addr 172.21.15.82:0/1758240001 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadb7fff700 1 --2- 172.21.15.82:0/1758240001 >> v2:172.21.15.134:3300/0 conn(0x7fadb80b4000 0x7fadb8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadbd6b0700 1 -- 172.21.15.82:0/1758240001 >> v2:172.21.15.134:3300/0 conn(0x7fadb80b4000 msgr2=0x7fadb8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadbd6b0700 1 --2- 172.21.15.82:0/1758240001 >> v2:172.21.15.134:3300/0 conn(0x7fadb80b4000 0x7fadb8159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadbd6b0700 1 -- 172.21.15.82:0/1758240001 >> v1:172.21.15.82:6789/0 conn(0x7fadb815cb10 legacy=0x7fadb80af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadbd6b0700 1 -- 172.21.15.82:0/1758240001 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb80b0020 con 0x7fadb80b1690 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadb77fe700 1 -- 172.21.15.82:0/1758240001 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292545265 0 0) 0x7fadb80698e0 con 0x7fadb815cb10 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadb7fff700 1 --2- 172.21.15.82:0/1758240001 >> v2:172.21.15.134:3300/0 conn(0x7fadb80b4000 0x7fadb8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadbd6b0700 1 --2- 172.21.15.82:0/1758240001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb80b1b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadb806f7c0 tx=0x7fadb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2e389c8c5740f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadb77fe700 1 -- 172.21.15.82:0/1758240001 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000b6b0 con 0x7fadb80b1690 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadb77fe700 1 -- 172.21.15.82:0/1758240001 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb000b810 con 0x7fadb80b1690 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.864+0000 7fadb77fe700 1 -- 172.21.15.82:0/1758240001 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000bbb0 con 0x7fadb80b1690 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.865+0000 7fadbf113700 1 -- 172.21.15.82:0/1758240001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 msgr2=0x7fadb80b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.865+0000 7fadbf113700 1 --2- 172.21.15.82:0/1758240001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb80b1b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadb806f7c0 tx=0x7fadb00091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.865+0000 7fadbf113700 1 -- 172.21.15.82:0/1758240001 shutdown_connections 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.865+0000 7fadbf113700 1 --2- 172.21.15.82:0/1758240001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb80b1b10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.865+0000 7fadbf113700 1 --2- 172.21.15.82:0/1758240001 >> v2:172.21.15.134:3300/0 conn(0x7fadb80b4000 0x7fadb8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.865+0000 7fadbf113700 1 -- 172.21.15.82:0/1758240001 >> 172.21.15.82:0/1758240001 conn(0x7fadb806d890 msgr2=0x7fadb806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:33.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.865+0000 7fadbf113700 1 -- 172.21.15.82:0/1758240001 shutdown_connections 2023-10-06T03:16:33.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.865+0000 7fadbf113700 1 -- 172.21.15.82:0/1758240001 wait complete. 2023-10-06T03:16:33.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.866+0000 7fadbf113700 1 Processor -- start 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.866+0000 7fadbf113700 1 -- start start 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbf113700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb8151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbf113700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadb80b4000 0x7fadb8156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbf113700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815cb10 0x7fadb806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbf113700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8156b70 con 0x7fadb80b1690 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbf113700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb81522b0 con 0x7fadb80b4000 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbf113700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8152590 con 0x7fadb815cb10 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb8151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb8151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47596/0 (socket says 172.21.15.82:47596) 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 -- 172.21.15.82:0/667800819 learned_addr learned my addr 172.21.15.82:0/667800819 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:33.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadb7fff700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadb80b4000 0x7fadb8156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbd6b0700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815cb10 0x7fadb806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 -- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815cb10 msgr2=0x7fadb806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815cb10 0x7fadb806c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 -- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadb80b4000 msgr2=0x7fadb8156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadb80b4000 0x7fadb8156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 -- 172.21.15.82:0/667800819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0009420 con 0x7fadb80b1690 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadb7fff700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadb80b4000 0x7fadb8156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbd6b0700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815cb10 0x7fadb806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbceaf700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb8151c60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fada800cc70 tx=0x7fada8001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadb4ff9700 1 -- 172.21.15.82:0/667800819 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800ce80 con 0x7fadb80b1690 2023-10-06T03:16:33.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadb4ff9700 1 -- 172.21.15.82:0/667800819 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada800ac00 con 0x7fadb80b1690 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb8152870 con 0x7fadb80b1690 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadb4ff9700 1 -- 172.21.15.82:0/667800819 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada80070f0 con 0x7fadb80b1690 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.867+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb8152e30 con 0x7fadb80b1690 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.868+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb81531a0 con 0x7fadb80b1690 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.869+0000 7fadb4ff9700 1 -- 172.21.15.82:0/667800819 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fada80074e0 con 0x7fadb80b1690 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.869+0000 7fadb4ff9700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fada4066f30 0x7fada40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.869+0000 7fadb4ff9700 1 -- 172.21.15.82:0/667800819 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fada80848f0 con 0x7fadb80b1690 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.869+0000 7fadb7fff700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fada4066f30 0x7fada40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.870+0000 7fadb7fff700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fada4066f30 0x7fada40693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fadac006f00 tx=0x7fadac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:33.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:33.873+0000 7fadb4ff9700 1 -- 172.21.15.82:0/667800819 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fada8051dd0 con 0x7fadb80b1690 2023-10-06T03:16:34.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.057+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fadb8064050 con 0x7fadb80b1690 2023-10-06T03:16:34.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.058+0000 7fadb4ff9700 1 -- 172.21.15.82:0/667800819 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fada80553f0 con 0x7fadb80b1690 2023-10-06T03:16:34.061 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fada4066f30 msgr2=0x7fada40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fada4066f30 0x7fada40693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fadac006f00 tx=0x7fadac008040 comp rx=0 tx=0).stop 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 msgr2=0x7fadb8151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb8151c60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fada800cc70 tx=0x7fada8001a30 comp rx=0 tx=0).stop 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 shutdown_connections 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fada4066f30 0x7fada40693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815cb10 0x7fadb806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb80b1690 0x7fadb8151c60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 --2- 172.21.15.82:0/667800819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadb80b4000 0x7fadb8156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 >> 172.21.15.82:0/667800819 conn(0x7fadb806d890 msgr2=0x7fadb8159920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:34.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 shutdown_connections 2023-10-06T03:16:34.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.060+0000 7fadbf113700 1 -- 172.21.15.82:0/667800819 wait complete. 2023-10-06T03:16:34.073 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.188+0000 7fdc1fcd6700 1 Processor -- start 2023-10-06T03:16:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.188+0000 7fdc1fcd6700 1 -- start start 2023-10-06T03:16:34.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1fcd6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdc18159500 0x7fdc181598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1fcd6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc180cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1fcd6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc180b1110 con 0x7fdc180b3fd0 2023-10-06T03:16:34.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1fcd6700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180b13b0 con 0x7fdc18159500 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1fcd6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180b1690 con 0x7fdc1815dab0 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1da72700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdc18159500 0x7fdc181598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1da72700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdc18159500 0x7fdc181598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47604/0 (socket says 172.21.15.82:47604) 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1da72700 1 -- 172.21.15.82:0/4192752395 learned_addr learned my addr 172.21.15.82:0/4192752395 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1d271700 1 --1- 172.21.15.82:0/4192752395 >> v1:172.21.15.82:6789/0 conn(0x7fdc180b3fd0 0x7fdc1815d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47850/0 (socket says 172.21.15.82:47850) 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1e273700 1 --2- 172.21.15.82:0/4192752395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc180cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1da72700 1 -- 172.21.15.82:0/4192752395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 msgr2=0x7fdc180cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1da72700 1 --2- 172.21.15.82:0/4192752395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc180cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1da72700 1 -- 172.21.15.82:0/4192752395 >> v1:172.21.15.82:6789/0 conn(0x7fdc180b3fd0 legacy=0x7fdc1815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.189+0000 7fdc1da72700 1 -- 172.21.15.82:0/4192752395 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180b1970 con 0x7fdc18159500 2023-10-06T03:16:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1da72700 1 --2- 172.21.15.82:0/4192752395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc18159500 0x7fdc181598d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009f20 tx=0x7fdc08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7511b69fea436b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1ca70700 1 -- 172.21.15.82:0/4192752395 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0800e070 con 0x7fdc18159500 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1ca70700 1 -- 172.21.15.82:0/4192752395 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0800ba80 con 0x7fdc18159500 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1ca70700 1 -- 172.21.15.82:0/4192752395 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc080092e0 con 0x7fdc18159500 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/4192752395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc18159500 msgr2=0x7fdc181598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/4192752395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc18159500 0x7fdc181598d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009f20 tx=0x7fdc08009840 comp rx=0 tx=0).stop 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/4192752395 shutdown_connections 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/4192752395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc18159500 0x7fdc181598d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/4192752395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc180cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/4192752395 >> 172.21.15.82:0/4192752395 conn(0x7fdc18067630 msgr2=0x7fdc18069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/4192752395 shutdown_connections 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.190+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/4192752395 wait complete. 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.191+0000 7fdc1fcd6700 1 Processor -- start 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.191+0000 7fdc1fcd6700 1 -- start start 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1fcd6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc180b3fd0 0x7fdc181598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1fcd6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc18159500 0x7fdc1816a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1fcd6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc1814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1fcd6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1816b1d0 con 0x7fdc180b3fd0 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1fcd6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc18159fd0 con 0x7fdc18159500 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1fcd6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1815a2b0 con 0x7fdc1815dab0 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1da72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc180b3fd0 0x7fdc181598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1da72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc180b3fd0 0x7fdc181598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47616/0 (socket says 172.21.15.82:47616) 2023-10-06T03:16:34.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1da72700 1 -- 172.21.15.82:0/468767904 learned_addr learned my addr 172.21.15.82:0/468767904 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:34.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1e273700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc1814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1d271700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc18159500 0x7fdc1816a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1da72700 1 -- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 msgr2=0x7fdc1814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1da72700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc1814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1da72700 1 -- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc18159500 msgr2=0x7fdc1816a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1da72700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc18159500 0x7fdc1816a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1da72700 1 -- 172.21.15.82:0/468767904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009ae0 con 0x7fdc180b3fd0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.192+0000 7fdc1e273700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc1814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.193+0000 7fdc1da72700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc180b3fd0 0x7fdc181598d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800b6c0 tx=0x7fdc08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.193+0000 7fdc15ffb700 1 -- 172.21.15.82:0/468767904 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08008bb0 con 0x7fdc180b3fd0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.193+0000 7fdc15ffb700 1 -- 172.21.15.82:0/468767904 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08008d10 con 0x7fdc180b3fd0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.193+0000 7fdc15ffb700 1 -- 172.21.15.82:0/468767904 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc080266b0 con 0x7fdc180b3fd0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.193+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1815a590 con 0x7fdc180b3fd0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.193+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1814cdf0 con 0x7fdc180b3fd0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.194+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc180cde20 con 0x7fdc180b3fd0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.194+0000 7fdc15ffb700 1 -- 172.21.15.82:0/468767904 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc08003040 con 0x7fdc180b3fd0 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.195+0000 7fdc15ffb700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc04066f30 0x7fdc040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.195+0000 7fdc15ffb700 1 -- 172.21.15.82:0/468767904 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdc08086200 con 0x7fdc180b3fd0 2023-10-06T03:16:34.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.195+0000 7fdc1d271700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc04066f30 0x7fdc040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.195+0000 7fdc1d271700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc04066f30 0x7fdc040693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007fd0 tx=0x7fdc0c007d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.199+0000 7fdc15ffb700 1 -- 172.21.15.82:0/468767904 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc08053660 con 0x7fdc180b3fd0 2023-10-06T03:16:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.383+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc1814cfe0 con 0x7fdc180b3fd0 2023-10-06T03:16:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.384+0000 7fdc15ffb700 1 -- 172.21.15.82:0/468767904 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc08056c80 con 0x7fdc180b3fd0 2023-10-06T03:16:34.386 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc04066f30 msgr2=0x7fdc040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc04066f30 0x7fdc040693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007fd0 tx=0x7fdc0c007d70 comp rx=0 tx=0).stop 2023-10-06T03:16:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc180b3fd0 msgr2=0x7fdc181598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc180b3fd0 0x7fdc181598d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800b6c0 tx=0x7fdc08018000 comp rx=0 tx=0).stop 2023-10-06T03:16:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 shutdown_connections 2023-10-06T03:16:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc04066f30 0x7fdc040693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc1815dab0 0x7fdc1814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc180b3fd0 0x7fdc181598d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 --2- 172.21.15.82:0/468767904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc18159500 0x7fdc1816a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 >> 172.21.15.82:0/468767904 conn(0x7fdc18067630 msgr2=0x7fdc18069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 shutdown_connections 2023-10-06T03:16:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.386+0000 7fdc1fcd6700 1 -- 172.21.15.82:0/468767904 wait complete. 2023-10-06T03:16:34.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:16:34.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.512+0000 7f2f3f926700 1 Processor -- start 2023-10-06T03:16:34.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.512+0000 7f2f3f926700 1 -- start start 2023-10-06T03:16:34.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.513+0000 7f2f3f926700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2f38157570 0x7f2f380b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.513+0000 7f2f3f926700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f3815b210 0x7f2f38158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.513+0000 7f2f3f926700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f381580d0 con 0x7f2f380add70 2023-10-06T03:16:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.513+0000 7f2f3f926700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3815ba40 con 0x7f2f3815b210 2023-10-06T03:16:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.513+0000 7f2f3f926700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3815bd20 con 0x7f2f38157570 2023-10-06T03:16:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.513+0000 7f2f3cec1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f3815b210 0x7f2f38158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.513+0000 7f2f3dec3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2f380add70 0x7f2f380ae190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47854/0 (socket says 172.21.15.82:47854) 2023-10-06T03:16:34.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.513+0000 7f2f3dec3700 1 -- 172.21.15.82:0/452442244 learned_addr learned my addr 172.21.15.82:0/452442244 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:34.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3d6c2700 1 --2- 172.21.15.82:0/452442244 >> v2:172.21.15.134:3300/0 conn(0x7f2f38157570 0x7f2f380b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3cec1700 1 -- 172.21.15.82:0/452442244 >> v2:172.21.15.134:3300/0 conn(0x7f2f38157570 msgr2=0x7f2f380b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:34.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3cec1700 1 --2- 172.21.15.82:0/452442244 >> v2:172.21.15.134:3300/0 conn(0x7f2f38157570 0x7f2f380b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3cec1700 1 -- 172.21.15.82:0/452442244 >> v1:172.21.15.82:6789/0 conn(0x7f2f380add70 legacy=0x7f2f380ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f2ffff700 1 -- 172.21.15.82:0/452442244 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229030937 0 0) 0x7f2f381580d0 con 0x7f2f380add70 2023-10-06T03:16:34.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3cec1700 1 -- 172.21.15.82:0/452442244 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38157d60 con 0x7f2f3815b210 2023-10-06T03:16:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3cec1700 1 --2- 172.21.15.82:0/452442244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f38158560 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f38064960 tx=0x7f2f280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a5e80f05b72975 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f2ffff700 1 -- 172.21.15.82:0/452442244 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800b6b0 con 0x7f2f3815b210 2023-10-06T03:16:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f2ffff700 1 -- 172.21.15.82:0/452442244 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2800b810 con 0x7f2f3815b210 2023-10-06T03:16:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f2ffff700 1 -- 172.21.15.82:0/452442244 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800bbb0 con 0x7f2f3815b210 2023-10-06T03:16:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3f926700 1 -- 172.21.15.82:0/452442244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 msgr2=0x7f2f38158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3f926700 1 --2- 172.21.15.82:0/452442244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f38158560 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f38064960 tx=0x7f2f280091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3f926700 1 -- 172.21.15.82:0/452442244 shutdown_connections 2023-10-06T03:16:34.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.514+0000 7f2f3f926700 1 --2- 172.21.15.82:0/452442244 >> v2:172.21.15.134:3300/0 conn(0x7f2f38157570 0x7f2f380b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.515+0000 7f2f3f926700 1 --2- 172.21.15.82:0/452442244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f38158560 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.515+0000 7f2f3f926700 1 -- 172.21.15.82:0/452442244 >> 172.21.15.82:0/452442244 conn(0x7f2f38067630 msgr2=0x7f2f38067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:34.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.515+0000 7f2f3f926700 1 -- 172.21.15.82:0/452442244 shutdown_connections 2023-10-06T03:16:34.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.515+0000 7f2f3f926700 1 -- 172.21.15.82:0/452442244 wait complete. 2023-10-06T03:16:34.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.516+0000 7f2f3f926700 1 Processor -- start 2023-10-06T03:16:34.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.516+0000 7f2f3f926700 1 -- start start 2023-10-06T03:16:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3f926700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f380add70 0x7f2f380c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3f926700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f38157570 0x7f2f38154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3f926700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f380ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3f926700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380c9960 con 0x7f2f3815b210 2023-10-06T03:16:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3f926700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380c9c40 con 0x7f2f380add70 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3f926700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380c9f20 con 0x7f2f38157570 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f380ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f380ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47634/0 (socket says 172.21.15.82:47634) 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 -- 172.21.15.82:0/2139346023 learned_addr learned my addr 172.21.15.82:0/2139346023 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3d6c2700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f380add70 0x7f2f380c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3cec1700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f38157570 0x7f2f38154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 -- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f38157570 msgr2=0x7f2f38154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f38157570 0x7f2f38154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 -- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f380add70 msgr2=0x7f2f380c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f380add70 0x7f2f380c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 -- 172.21.15.82:0/2139346023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f28009420 con 0x7f2f3815b210 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3cec1700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f38157570 0x7f2f38154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3dec3700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f380ca8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000c7e0 tx=0x7f2f30007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f2d7fa700 1 -- 172.21.15.82:0/2139346023 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30005c00 con 0x7f2f3815b210 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f2d7fa700 1 -- 172.21.15.82:0/2139346023 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f30005d80 con 0x7f2f3815b210 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f380ca200 con 0x7f2f3815b210 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f2d7fa700 1 -- 172.21.15.82:0/2139346023 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30007320 con 0x7f2f3815b210 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.517+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f380c7890 con 0x7f2f3815b210 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.518+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f38064050 con 0x7f2f3815b210 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.519+0000 7f2f2d7fa700 1 -- 172.21.15.82:0/2139346023 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f3001b3b0 con 0x7f2f3815b210 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.519+0000 7f2f2d7fa700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2f1c066f30 0x7f2f1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.519+0000 7f2f2d7fa700 1 -- 172.21.15.82:0/2139346023 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2f30083860 con 0x7f2f3815b210 2023-10-06T03:16:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.519+0000 7f2f3d6c2700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2f1c066f30 0x7f2f1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.520+0000 7f2f3d6c2700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2f1c066f30 0x7f2f1c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009fd0 tx=0x7f2f34009880 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.523+0000 7f2f2d7fa700 1 -- 172.21.15.82:0/2139346023 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f30050cc0 con 0x7f2f3815b210 2023-10-06T03:16:34.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.711+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2f380c2a20 con 0x7f2f3815b210 2023-10-06T03:16:34.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.711+0000 7f2f2d7fa700 1 -- 172.21.15.82:0/2139346023 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2f30017070 con 0x7f2f3815b210 2023-10-06T03:16:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:34.713 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-10-06T03:16:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-10-06T03:16:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-10-06T03:16:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-10-06T03:16:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-10-06T03:16:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:34.714 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-10-06T03:16:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2f1c066f30 msgr2=0x7f2f1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2f1c066f30 0x7f2f1c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009fd0 tx=0x7f2f34009880 comp rx=0 tx=0).stop 2023-10-06T03:16:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 msgr2=0x7f2f380ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f380ca8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000c7e0 tx=0x7f2f30007d90 comp rx=0 tx=0).stop 2023-10-06T03:16:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 shutdown_connections 2023-10-06T03:16:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f3815b210 0x7f2f380ca8a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f380add70 0x7f2f380c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2f1c066f30 0x7f2f1c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 --2- 172.21.15.82:0/2139346023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f38157570 0x7f2f38154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 >> 172.21.15.82:0/2139346023 conn(0x7f2f38067630 msgr2=0x7f2f3815a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 shutdown_connections 2023-10-06T03:16:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.713+0000 7f2f3f926700 1 -- 172.21.15.82:0/2139346023 wait complete. 2023-10-06T03:16:34.727 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:16:34.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:16:34.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.843+0000 7fc2d4ac9700 1 Processor -- start 2023-10-06T03:16:34.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.843+0000 7fc2d4ac9700 1 -- start start 2023-10-06T03:16:34.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.843+0000 7fc2d4ac9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d00cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.843+0000 7fc2d4ac9700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d00cb670 con 0x7fc2d00cf810 2023-10-06T03:16:34.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.843+0000 7fc2d4ac9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d00cce90 con 0x7fc2d00cf440 2023-10-06T03:16:34.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.843+0000 7fc2d4ac9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00cccb0 con 0x7fc2d00cc850 2023-10-06T03:16:34.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2ceffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc2d00cf810 0x7fc2d0158e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47868/0 (socket says 172.21.15.82:47868) 2023-10-06T03:16:34.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2ceffd700 1 -- 172.21.15.82:0/1645339511 learned_addr learned my addr 172.21.15.82:0/1645339511 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:34.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2cffff700 1 --2- 172.21.15.82:0/1645339511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d00cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2ce7fc700 1 -- 172.21.15.82:0/1645339511 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212376184 0 0) 0x7fc2d00cb670 con 0x7fc2d00cf810 2023-10-06T03:16:34.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2ce7fc700 1 -- 172.21.15.82:0/1645339511 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b8003570 con 0x7fc2d00cf810 2023-10-06T03:16:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2ce7fc700 1 -- 172.21.15.82:0/1645339511 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262363927 0 0) 0x7fc2d00cce90 con 0x7fc2d00cf440 2023-10-06T03:16:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2ce7fc700 1 -- 172.21.15.82:0/1645339511 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d00cb670 con 0x7fc2d00cf440 2023-10-06T03:16:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2ce7fc700 1 -- 172.21.15.82:0/1645339511 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 665608990 0 0) 0x7fc2b8003570 con 0x7fc2d00cf810 2023-10-06T03:16:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2cffff700 1 -- 172.21.15.82:0/1645339511 >> v1:172.21.15.134:6789/0 conn(0x7fc2d00cf440 legacy=0x7fc2d00cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2cffff700 1 -- 172.21.15.82:0/1645339511 >> v1:172.21.15.82:6789/0 conn(0x7fc2d00cf810 legacy=0x7fc2d0158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2cffff700 1 -- 172.21.15.82:0/1645339511 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00cad80 con 0x7fc2d00cc850 2023-10-06T03:16:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.844+0000 7fc2cffff700 1 --2- 172.21.15.82:0/1645339511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d00cbb00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009e90 tx=0x7fc2c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fba51c1bbb20485b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2ce7fc700 1 -- 172.21.15.82:0/1645339511 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800e070 con 0x7fc2d00cc850 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2ce7fc700 1 -- 172.21.15.82:0/1645339511 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c800b870 con 0x7fc2d00cc850 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2ce7fc700 1 -- 172.21.15.82:0/1645339511 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4001470 con 0x7fc2d00cc850 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1645339511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 msgr2=0x7fc2d00cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2d4ac9700 1 --2- 172.21.15.82:0/1645339511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d00cbb00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009e90 tx=0x7fc2c8009780 comp rx=0 tx=0).stop 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1645339511 shutdown_connections 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2d4ac9700 1 --2- 172.21.15.82:0/1645339511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d00cbb00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1645339511 >> 172.21.15.82:0/1645339511 conn(0x7fc2d00cd080 msgr2=0x7fc2d00cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1645339511 shutdown_connections 2023-10-06T03:16:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.845+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1645339511 wait complete. 2023-10-06T03:16:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.846+0000 7fc2d4ac9700 1 Processor -- start 2023-10-06T03:16:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.846+0000 7fc2d4ac9700 1 -- start start 2023-10-06T03:16:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2d4ac9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2d4ac9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d00cf440 0x7fc2d00b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2d4ac9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d00cf810 0x7fc2d00b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2d4ac9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d015c090 con 0x7fc2d00cf440 2023-10-06T03:16:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2d4ac9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d015b410 con 0x7fc2d00cf810 2023-10-06T03:16:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2d4ac9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d015b6f0 con 0x7fc2d00cc850 2023-10-06T03:16:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2ceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d00cf440 0x7fc2d00b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2ceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d00cf440 0x7fc2d00b5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47644/0 (socket says 172.21.15.82:47644) 2023-10-06T03:16:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.847+0000 7fc2ceffd700 1 -- 172.21.15.82:0/1708841825 learned_addr learned my addr 172.21.15.82:0/1708841825 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2cffff700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d00cf810 0x7fc2d00b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2cf7fe700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2ceffd700 1 -- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 msgr2=0x7fc2d015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2ceffd700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2ceffd700 1 -- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d00cf810 msgr2=0x7fc2d00b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2ceffd700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d00cf810 0x7fc2d00b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2ceffd700 1 -- 172.21.15.82:0/1708841825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c8009a20 con 0x7fc2d00cf440 2023-10-06T03:16:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2cffff700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d00cf810 0x7fc2d00b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2ceffd700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d00cf440 0x7fc2d00b5500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c860 tx=0x7fc2c4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2b77fe700 1 -- 172.21.15.82:0/1708841825 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4007360 con 0x7fc2d00cf440 2023-10-06T03:16:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2b77fe700 1 -- 172.21.15.82:0/1708841825 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40074c0 con 0x7fc2d00cf440 2023-10-06T03:16:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d015b9d0 con 0x7fc2d00cf440 2023-10-06T03:16:34.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2b77fe700 1 -- 172.21.15.82:0/1708841825 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4004830 con 0x7fc2d00cf440 2023-10-06T03:16:34.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.848+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d00c97b0 con 0x7fc2d00cf440 2023-10-06T03:16:34.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.849+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d0064050 con 0x7fc2d00cf440 2023-10-06T03:16:34.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.849+0000 7fc2b77fe700 1 -- 172.21.15.82:0/1708841825 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2c4004bc0 con 0x7fc2d00cf440 2023-10-06T03:16:34.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.850+0000 7fc2b77fe700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc2bc066f30 0x7fc2bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.850+0000 7fc2b77fe700 1 -- 172.21.15.82:0/1708841825 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc2c4083a50 con 0x7fc2d00cf440 2023-10-06T03:16:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.850+0000 7fc2cf7fe700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc2bc066f30 0x7fc2bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.850+0000 7fc2cf7fe700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc2bc066f30 0x7fc2bc0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00027d0 tx=0x7fc2c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:34.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:34.854+0000 7fc2b77fe700 1 -- 172.21.15.82:0/1708841825 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2c4050f30 con 0x7fc2d00cf440 2023-10-06T03:16:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.035+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc2d00cb020 con 0x7fc2d00cf440 2023-10-06T03:16:35.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.576+0000 7fc2b77fe700 1 -- 172.21.15.82:0/1708841825 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc2c40180b0 con 0x7fc2d00cf440 2023-10-06T03:16:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.580+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc2bc066f30 msgr2=0x7fc2bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.580+0000 7fc2d4ac9700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc2bc066f30 0x7fc2bc0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00027d0 tx=0x7fc2c0009040 comp rx=0 tx=0).stop 2023-10-06T03:16:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.580+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d00cf440 msgr2=0x7fc2d00b5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.580+0000 7fc2d4ac9700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d00cf440 0x7fc2d00b5500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c860 tx=0x7fc2c4001a30 comp rx=0 tx=0).stop 2023-10-06T03:16:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.581+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 shutdown_connections 2023-10-06T03:16:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.581+0000 7fc2d4ac9700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d00cf810 0x7fc2d00b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.581+0000 7fc2d4ac9700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc2bc066f30 0x7fc2bc0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.581+0000 7fc2d4ac9700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d00cc850 0x7fc2d015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.581+0000 7fc2d4ac9700 1 --2- 172.21.15.82:0/1708841825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d00cf440 0x7fc2d00b5500 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.581+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 >> 172.21.15.82:0/1708841825 conn(0x7fc2d00cd080 msgr2=0x7fc2d0158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.581+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 shutdown_connections 2023-10-06T03:16:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.581+0000 7fc2d4ac9700 1 -- 172.21.15.82:0/1708841825 wait complete. 2023-10-06T03:16:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-10-06T03:16:35.597 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:16:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.717+0000 7fd634e99700 1 Processor -- start 2023-10-06T03:16:35.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.717+0000 7fd634e99700 1 -- start start 2023-10-06T03:16:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd634e99700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6300b1be0 0x7fd6300b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd634e99700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6300cd860 con 0x7fd630159890 2023-10-06T03:16:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd634e99700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6300ce0f0 con 0x7fd6300cdcf0 2023-10-06T03:16:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd634e99700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6300ccc50 con 0x7fd6300b1be0 2023-10-06T03:16:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd625d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6300b1be0 0x7fd6300b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:35.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd62e59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd630159890 0x7fd6300b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47880/0 (socket says 172.21.15.82:47880) 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd62e59c700 1 -- 172.21.15.82:0/1436654814 learned_addr learned my addr 172.21.15.82:0/1436654814 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd625d9b700 1 -- 172.21.15.82:0/1436654814 >> v1:172.21.15.134:6789/0 conn(0x7fd6300cdcf0 legacy=0x7fd630159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd625d9b700 1 -- 172.21.15.82:0/1436654814 >> v1:172.21.15.82:6789/0 conn(0x7fd630159890 legacy=0x7fd6300b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd62dd9b700 1 -- 172.21.15.82:0/1436654814 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531721670 0 0) 0x7fd6300cd860 con 0x7fd630159890 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.718+0000 7fd625d9b700 1 -- 172.21.15.82:0/1436654814 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6300ccf30 con 0x7fd6300b1be0 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd625d9b700 1 --2- 172.21.15.82:0/1436654814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6300b1be0 0x7fd6300b0eb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd6180098e0 tx=0x7fd6180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfed14b86c5f7f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd62dd9b700 1 -- 172.21.15.82:0/1436654814 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618009e80 con 0x7fd6300b1be0 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd62dd9b700 1 -- 172.21.15.82:0/1436654814 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61800b820 con 0x7fd6300b1be0 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd62dd9b700 1 -- 172.21.15.82:0/1436654814 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61800bba0 con 0x7fd6300b1be0 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd634e99700 1 -- 172.21.15.82:0/1436654814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6300b1be0 msgr2=0x7fd6300b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:35.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd634e99700 1 --2- 172.21.15.82:0/1436654814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6300b1be0 0x7fd6300b0eb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd6180098e0 tx=0x7fd6180091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:35.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd634e99700 1 -- 172.21.15.82:0/1436654814 shutdown_connections 2023-10-06T03:16:35.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd634e99700 1 --2- 172.21.15.82:0/1436654814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6300b1be0 0x7fd6300b0eb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:35.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd634e99700 1 -- 172.21.15.82:0/1436654814 >> 172.21.15.82:0/1436654814 conn(0x7fd630099990 msgr2=0x7fd6300b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:35.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd634e99700 1 -- 172.21.15.82:0/1436654814 shutdown_connections 2023-10-06T03:16:35.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.719+0000 7fd634e99700 1 -- 172.21.15.82:0/1436654814 wait complete. 2023-10-06T03:16:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.720+0000 7fd634e99700 1 Processor -- start 2023-10-06T03:16:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd634e99700 1 -- start start 2023-10-06T03:16:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd634e99700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6300b1be0 0x7fd630155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd634e99700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6300cdcf0 0x7fd63015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd634e99700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd630159890 0x7fd63015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd634e99700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63015c430 con 0x7fd630159890 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd634e99700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6301585f0 con 0x7fd6300b1be0 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd634e99700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd630169d50 con 0x7fd6300cdcf0 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd62ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd630159890 0x7fd63015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd62ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd630159890 0x7fd63015e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47660/0 (socket says 172.21.15.82:47660) 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd62ed9d700 1 -- 172.21.15.82:0/3803992627 learned_addr learned my addr 172.21.15.82:0/3803992627 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd625d9b700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6300cdcf0 0x7fd63015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.721+0000 7fd62e59c700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6300b1be0 0x7fd630155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd62ed9d700 1 -- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6300cdcf0 msgr2=0x7fd63015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd62ed9d700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6300cdcf0 0x7fd63015bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd62ed9d700 1 -- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6300b1be0 msgr2=0x7fd630155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd62ed9d700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6300b1be0 0x7fd630155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd62ed9d700 1 -- 172.21.15.82:0/3803992627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618009420 con 0x7fd630159890 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd62ed9d700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd630159890 0x7fd63015e520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd62800c930 tx=0x7fd6280026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd626ffd700 1 -- 172.21.15.82:0/3803992627 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62800ce70 con 0x7fd630159890 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd626ffd700 1 -- 172.21.15.82:0/3803992627 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62800a7e0 con 0x7fd630159890 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63016a030 con 0x7fd630159890 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd626ffd700 1 -- 172.21.15.82:0/3803992627 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62800aba0 con 0x7fd630159890 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.722+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd630169a00 con 0x7fd630159890 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.723+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd630064050 con 0x7fd630159890 2023-10-06T03:16:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.723+0000 7fd626ffd700 1 -- 172.21.15.82:0/3803992627 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd628012420 con 0x7fd630159890 2023-10-06T03:16:35.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.724+0000 7fd626ffd700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd610066f30 0x7fd6100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:35.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.724+0000 7fd626ffd700 1 -- 172.21.15.82:0/3803992627 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fd628084880 con 0x7fd630159890 2023-10-06T03:16:35.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.724+0000 7fd62e59c700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd610066f30 0x7fd6100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:35.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.724+0000 7fd62e59c700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd610066f30 0x7fd6100693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd6300af630 tx=0x7fd620009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:35.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.728+0000 7fd626ffd700 1 -- 172.21.15.82:0/3803992627 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6280556b0 con 0x7fd630159890 2023-10-06T03:16:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:35.910+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd630089e10 con 0x7fd630159890 2023-10-06T03:16:36.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.582+0000 7fd626ffd700 1 -- 172.21.15.82:0/3803992627 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd628055240 con 0x7fd630159890 2023-10-06T03:16:36.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd610066f30 msgr2=0x7fd6100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd610066f30 0x7fd6100693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd6300af630 tx=0x7fd620009040 comp rx=0 tx=0).stop 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd630159890 msgr2=0x7fd63015e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd630159890 0x7fd63015e520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd62800c930 tx=0x7fd6280026e0 comp rx=0 tx=0).stop 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 shutdown_connections 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd630159890 0x7fd63015e520 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6300b1be0 0x7fd630155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd610066f30 0x7fd6100693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 --2- 172.21.15.82:0/3803992627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6300cdcf0 0x7fd63015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 >> 172.21.15.82:0/3803992627 conn(0x7fd630099990 msgr2=0x7fd630158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.592+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 shutdown_connections 2023-10-06T03:16:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.593+0000 7fd634e99700 1 -- 172.21.15.82:0/3803992627 wait complete. 2023-10-06T03:16:36.596 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-10-06T03:16:36.611 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:16:36.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.726+0000 7f56017d4700 1 Processor -- start 2023-10-06T03:16:36.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.726+0000 7f56017d4700 1 -- start start 2023-10-06T03:16:36.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.727+0000 7f56017d4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f55fc0b4000 0x7f55fc159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:36.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.727+0000 7f56017d4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0698e0 con 0x7f55fc15cb10 2023-10-06T03:16:36.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.727+0000 7f56017d4700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc068fd0 con 0x7f55fc0b1690 2023-10-06T03:16:36.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.727+0000 7f56017d4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0b0020 con 0x7f55fc0b4000 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.727+0000 7f55f27fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f55fc0b4000 0x7f55fc159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.727+0000 7f55f27fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f55fc0b4000 0x7f55fc159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47670/0 (socket says 172.21.15.82:47670) 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.727+0000 7f55faffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f55fc15cb10 0x7f55fc0af780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47896/0 (socket says 172.21.15.82:47896) 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.727+0000 7f55f27fc700 1 -- 172.21.15.82:0/2414643172 learned_addr learned my addr 172.21.15.82:0/2414643172 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f55f27fc700 1 -- 172.21.15.82:0/2414643172 >> v1:172.21.15.134:6789/0 conn(0x7f55fc0b1690 legacy=0x7f55fc069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f55f27fc700 1 -- 172.21.15.82:0/2414643172 >> v1:172.21.15.82:6789/0 conn(0x7f55fc15cb10 legacy=0x7f55fc0af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f55f27fc700 1 -- 172.21.15.82:0/2414643172 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc069290 con 0x7f55fc0b4000 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f55f27fc700 1 --2- 172.21.15.82:0/2414643172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b4000 0x7f55fc159b50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f55e40099b0 tx=0x7f55e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e668b386ae2576db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f55fa7fc700 1 -- 172.21.15.82:0/2414643172 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e400b860 con 0x7f55fc0b4000 2023-10-06T03:16:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f55fa7fc700 1 -- 172.21.15.82:0/2414643172 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e400b9c0 con 0x7f55fc0b4000 2023-10-06T03:16:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f55fa7fc700 1 -- 172.21.15.82:0/2414643172 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e400bd60 con 0x7f55fc0b4000 2023-10-06T03:16:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f56017d4700 1 -- 172.21.15.82:0/2414643172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b4000 msgr2=0x7f55fc159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f56017d4700 1 --2- 172.21.15.82:0/2414643172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b4000 0x7f55fc159b50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f55e40099b0 tx=0x7f55e4009250 comp rx=0 tx=0).stop 2023-10-06T03:16:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f56017d4700 1 -- 172.21.15.82:0/2414643172 shutdown_connections 2023-10-06T03:16:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f56017d4700 1 --2- 172.21.15.82:0/2414643172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b4000 0x7f55fc159b50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f56017d4700 1 -- 172.21.15.82:0/2414643172 >> 172.21.15.82:0/2414643172 conn(0x7f55fc06d890 msgr2=0x7f55fc06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.728+0000 7f56017d4700 1 -- 172.21.15.82:0/2414643172 shutdown_connections 2023-10-06T03:16:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.729+0000 7f56017d4700 1 -- 172.21.15.82:0/2414643172 wait complete. 2023-10-06T03:16:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.730+0000 7f56017d4700 1 Processor -- start 2023-10-06T03:16:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.730+0000 7f56017d4700 1 -- start start 2023-10-06T03:16:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.730+0000 7f56017d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b1690 0x7f55fc16af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.730+0000 7f56017d4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55fc0b4000 0x7f55fc16cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.730+0000 7f56017d4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55fc15cb10 0x7f55fc169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.730+0000 7f56017d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc16ad90 con 0x7f55fc0b1690 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.730+0000 7f56017d4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc153180 con 0x7f55fc0b4000 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.730+0000 7f56017d4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc16a7d0 con 0x7f55fc15cb10 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b1690 0x7f55fc16af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b1690 0x7f55fc16af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47678/0 (socket says 172.21.15.82:47678) 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 -- 172.21.15.82:0/1499547179 learned_addr learned my addr 172.21.15.82:0/1499547179 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55f27fc700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55fc0b4000 0x7f55fc16cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55fb7fe700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55fc15cb10 0x7f55fc169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 -- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55fc15cb10 msgr2=0x7f55fc169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55fc15cb10 0x7f55fc169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 -- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55fc0b4000 msgr2=0x7f55fc16cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55fc0b4000 0x7f55fc16cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 -- 172.21.15.82:0/1499547179 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40094f0 con 0x7f55fc0b1690 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55f27fc700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55fc0b4000 0x7f55fc16cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55faffd700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b1690 0x7f55fc16af50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c560 tx=0x7f55ec007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55f37fe700 1 -- 172.21.15.82:0/1499547179 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec005a70 con 0x7f55fc0b1690 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55f37fe700 1 -- 172.21.15.82:0/1499547179 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec005bd0 con 0x7f55fc0b1690 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f55f37fe700 1 -- 172.21.15.82:0/1499547179 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0070d0 con 0x7f55fc0b1690 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc16aab0 con 0x7f55fc0b1690 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.731+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc16d0b0 con 0x7f55fc0b1690 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.732+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc152c70 con 0x7f55fc0b1690 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.733+0000 7f55f37fe700 1 -- 172.21.15.82:0/1499547179 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55ec007480 con 0x7f55fc0b1690 2023-10-06T03:16:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.733+0000 7f55f37fe700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f55dc066f30 0x7f55dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:36.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.733+0000 7f55f37fe700 1 -- 172.21.15.82:0/1499547179 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f55ec083b40 con 0x7f55fc0b1690 2023-10-06T03:16:36.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.733+0000 7f55f27fc700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f55dc066f30 0x7f55dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:36.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.734+0000 7f55f27fc700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f55dc066f30 0x7f55dc0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f55e40099b0 tx=0x7f55e4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:36.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.738+0000 7f55f37fe700 1 -- 172.21.15.82:0/1499547179 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55fc152c70 con 0x7f55fc0b1690 2023-10-06T03:16:36.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:36.963+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f55fc152c70 con 0x7f55fc0b1690 2023-10-06T03:16:37.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.595+0000 7f55f37fe700 1 -- 172.21.15.82:0/1499547179 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f55fc152c70 con 0x7f55fc0b1690 2023-10-06T03:16:37.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.601+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f55dc066f30 msgr2=0x7f55dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:37.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.601+0000 7f56017d4700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f55dc066f30 0x7f55dc0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f55e40099b0 tx=0x7f55e4017000 comp rx=0 tx=0).stop 2023-10-06T03:16:37.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.601+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b1690 msgr2=0x7f55fc16af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:37.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.601+0000 7f56017d4700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b1690 0x7f55fc16af50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c560 tx=0x7f55ec007f70 comp rx=0 tx=0).stop 2023-10-06T03:16:37.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.602+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 shutdown_connections 2023-10-06T03:16:37.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.602+0000 7f56017d4700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f55dc066f30 0x7f55dc0693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.602+0000 7f56017d4700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55fc15cb10 0x7f55fc169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.602+0000 7f56017d4700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55fc0b1690 0x7f55fc16af50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.602+0000 7f56017d4700 1 --2- 172.21.15.82:0/1499547179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55fc0b4000 0x7f55fc16cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.602+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 >> 172.21.15.82:0/1499547179 conn(0x7f55fc06d890 msgr2=0x7f55fc15fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:37.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.604+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 shutdown_connections 2023-10-06T03:16:37.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.604+0000 7f56017d4700 1 -- 172.21.15.82:0/1499547179 wait complete. 2023-10-06T03:16:37.607 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T03:16:37.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.735+0000 7f1e228e5700 1 Processor -- start 2023-10-06T03:16:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.735+0000 7f1e228e5700 1 -- start start 2023-10-06T03:16:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.736+0000 7f1e228e5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1e1c151a60 0x7f1e1c0b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.736+0000 7f1e228e5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c158840 0x7f1e1c0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.736+0000 7f1e228e5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0cb770 con 0x7f1e1c0aefe0 2023-10-06T03:16:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.736+0000 7f1e228e5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0cba50 con 0x7f1e1c151a60 2023-10-06T03:16:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.736+0000 7f1e228e5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0cbd30 con 0x7f1e1c158840 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.736+0000 7f1e20e82700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1e1c0aefe0 0x7f1e1c0af410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41672/0 (socket says 172.21.15.82:41672) 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.736+0000 7f1e20e82700 1 -- 172.21.15.82:0/2774727959 learned_addr learned my addr 172.21.15.82:0/2774727959 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581142594 0 0) 0x7f1e1c0cb770 con 0x7f1e1c0aefe0 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1bfff700 1 --2- 172.21.15.82:0/2774727959 >> v2:172.21.15.134:3300/0 conn(0x7f1e1c151a60 0x7f1e1c0b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e04003570 con 0x7f1e1c0aefe0 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1b7fe700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c158840 0x7f1e1c0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3965955808 0 0) 0x7f1e04003570 con 0x7f1e1c0aefe0 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c158840 msgr2=0x7f1e1c0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c158840 0x7f1e1c0b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 >> v2:172.21.15.134:3300/0 conn(0x7f1e1c151a60 msgr2=0x7f1e1c0b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:37.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 --2- 172.21.15.82:0/2774727959 >> v2:172.21.15.134:3300/0 conn(0x7f1e1c151a60 0x7f1e1c0b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0cc010 con 0x7f1e1c0aefe0 2023-10-06T03:16:37.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f1e140017f0 con 0x7f1e1c0aefe0 2023-10-06T03:16:37.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 >> v1:172.21.15.82:6789/0 conn(0x7f1e1c0aefe0 legacy=0x7f1e1c0af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:37.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e04003a60 0x7f1e04003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c158840 0x7f1e04004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e04004d50 0x7f1e040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0cba50 con 0x7f1e04004d50 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0cbd30 con 0x7f1e04003a60 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0400ba60 con 0x7f1e1c158840 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e20e82700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e04004d50 0x7f1e040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1bfff700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e04003a60 0x7f1e04003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e1b7fe700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c158840 0x7f1e04004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e20e82700 1 -- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c158840 msgr2=0x7f1e04004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e20e82700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c158840 0x7f1e04004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e20e82700 1 -- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e04003a60 msgr2=0x7f1e04003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e20e82700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e04003a60 0x7f1e04003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.737+0000 7f1e20e82700 1 -- 172.21.15.82:0/2774727959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e04003570 con 0x7f1e04004d50 2023-10-06T03:16:37.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e20e82700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e04004d50 0x7f1e040051c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400a970 tx=0x7f1e14002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b09cd365505732 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:37.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14012440 con 0x7f1e04004d50 2023-10-06T03:16:37.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e140125c0 con 0x7f1e04004d50 2023-10-06T03:16:37.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e1affd700 1 -- 172.21.15.82:0/2774727959 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14012980 con 0x7f1e04004d50 2023-10-06T03:16:37.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e228e5700 1 -- 172.21.15.82:0/2774727959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e04004d50 msgr2=0x7f1e040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:37.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e228e5700 1 --2- 172.21.15.82:0/2774727959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e04004d50 0x7f1e040051c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400a970 tx=0x7f1e14002210 comp rx=0 tx=0).stop 2023-10-06T03:16:37.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e20e82700 1 -- 172.21.15.82:0/2774727959 reap_dead start 2023-10-06T03:16:37.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e228e5700 1 -- 172.21.15.82:0/2774727959 shutdown_connections 2023-10-06T03:16:37.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e228e5700 1 -- 172.21.15.82:0/2774727959 >> 172.21.15.82:0/2774727959 conn(0x7f1e1c06e6f0 msgr2=0x7f1e1c06afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:37.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e228e5700 1 -- 172.21.15.82:0/2774727959 shutdown_connections 2023-10-06T03:16:37.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.738+0000 7f1e228e5700 1 -- 172.21.15.82:0/2774727959 wait complete. 2023-10-06T03:16:37.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.739+0000 7f1e228e5700 1 Processor -- start 2023-10-06T03:16:37.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.740+0000 7f1e228e5700 1 -- start start 2023-10-06T03:16:37.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.740+0000 7f1e228e5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c13efb0 0x7f1e1c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.740+0000 7f1e228e5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e1c150040 0x7f1e1c1694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.740+0000 7f1e228e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e1c169a30 0x7f1e1c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.740+0000 7f1e228e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c150550 con 0x7f1e1c169a30 2023-10-06T03:16:37.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.740+0000 7f1e228e5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c14c330 con 0x7f1e1c150040 2023-10-06T03:16:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.740+0000 7f1e228e5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c13f380 con 0x7f1e1c13efb0 2023-10-06T03:16:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.740+0000 7f1e20e82700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e1c169a30 0x7f1e1c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e20e82700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e1c169a30 0x7f1e1c151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52758/0 (socket says 172.21.15.82:52758) 2023-10-06T03:16:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e20e82700 1 -- 172.21.15.82:0/1196934559 learned_addr learned my addr 172.21.15.82:0/1196934559 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e1bfff700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c13efb0 0x7f1e1c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e1b7fe700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e1c150040 0x7f1e1c1694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e20e82700 1 -- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c13efb0 msgr2=0x7f1e1c14fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:37.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e20e82700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c13efb0 0x7f1e1c14fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e20e82700 1 -- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e1c150040 msgr2=0x7f1e1c1694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:37.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e20e82700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e1c150040 0x7f1e1c1694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e20e82700 1 -- 172.21.15.82:0/1196934559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c14ba40 con 0x7f1e1c169a30 2023-10-06T03:16:37.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e1bfff700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c13efb0 0x7f1e1c14fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:37.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e1b7fe700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e1c150040 0x7f1e1c1694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:37.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e20e82700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e1c169a30 0x7f1e1c151e30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400a000 tx=0x7f1e14015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:37.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e03fff700 1 -- 172.21.15.82:0/1196934559 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14012440 con 0x7f1e1c169a30 2023-10-06T03:16:37.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e03fff700 1 -- 172.21.15.82:0/1196934559 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e140017b0 con 0x7f1e1c169a30 2023-10-06T03:16:37.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e03fff700 1 -- 172.21.15.82:0/1196934559 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14001f30 con 0x7f1e1c169a30 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c14bce0 con 0x7f1e1c169a30 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.741+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c0adbc0 con 0x7f1e1c169a30 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.742+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c14c4c0 con 0x7f1e1c169a30 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.742+0000 7f1e03fff700 1 -- 172.21.15.82:0/1196934559 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e14019030 con 0x7f1e1c169a30 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.743+0000 7f1e03fff700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1e08066f30 0x7f1e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.743+0000 7f1e03fff700 1 -- 172.21.15.82:0/1196934559 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1e14085cf0 con 0x7f1e1c169a30 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.743+0000 7f1e1bfff700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1e08066f30 0x7f1e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.744+0000 7f1e1bfff700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1e08066f30 0x7f1e080693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c006f00 tx=0x7f1e0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:37.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.747+0000 7f1e03fff700 1 -- 172.21.15.82:0/1196934559 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e14052e00 con 0x7f1e1c169a30 2023-10-06T03:16:37.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.932+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e1c064050 con 0x7f1e1c169a30 2023-10-06T03:16:37.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.933+0000 7f1e03fff700 1 -- 172.21.15.82:0/1196934559 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f1e14012940 con 0x7f1e1c169a30 2023-10-06T03:16:37.934 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:37.935 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:16:36.965670+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:16:35.054163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:16:35.928949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:37.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1e08066f30 msgr2=0x7f1e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:37.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1e08066f30 0x7f1e080693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c006f00 tx=0x7f1e0c008040 comp rx=0 tx=0).stop 2023-10-06T03:16:37.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e1c169a30 msgr2=0x7f1e1c151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e1c169a30 0x7f1e1c151e30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400a000 tx=0x7f1e14015000 comp rx=0 tx=0).stop 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 shutdown_connections 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e1c169a30 0x7f1e1c151e30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1e08066f30 0x7f1e080693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e1c13efb0 0x7f1e1c14fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 --2- 172.21.15.82:0/1196934559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e1c150040 0x7f1e1c1694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.934+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 >> 172.21.15.82:0/1196934559 conn(0x7f1e1c06e6f0 msgr2=0x7f1e1c14b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.935+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 shutdown_connections 2023-10-06T03:16:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:37.935+0000 7f1e228e5700 1 -- 172.21.15.82:0/1196934559 wait complete. 2023-10-06T03:16:37.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.062+0000 7f092b17e700 1 Processor -- start 2023-10-06T03:16:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.062+0000 7f092b17e700 1 -- start start 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.063+0000 7f092b17e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09240b5600 0x7f09240d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.063+0000 7f092b17e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09240b2ad0 con 0x7f092415d930 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.063+0000 7f092b17e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09240b4160 con 0x7f092415d560 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.063+0000 7f092b17e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b2230 con 0x7f09240b5600 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.063+0000 7f091bfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f092415d930 0x7f09241591b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41674/0 (socket says 172.21.15.82:41674) 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.063+0000 7f091bfff700 1 -- 172.21.15.82:0/2446963242 learned_addr learned my addr 172.21.15.82:0/2446963242 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.063+0000 7f092971b700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09240b5600 0x7f09240d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.063+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072161712 0 0) 0x7f09240b2ad0 con 0x7f092415d930 2023-10-06T03:16:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f090c003570 con 0x7f092415d930 2023-10-06T03:16:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 394605389 0 0) 0x7f090c003570 con 0x7f092415d930 2023-10-06T03:16:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09240b5600 msgr2=0x7f09240d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09240b5600 0x7f09240d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 >> v1:172.21.15.134:6789/0 conn(0x7f092415d560 legacy=0x7f09240b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09240b2510 con 0x7f092415d930 2023-10-06T03:16:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f0914001470 con 0x7f092415d930 2023-10-06T03:16:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 >> v1:172.21.15.82:6789/0 conn(0x7f092415d930 legacy=0x7f09241591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c003a90 0x7f090c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09240b5600 0x7f090c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c004d50 0x7f090c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b2230 con 0x7f090c003a90 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c00bba0 con 0x7f090c004d50 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c00bd60 con 0x7f09240b5600 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f0928f1a700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c003a90 0x7f090c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f091bfff700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09240b5600 0x7f090c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f092971b700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c004d50 0x7f090c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f0928f1a700 1 -- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09240b5600 msgr2=0x7f090c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f0928f1a700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09240b5600 0x7f090c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f0928f1a700 1 -- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c004d50 msgr2=0x7f090c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f0928f1a700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c004d50 0x7f090c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f0928f1a700 1 -- 172.21.15.82:0/2446963242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c003570 con 0x7f090c003a90 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.064+0000 7f0928f1a700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c003a90 0x7f090c003ea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0920001fc0 tx=0x7f0920001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d9f22c35f0354a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920001950 con 0x7f090c003a90 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092000c8b0 con 0x7f090c003a90 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f091b7fe700 1 -- 172.21.15.82:0/2446963242 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092000cc50 con 0x7f090c003a90 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f092b17e700 1 -- 172.21.15.82:0/2446963242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c003a90 msgr2=0x7f090c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f092b17e700 1 --2- 172.21.15.82:0/2446963242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c003a90 0x7f090c003ea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0920001fc0 tx=0x7f0920001640 comp rx=0 tx=0).stop 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f092971b700 1 -- 172.21.15.82:0/2446963242 reap_dead start 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f092b17e700 1 -- 172.21.15.82:0/2446963242 shutdown_connections 2023-10-06T03:16:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f092b17e700 1 -- 172.21.15.82:0/2446963242 >> 172.21.15.82:0/2446963242 conn(0x7f09240d1180 msgr2=0x7f0924069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:38.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f092b17e700 1 -- 172.21.15.82:0/2446963242 shutdown_connections 2023-10-06T03:16:38.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.065+0000 7f092b17e700 1 -- 172.21.15.82:0/2446963242 wait complete. 2023-10-06T03:16:38.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.066+0000 7f092b17e700 1 Processor -- start 2023-10-06T03:16:38.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.066+0000 7f092b17e700 1 -- start start 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092b17e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c003a90 0x7f092414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092b17e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0924169970 0x7f09241591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092b17e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f092414f490 0x7f092415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092b17e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092414f000 con 0x7f092414f490 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092b17e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0924159730 con 0x7f090c003a90 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092b17e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092414e3f0 con 0x7f0924169970 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092971b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f092414f490 0x7f092415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092971b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f092414f490 0x7f092415ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52784/0 (socket says 172.21.15.82:52784) 2023-10-06T03:16:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092971b700 1 -- 172.21.15.82:0/3444557535 learned_addr learned my addr 172.21.15.82:0/3444557535 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f0928f1a700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c003a90 0x7f092414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f091bfff700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0924169970 0x7f09241591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092971b700 1 -- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0924169970 msgr2=0x7f09241591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092971b700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0924169970 0x7f09241591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092971b700 1 -- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c003a90 msgr2=0x7f092414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092971b700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c003a90 0x7f092414dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f092971b700 1 -- 172.21.15.82:0/3444557535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092414e6d0 con 0x7f092414f490 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f091bfff700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0924169970 0x7f09241591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.067+0000 7f0928f1a700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c003a90 0x7f092414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.068+0000 7f092971b700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f092414f490 0x7f092415ab80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f091c006f00 tx=0x7f091c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.068+0000 7f0918ff9700 1 -- 172.21.15.82:0/3444557535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00f8e0 con 0x7f092414f490 2023-10-06T03:16:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.068+0000 7f0918ff9700 1 -- 172.21.15.82:0/3444557535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00fa40 con 0x7f092414f490 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.068+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092414e9b0 con 0x7f092414f490 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.068+0000 7f0918ff9700 1 -- 172.21.15.82:0/3444557535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00fde0 con 0x7f092414f490 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.068+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092414f910 con 0x7f092414f490 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.069+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0924064050 con 0x7f092414f490 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.069+0000 7f0918ff9700 1 -- 172.21.15.82:0/3444557535 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f091c014650 con 0x7f092414f490 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.069+0000 7f0918ff9700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0910066f30 0x7f09100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.070+0000 7f0918ff9700 1 -- 172.21.15.82:0/3444557535 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f091c084cf0 con 0x7f092414f490 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.070+0000 7f0928f1a700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0910066f30 0x7f09100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.070+0000 7f0928f1a700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0910066f30 0x7f09100693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0920001fc0 tx=0x7f0920015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:38.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.074+0000 7f0918ff9700 1 -- 172.21.15.82:0/3444557535 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f091c089070 con 0x7f092414f490 2023-10-06T03:16:38.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.255+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f092414f140 con 0x7f092414f490 2023-10-06T03:16:38.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.256+0000 7f0918ff9700 1 -- 172.21.15.82:0/3444557535 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f091c022020 con 0x7f092414f490 2023-10-06T03:16:38.258 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:38.258 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:16:36.965670+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:16:35.054163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:16:35.928949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:38.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0910066f30 msgr2=0x7f09100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0910066f30 0x7f09100693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0920001fc0 tx=0x7f0920015000 comp rx=0 tx=0).stop 2023-10-06T03:16:38.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f092414f490 msgr2=0x7f092415ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f092414f490 0x7f092415ab80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f091c006f00 tx=0x7f091c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 shutdown_connections 2023-10-06T03:16:38.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f092414f490 0x7f092415ab80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f090c003a90 0x7f092414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0910066f30 0x7f09100693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 --2- 172.21.15.82:0/3444557535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0924169970 0x7f09241591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 >> 172.21.15.82:0/3444557535 conn(0x7f09240d1180 msgr2=0x7f09240b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 shutdown_connections 2023-10-06T03:16:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.258+0000 7f092b17e700 1 -- 172.21.15.82:0/3444557535 wait complete. 2023-10-06T03:16:38.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:16:38.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.390+0000 7f4b0ffff700 1 Processor -- start 2023-10-06T03:16:38.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.390+0000 7f4b0ffff700 1 -- start start 2023-10-06T03:16:38.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b0ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 0x7f4b100cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b0ffff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b10067e20 con 0x7f4b10143290 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b0ffff700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1015ab10 con 0x7f4b100682b0 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b0ffff700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100677d0 con 0x7f4b10142ec0 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b067fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4b10143290 0x7f4b10159d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41682/0 (socket says 172.21.15.82:41682) 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b067fc700 1 -- 172.21.15.82:0/755193283 learned_addr learned my addr 172.21.15.82:0/755193283 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632538351 0 0) 0x7f4b10067e20 con 0x7f4b10143290 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b0effd700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 0x7f4b100cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.391+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4afc003570 con 0x7f4b10143290 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1696959684 0 0) 0x7f4afc003570 con 0x7f4b10143290 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 msgr2=0x7f4b100cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:38.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 0x7f4b100cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 >> v1:172.21.15.134:6789/0 conn(0x7f4b100682b0 legacy=0x7f4b1015af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10067ab0 con 0x7f4b10143290 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f4af8001470 con 0x7f4b10143290 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 >> v1:172.21.15.82:6789/0 conn(0x7f4b10143290 legacy=0x7f4b10159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4afc003a90 0x7f4afc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4afc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 0x7f4afc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100677d0 con 0x7f4afc004810 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc00bb60 con 0x7f4afc003a90 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc00bd20 con 0x7f4b10142ec0 2023-10-06T03:16:38.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b067fc700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4afc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0effd700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4afc003a90 0x7f4afc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0f7fe700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 0x7f4afc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b067fc700 1 -- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 msgr2=0x7f4afc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b067fc700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 0x7f4afc0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b067fc700 1 -- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4afc003a90 msgr2=0x7f4afc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b067fc700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4afc003a90 0x7f4afc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b067fc700 1 -- 172.21.15.82:0/755193283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc003570 con 0x7f4afc004810 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0effd700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4afc003a90 0x7f4afc003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0f7fe700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b10142ec0 0x7f4afc0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b067fc700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4afc004c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c390 tx=0x7f4b10067d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5aafd2f8302dce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800cc60 con 0x7f4afc004810 2023-10-06T03:16:38.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af800cdc0 con 0x7f4afc004810 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.392+0000 7f4b0e7fc700 1 -- 172.21.15.82:0/755193283 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8005b70 con 0x7f4afc004810 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.393+0000 7f4b0ffff700 1 -- 172.21.15.82:0/755193283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 msgr2=0x7f4afc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.393+0000 7f4b0ffff700 1 --2- 172.21.15.82:0/755193283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4afc004c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c390 tx=0x7f4b10067d90 comp rx=0 tx=0).stop 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.393+0000 7f4b0f7fe700 1 -- 172.21.15.82:0/755193283 reap_dead start 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.393+0000 7f4b0ffff700 1 -- 172.21.15.82:0/755193283 shutdown_connections 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.393+0000 7f4b0ffff700 1 -- 172.21.15.82:0/755193283 >> 172.21.15.82:0/755193283 conn(0x7f4b100ccf70 msgr2=0x7f4b100cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.393+0000 7f4b0ffff700 1 -- 172.21.15.82:0/755193283 shutdown_connections 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.393+0000 7f4b0ffff700 1 -- 172.21.15.82:0/755193283 wait complete. 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.394+0000 7f4b0ffff700 1 Processor -- start 2023-10-06T03:16:38.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.394+0000 7f4b0ffff700 1 -- start start 2023-10-06T03:16:38.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4b100af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b100c8400 0x7f4b100b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b100b5da0 0x7f4b10068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100b5910 con 0x7f4afc004810 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0ffff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c8900 con 0x7f4b100b5da0 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0ffff700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c8be0 con 0x7f4b100c8400 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4b100af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4b100af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52802/0 (socket says 172.21.15.82:52802) 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 -- 172.21.15.82:0/306474484 learned_addr learned my addr 172.21.15.82:0/306474484 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 -- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b100c8400 msgr2=0x7f4b100b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b100c8400 0x7f4b100b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 -- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b100b5da0 msgr2=0x7f4b10068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:38.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b100b5da0 0x7f4b10068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 -- 172.21.15.82:0/306474484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100b55a0 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b0effd700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4b100af7d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4b000118e0 tx=0x7f4b00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.395+0000 7f4b077fe700 1 -- 172.21.15.82:0/306474484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00011e80 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.396+0000 7f4b077fe700 1 -- 172.21.15.82:0/306474484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0000f8e0 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.396+0000 7f4b077fe700 1 -- 172.21.15.82:0/306474484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000fc80 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.396+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b100c8ec0 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.396+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b100b6240 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.396+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b100b5bf0 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.397+0000 7f4b077fe700 1 -- 172.21.15.82:0/306474484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b00015460 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.397+0000 7f4b077fe700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4af0066f30 0x7f4af00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.397+0000 7f4b077fe700 1 -- 172.21.15.82:0/306474484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b00084f70 con 0x7f4afc004810 2023-10-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.398+0000 7f4b067fc700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4af0066f30 0x7f4af00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.398+0000 7f4b067fc700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4af0066f30 0x7f4af00693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b100c8830 tx=0x7f4af8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.401+0000 7f4b077fe700 1 -- 172.21.15.82:0/306474484 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b00055b10 con 0x7f4afc004810 2023-10-06T03:16:38.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:38.631+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4b100b53f0 con 0x7f4afc004810 2023-10-06T03:16:39.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.600+0000 7f4b077fe700 1 -- 172.21.15.82:0/306474484 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4b000556a0 con 0x7f4afc004810 2023-10-06T03:16:39.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4af0066f30 msgr2=0x7f4af00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:39.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4af0066f30 0x7f4af00693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b100c8830 tx=0x7f4af8015000 comp rx=0 tx=0).stop 2023-10-06T03:16:39.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 msgr2=0x7f4b100af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4b100af7d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4b000118e0 tx=0x7f4b00008040 comp rx=0 tx=0).stop 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 shutdown_connections 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b100b5da0 0x7f4b10068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4afc004810 0x7f4b100af7d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4af0066f30 0x7f4af00693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 --2- 172.21.15.82:0/306474484 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b100c8400 0x7f4b100b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 >> 172.21.15.82:0/306474484 conn(0x7f4b100ccf70 msgr2=0x7f4b100c5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 shutdown_connections 2023-10-06T03:16:39.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.603+0000 7f4b0ffff700 1 -- 172.21.15.82:0/306474484 wait complete. 2023-10-06T03:16:39.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:16:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.744+0000 7f0a312a2700 1 Processor -- start 2023-10-06T03:16:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.744+0000 7f0a312a2700 1 -- start start 2023-10-06T03:16:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a312a2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a2c159500 0x7f0a2c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a312a2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c0b3fd0 0x7f0a2c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a312a2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a2c15d8e0 0x7f0a2c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a312a2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c15dd20 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a312a2700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c0b1110 con 0x7f0a2c159500 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a312a2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0b13b0 con 0x7f0a2c0b3fd0 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a2c15d8e0 0x7f0a2c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a2c15d8e0 0x7f0a2c0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52806/0 (socket says 172.21.15.82:52806) 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2b7fe700 1 -- 172.21.15.82:0/4095553069 learned_addr learned my addr 172.21.15.82:0/4095553069 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a227fc700 1 --2- 172.21.15.82:0/4095553069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c0b3fd0 0x7f0a2c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2affd700 1 --2- 172.21.15.82:0/4095553069 >> v2:172.21.15.134:3300/0 conn(0x7f0a2c159500 0x7f0a2c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:39.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2b7fe700 1 -- 172.21.15.82:0/4095553069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c0b3fd0 msgr2=0x7f0a2c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:39.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2b7fe700 1 --2- 172.21.15.82:0/4095553069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c0b3fd0 0x7f0a2c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2b7fe700 1 -- 172.21.15.82:0/4095553069 >> v2:172.21.15.134:3300/0 conn(0x7f0a2c159500 msgr2=0x7f0a2c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:39.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2b7fe700 1 --2- 172.21.15.82:0/4095553069 >> v2:172.21.15.134:3300/0 conn(0x7f0a2c159500 0x7f0a2c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.745+0000 7f0a2b7fe700 1 -- 172.21.15.82:0/4095553069 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0b1690 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a2b7fe700 1 --2- 172.21.15.82:0/4095553069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c0cf6c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c063e00 tx=0x7f0a24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1e1c507f33274d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:39.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a2a7fc700 1 -- 172.21.15.82:0/4095553069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400e070 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a2a7fc700 1 -- 172.21.15.82:0/4095553069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2400ba50 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a2a7fc700 1 -- 172.21.15.82:0/4095553069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a240092e0 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 -- 172.21.15.82:0/4095553069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 msgr2=0x7f0a2c0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 --2- 172.21.15.82:0/4095553069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c0cf6c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c063e00 tx=0x7f0a24009840 comp rx=0 tx=0).stop 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 -- 172.21.15.82:0/4095553069 shutdown_connections 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 --2- 172.21.15.82:0/4095553069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c0cf6c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 --2- 172.21.15.82:0/4095553069 >> v2:172.21.15.134:3300/0 conn(0x7f0a2c159500 0x7f0a2c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 --2- 172.21.15.82:0/4095553069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c0b3fd0 0x7f0a2c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 -- 172.21.15.82:0/4095553069 >> 172.21.15.82:0/4095553069 conn(0x7f0a2c067630 msgr2=0x7f0a2c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 -- 172.21.15.82:0/4095553069 shutdown_connections 2023-10-06T03:16:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.746+0000 7f0a312a2700 1 -- 172.21.15.82:0/4095553069 wait complete. 2023-10-06T03:16:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a312a2700 1 Processor -- start 2023-10-06T03:16:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a312a2700 1 -- start start 2023-10-06T03:16:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a312a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a2c0b3fd0 0x7f0a2c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a312a2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c159500 0x7f0a2c14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a312a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a312a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c15ad30 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a312a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c15afd0 con 0x7f0a2c0b3fd0 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a312a2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c15b2b0 con 0x7f0a2c159500 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a2b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a2b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52814/0 (socket says 172.21.15.82:52814) 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.748+0000 7f0a2b7fe700 1 -- 172.21.15.82:0/2394427783 learned_addr learned my addr 172.21.15.82:0/2394427783 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a2affd700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a2c0b3fd0 0x7f0a2c15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a2b7fe700 1 -- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c159500 msgr2=0x7f0a2c14c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a2b7fe700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c159500 0x7f0a2c14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a2b7fe700 1 -- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a2c0b3fd0 msgr2=0x7f0a2c15a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a2b7fe700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a2c0b3fd0 0x7f0a2c15a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a2b7fe700 1 -- 172.21.15.82:0/2394427783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24009ae0 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a2b7fe700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c150c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c088d00 tx=0x7f0a24018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a237fe700 1 -- 172.21.15.82:0/2394427783 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a240032f0 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a237fe700 1 -- 172.21.15.82:0/2394427783 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a24008e80 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c15b590 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a237fe700 1 -- 172.21.15.82:0/2394427783 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24025690 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.749+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c150740 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.750+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c1505a0 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.750+0000 7f0a237fe700 1 -- 172.21.15.82:0/2394427783 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a24003040 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.751+0000 7f0a237fe700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0a0c066f30 0x7f0a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.751+0000 7f0a237fe700 1 -- 172.21.15.82:0/2394427783 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a240863a0 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.751+0000 7f0a2affd700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0a0c066f30 0x7f0a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.751+0000 7f0a2affd700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0a0c066f30 0x7f0a0c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c006fd0 tx=0x7f0a1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.755+0000 7f0a237fe700 1 -- 172.21.15.82:0/2394427783 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a2c1505a0 con 0x7f0a2c15d8e0 2023-10-06T03:16:39.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:39.983+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0a2c1505a0 con 0x7f0a2c15d8e0 2023-10-06T03:16:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.602+0000 7f0a237fe700 1 -- 172.21.15.82:0/2394427783 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0a2c1505a0 con 0x7f0a2c15d8e0 2023-10-06T03:16:40.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0a0c066f30 msgr2=0x7f0a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:40.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0a0c066f30 0x7f0a0c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c006fd0 tx=0x7f0a1c008040 comp rx=0 tx=0).stop 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 msgr2=0x7f0a2c150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c150c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c088d00 tx=0x7f0a24018000 comp rx=0 tx=0).stop 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 shutdown_connections 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a2c15d8e0 0x7f0a2c150c60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a2c0b3fd0 0x7f0a2c15a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0a0c066f30 0x7f0a0c0693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 --2- 172.21.15.82:0/2394427783 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0a2c159500 0x7f0a2c14c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 >> 172.21.15.82:0/2394427783 conn(0x7f0a2c067630 msgr2=0x7f0a2c0ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 shutdown_connections 2023-10-06T03:16:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.604+0000 7f0a312a2700 1 -- 172.21.15.82:0/2394427783 wait complete. 2023-10-06T03:16:40.619 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.734+0000 7f1a3bfff700 1 Processor -- start 2023-10-06T03:16:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.734+0000 7f1a3bfff700 1 -- start start 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a3bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1a3c15d850 0x7f1a3c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a3bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c0b6170 0x7f1a3c0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a3bfff700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c069f70 con 0x7f1a3c15d480 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a3bfff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0687c0 con 0x7f1a3c15d850 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a3bfff700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c068aa0 con 0x7f1a3c0b6170 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c0b6170 0x7f1a3c0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a327fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1a3c15d850 0x7f1a3c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c0b6170 0x7f1a3c0b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:57794/0 (socket says 172.21.15.82:57794) 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.735+0000 7f1a3b7fe700 1 -- 172.21.15.82:0/1793957437 learned_addr learned my addr 172.21.15.82:0/1793957437 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.736+0000 7f1a3b7fe700 1 -- 172.21.15.82:0/1793957437 >> v2:172.21.15.134:3300/0 conn(0x7f1a3c15d850 msgr2=0x7f1a3c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.736+0000 7f1a3b7fe700 1 --2- 172.21.15.82:0/1793957437 >> v2:172.21.15.134:3300/0 conn(0x7f1a3c15d850 0x7f1a3c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.736+0000 7f1a3b7fe700 1 -- 172.21.15.82:0/1793957437 >> v1:172.21.15.134:6789/0 conn(0x7f1a3c15d480 legacy=0x7f1a3c069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.736+0000 7f1a3b7fe700 1 -- 172.21.15.82:0/1793957437 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c068d80 con 0x7f1a3c0b6170 2023-10-06T03:16:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.736+0000 7f1a3b7fe700 1 --2- 172.21.15.82:0/1793957437 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c0b6170 0x7f1a3c0b0310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009f20 tx=0x7f1a34009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679194246ee53288 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.736+0000 7f1a3a7fc700 1 -- 172.21.15.82:0/1793957437 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400e070 con 0x7f1a3c0b6170 2023-10-06T03:16:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.736+0000 7f1a3a7fc700 1 -- 172.21.15.82:0/1793957437 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3400b9d0 con 0x7f1a3c0b6170 2023-10-06T03:16:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.736+0000 7f1a3a7fc700 1 -- 172.21.15.82:0/1793957437 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a340092e0 con 0x7f1a3c0b6170 2023-10-06T03:16:40.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.737+0000 7f1a3bfff700 1 -- 172.21.15.82:0/1793957437 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c0b6170 msgr2=0x7f1a3c0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:40.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.737+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/1793957437 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c0b6170 0x7f1a3c0b0310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009f20 tx=0x7f1a34009840 comp rx=0 tx=0).stop 2023-10-06T03:16:40.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.737+0000 7f1a3bfff700 1 -- 172.21.15.82:0/1793957437 shutdown_connections 2023-10-06T03:16:40.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.737+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/1793957437 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c0b6170 0x7f1a3c0b0310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.737+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/1793957437 >> v2:172.21.15.134:3300/0 conn(0x7f1a3c15d850 0x7f1a3c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.737+0000 7f1a3bfff700 1 -- 172.21.15.82:0/1793957437 >> 172.21.15.82:0/1793957437 conn(0x7f1a3c0ccf80 msgr2=0x7f1a3c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:40.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.737+0000 7f1a3bfff700 1 -- 172.21.15.82:0/1793957437 shutdown_connections 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.737+0000 7f1a3bfff700 1 -- 172.21.15.82:0/1793957437 wait complete. 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.738+0000 7f1a3bfff700 1 Processor -- start 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.738+0000 7f1a3bfff700 1 -- start start 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a3bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a3c0b6170 0x7f1a3c0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a3c15d480 0x7f1a3c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a3bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c15d850 0x7f1a3c15b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a3bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0cb930 con 0x7f1a3c15d480 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a3bfff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c16ac40 con 0x7f1a3c0b6170 2023-10-06T03:16:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a3bfff700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0cb2e0 con 0x7f1a3c15d850 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a3c15d480 0x7f1a3c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a3c15d480 0x7f1a3c0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52830/0 (socket says 172.21.15.82:52830) 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a327fc700 1 -- 172.21.15.82:0/3553933168 learned_addr learned my addr 172.21.15.82:0/3553933168 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a3b7fe700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c15d850 0x7f1a3c15b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a3affd700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a3c0b6170 0x7f1a3c0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a327fc700 1 -- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c15d850 msgr2=0x7f1a3c15b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a327fc700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c15d850 0x7f1a3c15b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a327fc700 1 -- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a3c0b6170 msgr2=0x7f1a3c0c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a327fc700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a3c0b6170 0x7f1a3c0c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.739+0000 7f1a327fc700 1 -- 172.21.15.82:0/3553933168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34009ae0 con 0x7f1a3c15d480 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.740+0000 7f1a327fc700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a3c15d480 0x7f1a3c0cbdc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e930 tx=0x7f1a240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.740+0000 7f1a337fe700 1 -- 172.21.15.82:0/3553933168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24013680 con 0x7f1a3c15d480 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.740+0000 7f1a337fe700 1 -- 172.21.15.82:0/3553933168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a240137e0 con 0x7f1a3c15d480 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.740+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3c0cb5c0 con 0x7f1a3c15d480 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.740+0000 7f1a337fe700 1 -- 172.21.15.82:0/3553933168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24013b80 con 0x7f1a3c15d480 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.740+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c0caf00 con 0x7f1a3c15d480 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.741+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3c0ccb60 con 0x7f1a3c15d480 2023-10-06T03:16:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.741+0000 7f1a337fe700 1 -- 172.21.15.82:0/3553933168 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a2400c3e0 con 0x7f1a3c15d480 2023-10-06T03:16:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.741+0000 7f1a337fe700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a1c066f30 0x7f1a1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.741+0000 7f1a337fe700 1 -- 172.21.15.82:0/3553933168 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1a24084740 con 0x7f1a3c15d480 2023-10-06T03:16:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.742+0000 7f1a3affd700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a1c066f30 0x7f1a1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.742+0000 7f1a3affd700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a1c066f30 0x7f1a1c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c003a80 tx=0x7f1a2c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.745+0000 7f1a337fe700 1 -- 172.21.15.82:0/3553933168 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a24051850 con 0x7f1a3c15d480 2023-10-06T03:16:40.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.972+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a3c04c3c0 con 0x7f1a3c15d480 2023-10-06T03:16:40.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.972+0000 7f1a337fe700 1 -- 172.21.15.82:0/3553933168 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f1a24054e70 con 0x7f1a3c15d480 2023-10-06T03:16:40.974 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:40.974 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/968017372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":968017372},{"type":"v1","addr":"172.21.15.134:6836","nonce":968017372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1664218192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1664218192},{"type":"v1","addr":"172.21.15.82:6834","nonce":1664218192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2857365191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":2857365191},{"type":"v1","addr":"172.21.15.82:6835","nonce":2857365191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:16:36.965976+0000","modified":"2023-10-06T03:16:40.600885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/4000888931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":4000888931},{"type":"v1","addr":"172.21.15.134:6837","nonce":4000888931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:16:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a1c066f30 msgr2=0x7f1a1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a1c066f30 0x7f1a1c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c003a80 tx=0x7f1a2c007ec0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a3c15d480 msgr2=0x7f1a3c0cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a3c15d480 0x7f1a3c0cbdc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e930 tx=0x7f1a240091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 shutdown_connections 2023-10-06T03:16:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a1c066f30 0x7f1a1c0693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a3c15d850 0x7f1a3c15b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a3c0b6170 0x7f1a3c0c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 --2- 172.21.15.82:0/3553933168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a3c15d480 0x7f1a3c0cbdc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:40.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 >> 172.21.15.82:0/3553933168 conn(0x7f1a3c0ccf80 msgr2=0x7f1a3c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:40.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 shutdown_connections 2023-10-06T03:16:40.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:40.974+0000 7f1a3bfff700 1 -- 172.21.15.82:0/3553933168 wait complete. 2023-10-06T03:16:40.977 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2023-10-06T03:16:40.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.101+0000 7efd68b18700 1 Processor -- start 2023-10-06T03:16:41.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.101+0000 7efd68b18700 1 -- start start 2023-10-06T03:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.101+0000 7efd68b18700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd6415d480 0x7efd64069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd68b18700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd640687c0 con 0x7efd640b0a20 2023-10-06T03:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd68b18700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd64068aa0 con 0x7efd64069da0 2023-10-06T03:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd68b18700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd64068d80 con 0x7efd6415d480 2023-10-06T03:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd63fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efd640b0a20 0x7efd640b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41694/0 (socket says 172.21.15.82:41694) 2023-10-06T03:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd63fff700 1 -- 172.21.15.82:0/3048252101 learned_addr learned my addr 172.21.15.82:0/3048252101 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd637fe700 1 --2- 172.21.15.82:0/3048252101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd6415d480 0x7efd64069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd62ffd700 1 -- 172.21.15.82:0/3048252101 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671733212 0 0) 0x7efd640687c0 con 0x7efd640b0a20 2023-10-06T03:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd62ffd700 1 -- 172.21.15.82:0/3048252101 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd50003570 con 0x7efd640b0a20 2023-10-06T03:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd62ffd700 1 -- 172.21.15.82:0/3048252101 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901435929 0 0) 0x7efd64068aa0 con 0x7efd64069da0 2023-10-06T03:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd62ffd700 1 -- 172.21.15.82:0/3048252101 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd640687c0 con 0x7efd64069da0 2023-10-06T03:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd637fe700 1 -- 172.21.15.82:0/3048252101 >> v1:172.21.15.134:6789/0 conn(0x7efd64069da0 legacy=0x7efd640b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd637fe700 1 -- 172.21.15.82:0/3048252101 >> v1:172.21.15.82:6789/0 conn(0x7efd640b0a20 legacy=0x7efd640b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd637fe700 1 -- 172.21.15.82:0/3048252101 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64069060 con 0x7efd6415d480 2023-10-06T03:16:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.102+0000 7efd637fe700 1 --2- 172.21.15.82:0/3048252101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd6415d480 0x7efd64069860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd54009910 tx=0x7efd540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6907f8aa708ed4c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd62ffd700 1 -- 172.21.15.82:0/3048252101 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011630 con 0x7efd6415d480 2023-10-06T03:16:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd62ffd700 1 -- 172.21.15.82:0/3048252101 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54011790 con 0x7efd6415d480 2023-10-06T03:16:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd62ffd700 1 -- 172.21.15.82:0/3048252101 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011b30 con 0x7efd6415d480 2023-10-06T03:16:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd68b18700 1 -- 172.21.15.82:0/3048252101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd6415d480 msgr2=0x7efd64069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd68b18700 1 --2- 172.21.15.82:0/3048252101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd6415d480 0x7efd64069860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd54009910 tx=0x7efd540091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd68b18700 1 -- 172.21.15.82:0/3048252101 shutdown_connections 2023-10-06T03:16:41.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd68b18700 1 --2- 172.21.15.82:0/3048252101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd6415d480 0x7efd64069860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd68b18700 1 -- 172.21.15.82:0/3048252101 >> 172.21.15.82:0/3048252101 conn(0x7efd640ccf80 msgr2=0x7efd640cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:41.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd68b18700 1 -- 172.21.15.82:0/3048252101 shutdown_connections 2023-10-06T03:16:41.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.103+0000 7efd68b18700 1 -- 172.21.15.82:0/3048252101 wait complete. 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.104+0000 7efd68b18700 1 Processor -- start 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.104+0000 7efd68b18700 1 -- start start 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd68b18700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd64069da0 0x7efd640c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd68b18700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd640b0a20 0x7efd64169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd68b18700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd6415d480 0x7efd640b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd68b18700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd640aed90 con 0x7efd64069da0 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd68b18700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd640c8960 con 0x7efd6415d480 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd68b18700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6416ab60 con 0x7efd640b0a20 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd637fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd64069da0 0x7efd640c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd637fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd64069da0 0x7efd640c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52838/0 (socket says 172.21.15.82:52838) 2023-10-06T03:16:41.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd637fe700 1 -- 172.21.15.82:0/1232037439 learned_addr learned my addr 172.21.15.82:0/1232037439 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd5affd700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd640b0a20 0x7efd64169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.105+0000 7efd63fff700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd6415d480 0x7efd640b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd637fe700 1 -- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd640b0a20 msgr2=0x7efd64169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd637fe700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd640b0a20 0x7efd64169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd637fe700 1 -- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd6415d480 msgr2=0x7efd640b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd637fe700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd6415d480 0x7efd640b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd637fe700 1 -- 172.21.15.82:0/1232037439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54009420 con 0x7efd64069da0 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd637fe700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd64069da0 0x7efd640c8df0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efd54009f00 tx=0x7efd54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd5bfff700 1 -- 172.21.15.82:0/1232037439 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5401f070 con 0x7efd64069da0 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd5bfff700 1 -- 172.21.15.82:0/1232037439 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54000bc0 con 0x7efd64069da0 2023-10-06T03:16:41.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6416a5a0 con 0x7efd64069da0 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd5bfff700 1 -- 172.21.15.82:0/1232037439 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54025420 con 0x7efd64069da0 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.106+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd640c85f0 con 0x7efd64069da0 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.107+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6404c3c0 con 0x7efd64069da0 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.107+0000 7efd5bfff700 1 -- 172.21.15.82:0/1232037439 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd54023070 con 0x7efd64069da0 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.108+0000 7efd5bfff700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efd44066f30 0x7efd440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.108+0000 7efd5bfff700 1 -- 172.21.15.82:0/1232037439 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efd540859e0 con 0x7efd64069da0 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.108+0000 7efd5affd700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efd44066f30 0x7efd440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.108+0000 7efd5affd700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efd44066f30 0x7efd440693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd640d0180 tx=0x7efd4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.112+0000 7efd5bfff700 1 -- 172.21.15.82:0/1232037439 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd54052af0 con 0x7efd64069da0 2023-10-06T03:16:41.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.295+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd64069340 con 0x7efd64069da0 2023-10-06T03:16:41.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.295+0000 7efd5bfff700 1 -- 172.21.15.82:0/1232037439 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16866 (secure 0 0 0) 0x7efd5402a020 con 0x7efd64069da0 2023-10-06T03:16:41.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:41.297 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:16:38.582429+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:16:35.054163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:16:35.928949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efd44066f30 msgr2=0x7efd440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efd44066f30 0x7efd440693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd640d0180 tx=0x7efd4c009040 comp rx=0 tx=0).stop 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd64069da0 msgr2=0x7efd640c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd64069da0 0x7efd640c8df0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efd54009f00 tx=0x7efd54017000 comp rx=0 tx=0).stop 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 shutdown_connections 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd6415d480 0x7efd640b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd64069da0 0x7efd640c8df0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efd44066f30 0x7efd440693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 --2- 172.21.15.82:0/1232037439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd640b0a20 0x7efd64169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 >> 172.21.15.82:0/1232037439 conn(0x7efd640ccf80 msgr2=0x7efd640ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:41.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 shutdown_connections 2023-10-06T03:16:41.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.298+0000 7efd68b18700 1 -- 172.21.15.82:0/1232037439 wait complete. 2023-10-06T03:16:41.311 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:16:41.312 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:16:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.425+0000 7fa2dc6d5700 1 Processor -- start 2023-10-06T03:16:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.425+0000 7fa2dc6d5700 1 -- start start 2023-10-06T03:16:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2dc6d5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 0x7fa2d40d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2dc6d5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2d415d930 0x7fa2d40b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2dc6d5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40b2ad0 con 0x7fa2d41591b0 2023-10-06T03:16:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2dc6d5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40b4160 con 0x7fa2d415d930 2023-10-06T03:16:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2dc6d5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40b1f80 con 0x7fa2d415d560 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d9c70700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2d415d930 0x7fa2d40b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d9c70700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2d415d930 0x7fa2d40b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52854/0 (socket says 172.21.15.82:52854) 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d9c70700 1 -- 172.21.15.82:0/4251860369 learned_addr learned my addr 172.21.15.82:0/4251860369 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2da471700 1 --2- 172.21.15.82:0/4251860369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 0x7fa2d40d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d9c70700 1 -- 172.21.15.82:0/4251860369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 msgr2=0x7fa2d40d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d9c70700 1 --2- 172.21.15.82:0/4251860369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 0x7fa2d40d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d9c70700 1 -- 172.21.15.82:0/4251860369 >> v1:172.21.15.82:6789/0 conn(0x7fa2d41591b0 legacy=0x7fa2d4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d946f700 1 -- 172.21.15.82:0/4251860369 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286026771 0 0) 0x7fa2d40b2ad0 con 0x7fa2d41591b0 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d9c70700 1 -- 172.21.15.82:0/4251860369 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40b2230 con 0x7fa2d415d930 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d9c70700 1 --2- 172.21.15.82:0/4251860369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40b1a40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40099b0 tx=0x7fa2c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c6384a521c21fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d946f700 1 -- 172.21.15.82:0/4251860369 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400b860 con 0x7fa2d415d930 2023-10-06T03:16:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d946f700 1 -- 172.21.15.82:0/4251860369 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c400b9c0 con 0x7fa2d415d930 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.426+0000 7fa2d946f700 1 -- 172.21.15.82:0/4251860369 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400bd60 con 0x7fa2d415d930 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.427+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/4251860369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 msgr2=0x7fa2d40b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.427+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/4251860369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40b1a40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40099b0 tx=0x7fa2c4009250 comp rx=0 tx=0).stop 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.427+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/4251860369 shutdown_connections 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.427+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/4251860369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 0x7fa2d40d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.427+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/4251860369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40b1a40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.427+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/4251860369 >> 172.21.15.82:0/4251860369 conn(0x7fa2d40d1180 msgr2=0x7fa2d4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.427+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/4251860369 shutdown_connections 2023-10-06T03:16:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.427+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/4251860369 wait complete. 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.428+0000 7fa2dc6d5700 1 Processor -- start 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.428+0000 7fa2dc6d5700 1 -- start start 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dc6d5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d41591b0 0x7fa2d40ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dc6d5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 0x7fa2d415a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dc6d5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dc6d5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4154fd0 con 0x7fa2d415d930 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dc6d5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4158790 con 0x7fa2d41591b0 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dc6d5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4157b80 con 0x7fa2d415d560 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dac72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dac72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40a6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52868/0 (socket says 172.21.15.82:52868) 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dac72700 1 -- 172.21.15.82:0/1626290693 learned_addr learned my addr 172.21.15.82:0/1626290693 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2da471700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d41591b0 0x7fa2d40ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2d9c70700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 0x7fa2d415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dac72700 1 -- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 msgr2=0x7fa2d415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dac72700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 0x7fa2d415a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dac72700 1 -- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d41591b0 msgr2=0x7fa2d40ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dac72700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d41591b0 0x7fa2d40ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.429+0000 7fa2dac72700 1 -- 172.21.15.82:0/1626290693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c40094f0 con 0x7fa2d415d930 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.430+0000 7fa2dac72700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40a6f70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00c890 tx=0x7fa2cc001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.430+0000 7fa2ca7fc700 1 -- 172.21.15.82:0/1626290693 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc012630 con 0x7fa2d415d930 2023-10-06T03:16:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.430+0000 7fa2ca7fc700 1 -- 172.21.15.82:0/1626290693 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc0127b0 con 0x7fa2d415d930 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.430+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d4157e60 con 0x7fa2d415d930 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.430+0000 7fa2ca7fc700 1 -- 172.21.15.82:0/1626290693 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc012b70 con 0x7fa2d415d930 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.430+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d4158420 con 0x7fa2d415d930 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.431+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d4064050 con 0x7fa2d415d930 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.431+0000 7fa2ca7fc700 1 -- 172.21.15.82:0/1626290693 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2cc003030 con 0x7fa2d415d930 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.431+0000 7fa2ca7fc700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2b8066f30 0x7fa2b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.431+0000 7fa2ca7fc700 1 -- 172.21.15.82:0/1626290693 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2cc084680 con 0x7fa2d415d930 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.432+0000 7fa2da471700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2b8066f30 0x7fa2b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.432+0000 7fa2da471700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2b8066f30 0x7fa2b80693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0006fd0 tx=0x7fa2d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.435+0000 7fa2ca7fc700 1 -- 172.21.15.82:0/1626290693 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2cc051790 con 0x7fa2d415d930 2023-10-06T03:16:41.570 INFO:tasks.ceph.mds.d.smithi134.stderr:2023-10-06T03:16:41.570+0000 7fce4aae4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:16:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.613+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2d4158900 con 0x7fa2b8066f30 2023-10-06T03:16:41.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.623+0000 7fa2ca7fc700 1 -- 172.21.15.82:0/1626290693 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286880 (secure 0 0 0) 0x7fa2d4158900 con 0x7fa2b8066f30 2023-10-06T03:16:41.627 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:41.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2b8066f30 msgr2=0x7fa2b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2b8066f30 0x7fa2b80693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0006fd0 tx=0x7fa2d0008040 comp rx=0 tx=0).stop 2023-10-06T03:16:41.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 msgr2=0x7fa2d40a6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40a6f70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00c890 tx=0x7fa2cc001630 comp rx=0 tx=0).stop 2023-10-06T03:16:41.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 shutdown_connections 2023-10-06T03:16:41.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d415d930 0x7fa2d40a6f70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d41591b0 0x7fa2d40ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2b8066f30 0x7fa2b80693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 --2- 172.21.15.82:0/1626290693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d415d560 0x7fa2d415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 >> 172.21.15.82:0/1626290693 conn(0x7fa2d40d1180 msgr2=0x7fa2d40681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:41.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 shutdown_connections 2023-10-06T03:16:41.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.626+0000 7fa2dc6d5700 1 -- 172.21.15.82:0/1626290693 wait complete. 2023-10-06T03:16:41.631 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:16:41.639 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-06T03:16:41.160241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382168,"kb_used_data":3864,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592552,"statfs":{"total":773094113280,"available":770654773248,"internally_reserved":0,"allocated":3956736,"data_stored":2274458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.583678"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.598184+0000","last_change":"2023-10-06T03:16:37.598184+0000","last_active":"2023-10-06T03:16:37.598184+0000","last_peered":"2023-10-06T03:16:37.598184+0000","last_clean":"2023-10-06T03:16:37.598184+0000","last_became_active":"2023-10-06T03:16:37.597830+0000","last_became_peered":"2023-10-06T03:16:37.597830+0000","last_unstale":"2023-10-06T03:16:37.598184+0000","last_undegraded":"2023-10-06T03:16:37.598184+0000","last_fullsized":"2023-10-06T03:16:37.598184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:35.766427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600019+0000","last_change":"2023-10-06T03:16:37.600019+0000","last_active":"2023-10-06T03:16:37.600019+0000","last_peered":"2023-10-06T03:16:37.600019+0000","last_clean":"2023-10-06T03:16:37.600019+0000","last_became_active":"2023-10-06T03:16:37.599712+0000","last_became_peered":"2023-10-06T03:16:37.599712+0000","last_unstale":"2023-10-06T03:16:37.600019+0000","last_undegraded":"2023-10-06T03:16:37.600019+0000","last_fullsized":"2023-10-06T03:16:37.600019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:38.046558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601170+0000","last_change":"2023-10-06T03:16:37.597760+0000","last_active":"2023-10-06T03:16:37.601170+0000","last_peered":"2023-10-06T03:16:37.601170+0000","last_clean":"2023-10-06T03:16:37.601170+0000","last_became_active":"2023-10-06T03:16:37.597510+0000","last_became_peered":"2023-10-06T03:16:37.597510+0000","last_unstale":"2023-10-06T03:16:37.601170+0000","last_undegraded":"2023-10-06T03:16:37.601170+0000","last_fullsized":"2023-10-06T03:16:37.601170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:23.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602258+0000","last_change":"2023-10-06T03:16:37.597743+0000","last_active":"2023-10-06T03:16:37.602258+0000","last_peered":"2023-10-06T03:16:37.602258+0000","last_clean":"2023-10-06T03:16:37.602258+0000","last_became_active":"2023-10-06T03:16:37.597494+0000","last_became_peered":"2023-10-06T03:16:37.597494+0000","last_unstale":"2023-10-06T03:16:37.602258+0000","last_undegraded":"2023-10-06T03:16:37.602258+0000","last_fullsized":"2023-10-06T03:16:37.602258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:41.123513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605327+0000","last_change":"2023-10-06T03:16:37.602820+0000","last_active":"2023-10-06T03:16:37.605327+0000","last_peered":"2023-10-06T03:16:37.605327+0000","last_clean":"2023-10-06T03:16:37.605327+0000","last_became_active":"2023-10-06T03:16:37.602519+0000","last_became_peered":"2023-10-06T03:16:37.602519+0000","last_unstale":"2023-10-06T03:16:37.605327+0000","last_undegraded":"2023-10-06T03:16:37.605327+0000","last_fullsized":"2023-10-06T03:16:37.605327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:39.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.597927+0000","last_change":"2023-10-06T03:16:37.597927+0000","last_active":"2023-10-06T03:16:37.597927+0000","last_peered":"2023-10-06T03:16:37.597927+0000","last_clean":"2023-10-06T03:16:37.597927+0000","last_became_active":"2023-10-06T03:16:37.597676+0000","last_became_peered":"2023-10-06T03:16:37.597676+0000","last_unstale":"2023-10-06T03:16:37.597927+0000","last_undegraded":"2023-10-06T03:16:37.597927+0000","last_fullsized":"2023-10-06T03:16:37.597927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:52.523580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601525+0000","last_change":"2023-10-06T03:16:37.595405+0000","last_active":"2023-10-06T03:16:37.601525+0000","last_peered":"2023-10-06T03:16:37.601525+0000","last_clean":"2023-10-06T03:16:37.601525+0000","last_became_active":"2023-10-06T03:16:37.595111+0000","last_became_peered":"2023-10-06T03:16:37.595111+0000","last_unstale":"2023-10-06T03:16:37.601525+0000","last_undegraded":"2023-10-06T03:16:37.601525+0000","last_fullsized":"2023-10-06T03:16:37.601525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:20.748360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.607264+0000","last_change":"2023-10-06T03:16:37.607264+0000","last_active":"2023-10-06T03:16:37.607264+0000","last_peered":"2023-10-06T03:16:37.607264+0000","last_clean":"2023-10-06T03:16:37.607264+0000","last_became_active":"2023-10-06T03:16:37.606884+0000","last_became_peered":"2023-10-06T03:16:37.606884+0000","last_unstale":"2023-10-06T03:16:37.607264+0000","last_undegraded":"2023-10-06T03:16:37.607264+0000","last_fullsized":"2023-10-06T03:16:37.607264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:33.692348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.593308+0000","last_change":"2023-10-06T03:16:37.591574+0000","last_active":"2023-10-06T03:16:37.593308+0000","last_peered":"2023-10-06T03:16:37.593308+0000","last_clean":"2023-10-06T03:16:37.593308+0000","last_became_active":"2023-10-06T03:16:37.591271+0000","last_became_peered":"2023-10-06T03:16:37.591271+0000","last_unstale":"2023-10-06T03:16:37.593308+0000","last_undegraded":"2023-10-06T03:16:37.593308+0000","last_fullsized":"2023-10-06T03:16:37.593308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:37.168785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.612848+0000","last_change":"2023-10-06T03:16:37.611064+0000","last_active":"2023-10-06T03:16:37.612848+0000","last_peered":"2023-10-06T03:16:37.612848+0000","last_clean":"2023-10-06T03:16:37.612848+0000","last_became_active":"2023-10-06T03:16:37.610528+0000","last_became_peered":"2023-10-06T03:16:37.610528+0000","last_unstale":"2023-10-06T03:16:37.612848+0000","last_undegraded":"2023-10-06T03:16:37.612848+0000","last_fullsized":"2023-10-06T03:16:37.612848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:54.678016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.603876+0000","last_change":"2023-10-06T03:16:37.595461+0000","last_active":"2023-10-06T03:16:37.603876+0000","last_peered":"2023-10-06T03:16:37.603876+0000","last_clean":"2023-10-06T03:16:37.603876+0000","last_became_active":"2023-10-06T03:16:37.595185+0000","last_became_peered":"2023-10-06T03:16:37.595185+0000","last_unstale":"2023-10-06T03:16:37.603876+0000","last_undegraded":"2023-10-06T03:16:37.603876+0000","last_fullsized":"2023-10-06T03:16:37.603876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:23.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600974+0000","last_change":"2023-10-06T03:16:37.599197+0000","last_active":"2023-10-06T03:16:37.600974+0000","last_peered":"2023-10-06T03:16:37.600974+0000","last_clean":"2023-10-06T03:16:37.600974+0000","last_became_active":"2023-10-06T03:16:37.598858+0000","last_became_peered":"2023-10-06T03:16:37.598858+0000","last_unstale":"2023-10-06T03:16:37.600974+0000","last_undegraded":"2023-10-06T03:16:37.600974+0000","last_fullsized":"2023-10-06T03:16:37.600974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:26.068931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.610342+0000","last_change":"2023-10-06T03:16:37.607782+0000","last_active":"2023-10-06T03:16:37.610342+0000","last_peered":"2023-10-06T03:16:37.610342+0000","last_clean":"2023-10-06T03:16:37.610342+0000","last_became_active":"2023-10-06T03:16:37.606775+0000","last_became_peered":"2023-10-06T03:16:37.606775+0000","last_unstale":"2023-10-06T03:16:37.610342+0000","last_undegraded":"2023-10-06T03:16:37.610342+0000","last_fullsized":"2023-10-06T03:16:37.610342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:25.322353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.611033+0000","last_change":"2023-10-06T03:16:37.606681+0000","last_active":"2023-10-06T03:16:37.611033+0000","last_peered":"2023-10-06T03:16:37.611033+0000","last_clean":"2023-10-06T03:16:37.611033+0000","last_became_active":"2023-10-06T03:16:37.606420+0000","last_became_peered":"2023-10-06T03:16:37.606420+0000","last_unstale":"2023-10-06T03:16:37.611033+0000","last_undegraded":"2023-10-06T03:16:37.611033+0000","last_fullsized":"2023-10-06T03:16:37.611033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:29.145161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602620+0000","last_change":"2023-10-06T03:16:37.601213+0000","last_active":"2023-10-06T03:16:37.602620+0000","last_peered":"2023-10-06T03:16:37.602620+0000","last_clean":"2023-10-06T03:16:37.602620+0000","last_became_active":"2023-10-06T03:16:37.600913+0000","last_became_peered":"2023-10-06T03:16:37.600913+0000","last_unstale":"2023-10-06T03:16:37.602620+0000","last_undegraded":"2023-10-06T03:16:37.602620+0000","last_fullsized":"2023-10-06T03:16:37.602620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:37.168785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614286+0000","last_change":"2023-10-06T03:16:37.605205+0000","last_active":"2023-10-06T03:16:37.614286+0000","last_peered":"2023-10-06T03:16:37.614286+0000","last_clean":"2023-10-06T03:16:37.614286+0000","last_became_active":"2023-10-06T03:16:37.604948+0000","last_became_peered":"2023-10-06T03:16:37.604948+0000","last_unstale":"2023-10-06T03:16:37.614286+0000","last_undegraded":"2023-10-06T03:16:37.614286+0000","last_fullsized":"2023-10-06T03:16:37.614286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:25.322353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613934+0000","last_change":"2023-10-06T03:16:37.606611+0000","last_active":"2023-10-06T03:16:37.613934+0000","last_peered":"2023-10-06T03:16:37.613934+0000","last_clean":"2023-10-06T03:16:37.613934+0000","last_became_active":"2023-10-06T03:16:37.606344+0000","last_became_peered":"2023-10-06T03:16:37.606344+0000","last_unstale":"2023-10-06T03:16:37.613934+0000","last_undegraded":"2023-10-06T03:16:37.613934+0000","last_fullsized":"2023-10-06T03:16:37.613934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:54.678016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.604009+0000","last_change":"2023-10-06T03:16:37.604009+0000","last_active":"2023-10-06T03:16:37.604009+0000","last_peered":"2023-10-06T03:16:37.604009+0000","last_clean":"2023-10-06T03:16:37.604009+0000","last_became_active":"2023-10-06T03:16:37.603701+0000","last_became_peered":"2023-10-06T03:16:37.603701+0000","last_unstale":"2023-10-06T03:16:37.604009+0000","last_undegraded":"2023-10-06T03:16:37.604009+0000","last_fullsized":"2023-10-06T03:16:37.604009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:44.324197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601051+0000","last_change":"2023-10-06T03:16:37.596013+0000","last_active":"2023-10-06T03:16:37.601051+0000","last_peered":"2023-10-06T03:16:37.601051+0000","last_clean":"2023-10-06T03:16:37.601051+0000","last_became_active":"2023-10-06T03:16:37.595780+0000","last_became_peered":"2023-10-06T03:16:37.595780+0000","last_unstale":"2023-10-06T03:16:37.601051+0000","last_undegraded":"2023-10-06T03:16:37.601051+0000","last_fullsized":"2023-10-06T03:16:37.601051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:11.043471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.604975+0000","last_change":"2023-10-06T03:16:37.604975+0000","last_active":"2023-10-06T03:16:37.604975+0000","last_peered":"2023-10-06T03:16:37.604975+0000","last_clean":"2023-10-06T03:16:37.604975+0000","last_became_active":"2023-10-06T03:16:37.604717+0000","last_became_peered":"2023-10-06T03:16:37.604717+0000","last_unstale":"2023-10-06T03:16:37.604975+0000","last_undegraded":"2023-10-06T03:16:37.604975+0000","last_fullsized":"2023-10-06T03:16:37.604975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:06.918970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602838+0000","last_change":"2023-10-06T03:16:37.596100+0000","last_active":"2023-10-06T03:16:37.602838+0000","last_peered":"2023-10-06T03:16:37.602838+0000","last_clean":"2023-10-06T03:16:37.602838+0000","last_became_active":"2023-10-06T03:16:37.595829+0000","last_became_peered":"2023-10-06T03:16:37.595829+0000","last_unstale":"2023-10-06T03:16:37.602838+0000","last_undegraded":"2023-10-06T03:16:37.602838+0000","last_fullsized":"2023-10-06T03:16:37.602838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:26.068931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602635+0000","last_change":"2023-10-06T03:16:37.599584+0000","last_active":"2023-10-06T03:16:37.602635+0000","last_peered":"2023-10-06T03:16:37.602635+0000","last_clean":"2023-10-06T03:16:37.602635+0000","last_became_active":"2023-10-06T03:16:37.598957+0000","last_became_peered":"2023-10-06T03:16:37.598957+0000","last_unstale":"2023-10-06T03:16:37.602635+0000","last_undegraded":"2023-10-06T03:16:37.602635+0000","last_fullsized":"2023-10-06T03:16:37.602635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:28.972124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614135+0000","last_change":"2023-10-06T03:16:37.607319+0000","last_active":"2023-10-06T03:16:37.614135+0000","last_peered":"2023-10-06T03:16:37.614135+0000","last_clean":"2023-10-06T03:16:37.614135+0000","last_became_active":"2023-10-06T03:16:37.607052+0000","last_became_peered":"2023-10-06T03:16:37.607052+0000","last_unstale":"2023-10-06T03:16:37.614135+0000","last_undegraded":"2023-10-06T03:16:37.614135+0000","last_fullsized":"2023-10-06T03:16:37.614135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:37.168785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.615682+0000","last_change":"2023-10-06T03:16:37.612724+0000","last_active":"2023-10-06T03:16:37.615682+0000","last_peered":"2023-10-06T03:16:37.615682+0000","last_clean":"2023-10-06T03:16:37.615682+0000","last_became_active":"2023-10-06T03:16:37.612408+0000","last_became_peered":"2023-10-06T03:16:37.612408+0000","last_unstale":"2023-10-06T03:16:37.615682+0000","last_undegraded":"2023-10-06T03:16:37.615682+0000","last_fullsized":"2023-10-06T03:16:37.615682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:36.177339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.599436+0000","last_change":"2023-10-06T03:16:37.599436+0000","last_active":"2023-10-06T03:16:37.599436+0000","last_peered":"2023-10-06T03:16:37.599436+0000","last_clean":"2023-10-06T03:16:37.599436+0000","last_became_active":"2023-10-06T03:16:37.599101+0000","last_became_peered":"2023-10-06T03:16:37.599101+0000","last_unstale":"2023-10-06T03:16:37.599436+0000","last_undegraded":"2023-10-06T03:16:37.599436+0000","last_fullsized":"2023-10-06T03:16:37.599436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:48.312529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605047+0000","last_change":"2023-10-06T03:16:37.605047+0000","last_active":"2023-10-06T03:16:37.605047+0000","last_peered":"2023-10-06T03:16:37.605047+0000","last_clean":"2023-10-06T03:16:37.605047+0000","last_became_active":"2023-10-06T03:16:37.604792+0000","last_became_peered":"2023-10-06T03:16:37.604792+0000","last_unstale":"2023-10-06T03:16:37.605047+0000","last_undegraded":"2023-10-06T03:16:37.605047+0000","last_fullsized":"2023-10-06T03:16:37.605047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:27.450298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.603651+0000","last_change":"2023-10-06T03:16:37.603651+0000","last_active":"2023-10-06T03:16:37.603651+0000","last_peered":"2023-10-06T03:16:37.603651+0000","last_clean":"2023-10-06T03:16:37.603651+0000","last_became_active":"2023-10-06T03:16:37.603385+0000","last_became_peered":"2023-10-06T03:16:37.603385+0000","last_unstale":"2023-10-06T03:16:37.603651+0000","last_undegraded":"2023-10-06T03:16:37.603651+0000","last_fullsized":"2023-10-06T03:16:37.603651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:46.496334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.610072+0000","last_change":"2023-10-06T03:16:37.606497+0000","last_active":"2023-10-06T03:16:37.610072+0000","last_peered":"2023-10-06T03:16:37.610072+0000","last_clean":"2023-10-06T03:16:37.610072+0000","last_became_active":"2023-10-06T03:16:37.604178+0000","last_became_peered":"2023-10-06T03:16:37.604178+0000","last_unstale":"2023-10-06T03:16:37.610072+0000","last_undegraded":"2023-10-06T03:16:37.610072+0000","last_fullsized":"2023-10-06T03:16:37.610072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:26.370414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601936+0000","last_change":"2023-10-06T03:16:37.601936+0000","last_active":"2023-10-06T03:16:37.601936+0000","last_peered":"2023-10-06T03:16:37.601936+0000","last_clean":"2023-10-06T03:16:37.601936+0000","last_became_active":"2023-10-06T03:16:37.601677+0000","last_became_peered":"2023-10-06T03:16:37.601677+0000","last_unstale":"2023-10-06T03:16:37.601936+0000","last_undegraded":"2023-10-06T03:16:37.601936+0000","last_fullsized":"2023-10-06T03:16:37.601936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:36.177339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601434+0000","last_change":"2023-10-06T03:16:37.601434+0000","last_active":"2023-10-06T03:16:37.601434+0000","last_peered":"2023-10-06T03:16:37.601434+0000","last_clean":"2023-10-06T03:16:37.601434+0000","last_became_active":"2023-10-06T03:16:37.600516+0000","last_became_peered":"2023-10-06T03:16:37.600516+0000","last_unstale":"2023-10-06T03:16:37.601434+0000","last_undegraded":"2023-10-06T03:16:37.601434+0000","last_fullsized":"2023-10-06T03:16:37.601434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:52.523580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614094+0000","last_change":"2023-10-06T03:16:37.607257+0000","last_active":"2023-10-06T03:16:37.614094+0000","last_peered":"2023-10-06T03:16:37.614094+0000","last_clean":"2023-10-06T03:16:37.614094+0000","last_became_active":"2023-10-06T03:16:37.606916+0000","last_became_peered":"2023-10-06T03:16:37.606916+0000","last_unstale":"2023-10-06T03:16:37.614094+0000","last_undegraded":"2023-10-06T03:16:37.614094+0000","last_fullsized":"2023-10-06T03:16:37.614094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:47.686372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602680+0000","last_change":"2023-10-06T03:16:37.602680+0000","last_active":"2023-10-06T03:16:37.602680+0000","last_peered":"2023-10-06T03:16:37.602680+0000","last_clean":"2023-10-06T03:16:37.602680+0000","last_became_active":"2023-10-06T03:16:37.602377+0000","last_became_peered":"2023-10-06T03:16:37.602377+0000","last_unstale":"2023-10-06T03:16:37.602680+0000","last_undegraded":"2023-10-06T03:16:37.602680+0000","last_fullsized":"2023-10-06T03:16:37.602680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:44.324197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613909+0000","last_change":"2023-10-06T03:16:37.605796+0000","last_active":"2023-10-06T03:16:37.613909+0000","last_peered":"2023-10-06T03:16:37.613909+0000","last_clean":"2023-10-06T03:16:37.613909+0000","last_became_active":"2023-10-06T03:16:37.605544+0000","last_became_peered":"2023-10-06T03:16:37.605544+0000","last_unstale":"2023-10-06T03:16:37.613909+0000","last_undegraded":"2023-10-06T03:16:37.613909+0000","last_fullsized":"2023-10-06T03:16:37.613909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:26.068931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614793+0000","last_change":"2023-10-06T03:16:36.598810+0000","last_active":"2023-10-06T03:16:37.614793+0000","last_peered":"2023-10-06T03:16:37.614793+0000","last_clean":"2023-10-06T03:16:37.614793+0000","last_became_active":"2023-10-06T03:16:36.598481+0000","last_became_peered":"2023-10-06T03:16:36.598481+0000","last_unstale":"2023-10-06T03:16:37.614793+0000","last_undegraded":"2023-10-06T03:16:37.614793+0000","last_fullsized":"2023-10-06T03:16:37.614793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:23.651906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.606800+0000","last_change":"2023-10-06T03:16:37.606800+0000","last_active":"2023-10-06T03:16:37.606800+0000","last_peered":"2023-10-06T03:16:37.606800+0000","last_clean":"2023-10-06T03:16:37.606800+0000","last_became_active":"2023-10-06T03:16:37.606545+0000","last_became_peered":"2023-10-06T03:16:37.606545+0000","last_unstale":"2023-10-06T03:16:37.606800+0000","last_undegraded":"2023-10-06T03:16:37.606800+0000","last_fullsized":"2023-10-06T03:16:37.606800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:42.138880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614871+0000","last_change":"2023-10-06T03:16:36.599798+0000","last_active":"2023-10-06T03:16:37.614871+0000","last_peered":"2023-10-06T03:16:37.614871+0000","last_clean":"2023-10-06T03:16:37.614871+0000","last_became_active":"2023-10-06T03:16:36.599519+0000","last_became_peered":"2023-10-06T03:16:36.599519+0000","last_unstale":"2023-10-06T03:16:37.614871+0000","last_undegraded":"2023-10-06T03:16:37.614871+0000","last_fullsized":"2023-10-06T03:16:37.614871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:45.491899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605870+0000","last_change":"2023-10-06T03:16:37.600312+0000","last_active":"2023-10-06T03:16:37.605870+0000","last_peered":"2023-10-06T03:16:37.605870+0000","last_clean":"2023-10-06T03:16:37.605870+0000","last_became_active":"2023-10-06T03:16:37.600017+0000","last_became_peered":"2023-10-06T03:16:37.600017+0000","last_unstale":"2023-10-06T03:16:37.605870+0000","last_undegraded":"2023-10-06T03:16:37.605870+0000","last_fullsized":"2023-10-06T03:16:37.605870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:29.168173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.607885+0000","last_change":"2023-10-06T03:16:36.593003+0000","last_active":"2023-10-06T03:16:37.607885+0000","last_peered":"2023-10-06T03:16:37.607885+0000","last_clean":"2023-10-06T03:16:37.607885+0000","last_became_active":"2023-10-06T03:16:36.592686+0000","last_became_peered":"2023-10-06T03:16:36.592686+0000","last_unstale":"2023-10-06T03:16:37.607885+0000","last_undegraded":"2023-10-06T03:16:37.607885+0000","last_fullsized":"2023-10-06T03:16:37.607885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:23.651906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601226+0000","last_change":"2023-10-06T03:16:37.601226+0000","last_active":"2023-10-06T03:16:37.601226+0000","last_peered":"2023-10-06T03:16:37.601226+0000","last_clean":"2023-10-06T03:16:37.601226+0000","last_became_active":"2023-10-06T03:16:37.600991+0000","last_became_peered":"2023-10-06T03:16:37.600991+0000","last_unstale":"2023-10-06T03:16:37.601226+0000","last_undegraded":"2023-10-06T03:16:37.601226+0000","last_fullsized":"2023-10-06T03:16:37.601226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:25.322353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613482+0000","last_change":"2023-10-06T03:16:36.605013+0000","last_active":"2023-10-06T03:16:37.613482+0000","last_peered":"2023-10-06T03:16:37.613482+0000","last_clean":"2023-10-06T03:16:37.613482+0000","last_became_active":"2023-10-06T03:16:36.604744+0000","last_became_peered":"2023-10-06T03:16:36.604744+0000","last_unstale":"2023-10-06T03:16:37.613482+0000","last_undegraded":"2023-10-06T03:16:37.613482+0000","last_fullsized":"2023-10-06T03:16:37.613482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:13.642996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600665+0000","last_change":"2023-10-06T03:16:37.596287+0000","last_active":"2023-10-06T03:16:37.600665+0000","last_peered":"2023-10-06T03:16:37.600665+0000","last_clean":"2023-10-06T03:16:37.600665+0000","last_became_active":"2023-10-06T03:16:37.596019+0000","last_became_peered":"2023-10-06T03:16:37.596019+0000","last_unstale":"2023-10-06T03:16:37.600665+0000","last_undegraded":"2023-10-06T03:16:37.600665+0000","last_fullsized":"2023-10-06T03:16:37.600665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:43.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613985+0000","last_change":"2023-10-06T03:16:36.597252+0000","last_active":"2023-10-06T03:16:37.613985+0000","last_peered":"2023-10-06T03:16:37.613985+0000","last_clean":"2023-10-06T03:16:37.613985+0000","last_became_active":"2023-10-06T03:16:36.596974+0000","last_became_peered":"2023-10-06T03:16:36.596974+0000","last_unstale":"2023-10-06T03:16:37.613985+0000","last_undegraded":"2023-10-06T03:16:37.613985+0000","last_fullsized":"2023-10-06T03:16:37.613985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:40.119077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601546+0000","last_change":"2023-10-06T03:16:37.595909+0000","last_active":"2023-10-06T03:16:37.601546+0000","last_peered":"2023-10-06T03:16:37.601546+0000","last_clean":"2023-10-06T03:16:37.601546+0000","last_became_active":"2023-10-06T03:16:37.595658+0000","last_became_peered":"2023-10-06T03:16:37.595658+0000","last_unstale":"2023-10-06T03:16:37.601546+0000","last_undegraded":"2023-10-06T03:16:37.601546+0000","last_fullsized":"2023-10-06T03:16:37.601546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:47.686372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613623+0000","last_change":"2023-10-06T03:16:36.598078+0000","last_active":"2023-10-06T03:16:37.613623+0000","last_peered":"2023-10-06T03:16:37.613623+0000","last_clean":"2023-10-06T03:16:37.613623+0000","last_became_active":"2023-10-06T03:16:36.597801+0000","last_became_peered":"2023-10-06T03:16:36.597801+0000","last_unstale":"2023-10-06T03:16:37.613623+0000","last_undegraded":"2023-10-06T03:16:37.613623+0000","last_fullsized":"2023-10-06T03:16:37.613623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.308093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601428+0000","last_change":"2023-10-06T03:16:37.598043+0000","last_active":"2023-10-06T03:16:37.601428+0000","last_peered":"2023-10-06T03:16:37.601428+0000","last_clean":"2023-10-06T03:16:37.601428+0000","last_became_active":"2023-10-06T03:16:37.597813+0000","last_became_peered":"2023-10-06T03:16:37.597813+0000","last_unstale":"2023-10-06T03:16:37.601428+0000","last_undegraded":"2023-10-06T03:16:37.601428+0000","last_fullsized":"2023-10-06T03:16:37.601428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:54.678016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.604128+0000","last_change":"2023-10-06T03:16:36.599282+0000","last_active":"2023-10-06T03:16:36.604128+0000","last_peered":"2023-10-06T03:16:36.604128+0000","last_clean":"2023-10-06T03:16:36.604128+0000","last_became_active":"2023-10-06T03:16:36.598679+0000","last_became_peered":"2023-10-06T03:16:36.598679+0000","last_unstale":"2023-10-06T03:16:36.604128+0000","last_undegraded":"2023-10-06T03:16:36.604128+0000","last_fullsized":"2023-10-06T03:16:36.604128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:26.175878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.607496+0000","last_change":"2023-10-06T03:16:37.607496+0000","last_active":"2023-10-06T03:16:37.607496+0000","last_peered":"2023-10-06T03:16:37.607496+0000","last_clean":"2023-10-06T03:16:37.607496+0000","last_became_active":"2023-10-06T03:16:37.607258+0000","last_became_peered":"2023-10-06T03:16:37.607258+0000","last_unstale":"2023-10-06T03:16:37.607496+0000","last_undegraded":"2023-10-06T03:16:37.607496+0000","last_fullsized":"2023-10-06T03:16:37.607496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:29.145161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589879+0000","last_change":"2023-10-06T03:16:36.592980+0000","last_active":"2023-10-06T03:16:37.589879+0000","last_peered":"2023-10-06T03:16:37.589879+0000","last_clean":"2023-10-06T03:16:37.589879+0000","last_became_active":"2023-10-06T03:16:36.592722+0000","last_became_peered":"2023-10-06T03:16:36.592722+0000","last_unstale":"2023-10-06T03:16:37.589879+0000","last_undegraded":"2023-10-06T03:16:37.589879+0000","last_fullsized":"2023-10-06T03:16:37.589879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:48.373403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602242+0000","last_change":"2023-10-06T03:16:37.597710+0000","last_active":"2023-10-06T03:16:37.602242+0000","last_peered":"2023-10-06T03:16:37.602242+0000","last_clean":"2023-10-06T03:16:37.602242+0000","last_became_active":"2023-10-06T03:16:37.597448+0000","last_became_peered":"2023-10-06T03:16:37.597448+0000","last_unstale":"2023-10-06T03:16:37.602242+0000","last_undegraded":"2023-10-06T03:16:37.602242+0000","last_fullsized":"2023-10-06T03:16:37.602242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:45.650720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.606767+0000","last_change":"2023-10-06T03:16:36.601293+0000","last_active":"2023-10-06T03:16:36.606767+0000","last_peered":"2023-10-06T03:16:36.606767+0000","last_clean":"2023-10-06T03:16:36.606767+0000","last_became_active":"2023-10-06T03:16:36.601046+0000","last_became_peered":"2023-10-06T03:16:36.601046+0000","last_unstale":"2023-10-06T03:16:36.606767+0000","last_undegraded":"2023-10-06T03:16:36.606767+0000","last_fullsized":"2023-10-06T03:16:36.606767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:26.445862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613362+0000","last_change":"2023-10-06T03:16:37.597737+0000","last_active":"2023-10-06T03:16:37.613362+0000","last_peered":"2023-10-06T03:16:37.613362+0000","last_clean":"2023-10-06T03:16:37.613362+0000","last_became_active":"2023-10-06T03:16:37.597468+0000","last_became_peered":"2023-10-06T03:16:37.597468+0000","last_unstale":"2023-10-06T03:16:37.613362+0000","last_undegraded":"2023-10-06T03:16:37.613362+0000","last_fullsized":"2023-10-06T03:16:37.613362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:20.748360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.587176+0000","last_change":"2023-10-06T03:16:36.597998+0000","last_active":"2023-10-06T03:16:37.587176+0000","last_peered":"2023-10-06T03:16:37.587176+0000","last_clean":"2023-10-06T03:16:37.587176+0000","last_became_active":"2023-10-06T03:16:36.597729+0000","last_became_peered":"2023-10-06T03:16:36.597729+0000","last_unstale":"2023-10-06T03:16:37.587176+0000","last_undegraded":"2023-10-06T03:16:37.587176+0000","last_fullsized":"2023-10-06T03:16:37.587176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:35.172904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600621+0000","last_change":"2023-10-06T03:16:37.596985+0000","last_active":"2023-10-06T03:16:37.600621+0000","last_peered":"2023-10-06T03:16:37.600621+0000","last_clean":"2023-10-06T03:16:37.600621+0000","last_became_active":"2023-10-06T03:16:37.596733+0000","last_became_peered":"2023-10-06T03:16:37.596733+0000","last_unstale":"2023-10-06T03:16:37.600621+0000","last_undegraded":"2023-10-06T03:16:37.600621+0000","last_fullsized":"2023-10-06T03:16:37.600621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.913463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.615772+0000","last_change":"2023-10-06T03:16:36.594703+0000","last_active":"2023-10-06T03:16:37.615772+0000","last_peered":"2023-10-06T03:16:37.615772+0000","last_clean":"2023-10-06T03:16:37.615772+0000","last_became_active":"2023-10-06T03:16:36.594382+0000","last_became_peered":"2023-10-06T03:16:36.594382+0000","last_unstale":"2023-10-06T03:16:37.615772+0000","last_undegraded":"2023-10-06T03:16:37.615772+0000","last_fullsized":"2023-10-06T03:16:37.615772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:43.319761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602630+0000","last_change":"2023-10-06T03:16:37.599404+0000","last_active":"2023-10-06T03:16:37.602630+0000","last_peered":"2023-10-06T03:16:37.602630+0000","last_clean":"2023-10-06T03:16:37.602630+0000","last_became_active":"2023-10-06T03:16:37.598982+0000","last_became_peered":"2023-10-06T03:16:37.598982+0000","last_unstale":"2023-10-06T03:16:37.602630+0000","last_undegraded":"2023-10-06T03:16:37.602630+0000","last_fullsized":"2023-10-06T03:16:37.602630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.913463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.615350+0000","last_change":"2023-10-06T03:16:36.604270+0000","last_active":"2023-10-06T03:16:37.615350+0000","last_peered":"2023-10-06T03:16:37.615350+0000","last_clean":"2023-10-06T03:16:37.615350+0000","last_became_active":"2023-10-06T03:16:36.604060+0000","last_became_peered":"2023-10-06T03:16:36.604060+0000","last_unstale":"2023-10-06T03:16:37.615350+0000","last_undegraded":"2023-10-06T03:16:37.615350+0000","last_fullsized":"2023-10-06T03:16:37.615350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:09.255469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.593336+0000","last_change":"2023-10-06T03:16:37.591571+0000","last_active":"2023-10-06T03:16:37.593336+0000","last_peered":"2023-10-06T03:16:37.593336+0000","last_clean":"2023-10-06T03:16:37.593336+0000","last_became_active":"2023-10-06T03:16:37.591284+0000","last_became_peered":"2023-10-06T03:16:37.591284+0000","last_unstale":"2023-10-06T03:16:37.593336+0000","last_undegraded":"2023-10-06T03:16:37.593336+0000","last_fullsized":"2023-10-06T03:16:37.593336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.361049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.609338+0000","last_change":"2023-10-06T03:16:36.604178+0000","last_active":"2023-10-06T03:16:37.609338+0000","last_peered":"2023-10-06T03:16:37.609338+0000","last_clean":"2023-10-06T03:16:37.609338+0000","last_became_active":"2023-10-06T03:16:36.603978+0000","last_became_peered":"2023-10-06T03:16:36.603978+0000","last_unstale":"2023-10-06T03:16:37.609338+0000","last_undegraded":"2023-10-06T03:16:37.609338+0000","last_fullsized":"2023-10-06T03:16:37.609338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:31.404294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.595439+0000","last_change":"2023-10-06T03:16:37.595439+0000","last_active":"2023-10-06T03:16:37.595439+0000","last_peered":"2023-10-06T03:16:37.595439+0000","last_clean":"2023-10-06T03:16:37.595439+0000","last_became_active":"2023-10-06T03:16:37.594879+0000","last_became_peered":"2023-10-06T03:16:37.594879+0000","last_unstale":"2023-10-06T03:16:37.595439+0000","last_undegraded":"2023-10-06T03:16:37.595439+0000","last_fullsized":"2023-10-06T03:16:37.595439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:37.168785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.604101+0000","last_change":"2023-10-06T03:16:36.599110+0000","last_active":"2023-10-06T03:16:36.604101+0000","last_peered":"2023-10-06T03:16:36.604101+0000","last_clean":"2023-10-06T03:16:36.604101+0000","last_became_active":"2023-10-06T03:16:36.598669+0000","last_became_peered":"2023-10-06T03:16:36.598669+0000","last_unstale":"2023-10-06T03:16:36.604101+0000","last_undegraded":"2023-10-06T03:16:36.604101+0000","last_fullsized":"2023-10-06T03:16:36.604101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:09.501526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613982+0000","last_change":"2023-10-06T03:16:37.606269+0000","last_active":"2023-10-06T03:16:37.613982+0000","last_peered":"2023-10-06T03:16:37.613982+0000","last_clean":"2023-10-06T03:16:37.613982+0000","last_became_active":"2023-10-06T03:16:37.605995+0000","last_became_peered":"2023-10-06T03:16:37.605995+0000","last_unstale":"2023-10-06T03:16:37.613982+0000","last_undegraded":"2023-10-06T03:16:37.613982+0000","last_fullsized":"2023-10-06T03:16:37.613982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:43.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.604251+0000","last_change":"2023-10-06T03:16:36.598871+0000","last_active":"2023-10-06T03:16:36.604251+0000","last_peered":"2023-10-06T03:16:36.604251+0000","last_clean":"2023-10-06T03:16:36.604251+0000","last_became_active":"2023-10-06T03:16:36.598601+0000","last_became_peered":"2023-10-06T03:16:36.598601+0000","last_unstale":"2023-10-06T03:16:36.604251+0000","last_undegraded":"2023-10-06T03:16:36.604251+0000","last_fullsized":"2023-10-06T03:16:36.604251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:12.733826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.597230+0000","last_change":"2023-10-06T03:16:37.597230+0000","last_active":"2023-10-06T03:16:37.597230+0000","last_peered":"2023-10-06T03:16:37.597230+0000","last_clean":"2023-10-06T03:16:37.597230+0000","last_became_active":"2023-10-06T03:16:37.596987+0000","last_became_peered":"2023-10-06T03:16:37.596987+0000","last_unstale":"2023-10-06T03:16:37.597230+0000","last_undegraded":"2023-10-06T03:16:37.597230+0000","last_fullsized":"2023-10-06T03:16:37.597230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:28.972124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614557+0000","last_change":"2023-10-06T03:16:36.600369+0000","last_active":"2023-10-06T03:16:37.614557+0000","last_peered":"2023-10-06T03:16:37.614557+0000","last_clean":"2023-10-06T03:16:37.614557+0000","last_became_active":"2023-10-06T03:16:36.600045+0000","last_became_peered":"2023-10-06T03:16:36.600045+0000","last_unstale":"2023-10-06T03:16:37.614557+0000","last_undegraded":"2023-10-06T03:16:37.614557+0000","last_fullsized":"2023-10-06T03:16:37.614557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:35.172904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605737+0000","last_change":"2023-10-06T03:16:37.605737+0000","last_active":"2023-10-06T03:16:37.605737+0000","last_peered":"2023-10-06T03:16:37.605737+0000","last_clean":"2023-10-06T03:16:37.605737+0000","last_became_active":"2023-10-06T03:16:37.605495+0000","last_became_peered":"2023-10-06T03:16:37.605495+0000","last_unstale":"2023-10-06T03:16:37.605737+0000","last_undegraded":"2023-10-06T03:16:37.605737+0000","last_fullsized":"2023-10-06T03:16:37.605737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:26.370414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614995+0000","last_change":"2023-10-06T03:16:36.598971+0000","last_active":"2023-10-06T03:16:37.614995+0000","last_peered":"2023-10-06T03:16:37.614995+0000","last_clean":"2023-10-06T03:16:37.614995+0000","last_became_active":"2023-10-06T03:16:36.598728+0000","last_became_peered":"2023-10-06T03:16:36.598728+0000","last_unstale":"2023-10-06T03:16:37.614995+0000","last_undegraded":"2023-10-06T03:16:37.614995+0000","last_fullsized":"2023-10-06T03:16:37.614995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:44.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.608833+0000","last_change":"2023-10-06T03:16:37.603499+0000","last_active":"2023-10-06T03:16:37.608833+0000","last_peered":"2023-10-06T03:16:37.608833+0000","last_clean":"2023-10-06T03:16:37.608833+0000","last_became_active":"2023-10-06T03:16:37.603032+0000","last_became_peered":"2023-10-06T03:16:37.603032+0000","last_unstale":"2023-10-06T03:16:37.608833+0000","last_undegraded":"2023-10-06T03:16:37.608833+0000","last_fullsized":"2023-10-06T03:16:37.608833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.913463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.612575+0000","last_change":"2023-10-06T03:16:36.597449+0000","last_active":"2023-10-06T03:16:37.612575+0000","last_peered":"2023-10-06T03:16:37.612575+0000","last_clean":"2023-10-06T03:16:37.612575+0000","last_became_active":"2023-10-06T03:16:36.597199+0000","last_became_peered":"2023-10-06T03:16:36.597199+0000","last_unstale":"2023-10-06T03:16:37.612575+0000","last_undegraded":"2023-10-06T03:16:37.612575+0000","last_fullsized":"2023-10-06T03:16:37.612575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:36.412042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601559+0000","last_change":"2023-10-06T03:16:37.598001+0000","last_active":"2023-10-06T03:16:37.601559+0000","last_peered":"2023-10-06T03:16:37.601559+0000","last_clean":"2023-10-06T03:16:37.601559+0000","last_became_active":"2023-10-06T03:16:37.596864+0000","last_became_peered":"2023-10-06T03:16:37.596864+0000","last_unstale":"2023-10-06T03:16:37.601559+0000","last_undegraded":"2023-10-06T03:16:37.601559+0000","last_fullsized":"2023-10-06T03:16:37.601559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:35.766427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614583+0000","last_change":"2023-10-06T03:16:36.599579+0000","last_active":"2023-10-06T03:16:37.614583+0000","last_peered":"2023-10-06T03:16:37.614583+0000","last_clean":"2023-10-06T03:16:37.614583+0000","last_became_active":"2023-10-06T03:16:36.599299+0000","last_became_peered":"2023-10-06T03:16:36.599299+0000","last_unstale":"2023-10-06T03:16:37.614583+0000","last_undegraded":"2023-10-06T03:16:37.614583+0000","last_fullsized":"2023-10-06T03:16:37.614583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:57.189332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601303+0000","last_change":"2023-10-06T03:16:37.598904+0000","last_active":"2023-10-06T03:16:37.601303+0000","last_peered":"2023-10-06T03:16:37.601303+0000","last_clean":"2023-10-06T03:16:37.601303+0000","last_became_active":"2023-10-06T03:16:37.598620+0000","last_became_peered":"2023-10-06T03:16:37.598620+0000","last_unstale":"2023-10-06T03:16:37.601303+0000","last_undegraded":"2023-10-06T03:16:37.601303+0000","last_fullsized":"2023-10-06T03:16:37.601303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:48.312529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.604054+0000","last_change":"2023-10-06T03:16:36.597293+0000","last_active":"2023-10-06T03:16:36.604054+0000","last_peered":"2023-10-06T03:16:36.604054+0000","last_clean":"2023-10-06T03:16:36.604054+0000","last_became_active":"2023-10-06T03:16:36.597048+0000","last_became_peered":"2023-10-06T03:16:36.597048+0000","last_unstale":"2023-10-06T03:16:36.604054+0000","last_undegraded":"2023-10-06T03:16:36.604054+0000","last_fullsized":"2023-10-06T03:16:36.604054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:44.980760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614315+0000","last_change":"2023-10-06T03:16:37.606154+0000","last_active":"2023-10-06T03:16:37.614315+0000","last_peered":"2023-10-06T03:16:37.614315+0000","last_clean":"2023-10-06T03:16:37.614315+0000","last_became_active":"2023-10-06T03:16:37.605906+0000","last_became_peered":"2023-10-06T03:16:37.605906+0000","last_unstale":"2023-10-06T03:16:37.614315+0000","last_undegraded":"2023-10-06T03:16:37.614315+0000","last_fullsized":"2023-10-06T03:16:37.614315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:23.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.608059+0000","last_change":"2023-10-06T03:16:36.597288+0000","last_active":"2023-10-06T03:16:37.608059+0000","last_peered":"2023-10-06T03:16:37.608059+0000","last_clean":"2023-10-06T03:16:37.608059+0000","last_became_active":"2023-10-06T03:16:36.597026+0000","last_became_peered":"2023-10-06T03:16:36.597026+0000","last_unstale":"2023-10-06T03:16:37.608059+0000","last_undegraded":"2023-10-06T03:16:37.608059+0000","last_fullsized":"2023-10-06T03:16:37.608059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:55.930244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600655+0000","last_change":"2023-10-06T03:16:37.597010+0000","last_active":"2023-10-06T03:16:37.600655+0000","last_peered":"2023-10-06T03:16:37.600655+0000","last_clean":"2023-10-06T03:16:37.600655+0000","last_became_active":"2023-10-06T03:16:37.596759+0000","last_became_peered":"2023-10-06T03:16:37.596759+0000","last_unstale":"2023-10-06T03:16:37.600655+0000","last_undegraded":"2023-10-06T03:16:37.600655+0000","last_fullsized":"2023-10-06T03:16:37.600655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:20.748360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589570+0000","last_change":"2023-10-06T03:16:36.597896+0000","last_active":"2023-10-06T03:16:37.589570+0000","last_peered":"2023-10-06T03:16:37.589570+0000","last_clean":"2023-10-06T03:16:37.589570+0000","last_became_active":"2023-10-06T03:16:36.597652+0000","last_became_peered":"2023-10-06T03:16:36.597652+0000","last_unstale":"2023-10-06T03:16:37.589570+0000","last_undegraded":"2023-10-06T03:16:37.589570+0000","last_fullsized":"2023-10-06T03:16:37.589570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:11.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.610349+0000","last_change":"2023-10-06T03:16:37.607443+0000","last_active":"2023-10-06T03:16:37.610349+0000","last_peered":"2023-10-06T03:16:37.610349+0000","last_clean":"2023-10-06T03:16:37.610349+0000","last_became_active":"2023-10-06T03:16:37.607200+0000","last_became_peered":"2023-10-06T03:16:37.607200+0000","last_unstale":"2023-10-06T03:16:37.610349+0000","last_undegraded":"2023-10-06T03:16:37.610349+0000","last_fullsized":"2023-10-06T03:16:37.610349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:43.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589196+0000","last_change":"2023-10-06T03:16:36.601435+0000","last_active":"2023-10-06T03:16:37.589196+0000","last_peered":"2023-10-06T03:16:37.589196+0000","last_clean":"2023-10-06T03:16:37.589196+0000","last_became_active":"2023-10-06T03:16:36.600979+0000","last_became_peered":"2023-10-06T03:16:36.600979+0000","last_unstale":"2023-10-06T03:16:37.589196+0000","last_undegraded":"2023-10-06T03:16:37.589196+0000","last_fullsized":"2023-10-06T03:16:37.589196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:40.119077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.607580+0000","last_change":"2023-10-06T03:16:37.607580+0000","last_active":"2023-10-06T03:16:37.607580+0000","last_peered":"2023-10-06T03:16:37.607580+0000","last_clean":"2023-10-06T03:16:37.607580+0000","last_became_active":"2023-10-06T03:16:37.607295+0000","last_became_peered":"2023-10-06T03:16:37.607295+0000","last_unstale":"2023-10-06T03:16:37.607580+0000","last_undegraded":"2023-10-06T03:16:37.607580+0000","last_fullsized":"2023-10-06T03:16:37.607580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:29.168173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589963+0000","last_change":"2023-10-06T03:16:36.591569+0000","last_active":"2023-10-06T03:16:37.589963+0000","last_peered":"2023-10-06T03:16:37.589963+0000","last_clean":"2023-10-06T03:16:37.589963+0000","last_became_active":"2023-10-06T03:16:36.591282+0000","last_became_peered":"2023-10-06T03:16:36.591282+0000","last_unstale":"2023-10-06T03:16:37.589963+0000","last_undegraded":"2023-10-06T03:16:37.589963+0000","last_fullsized":"2023-10-06T03:16:37.589963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:26.073879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605801+0000","last_change":"2023-10-06T03:16:37.601096+0000","last_active":"2023-10-06T03:16:37.605801+0000","last_peered":"2023-10-06T03:16:37.605801+0000","last_clean":"2023-10-06T03:16:37.605801+0000","last_became_active":"2023-10-06T03:16:37.600367+0000","last_became_peered":"2023-10-06T03:16:37.600367+0000","last_unstale":"2023-10-06T03:16:37.605801+0000","last_undegraded":"2023-10-06T03:16:37.605801+0000","last_fullsized":"2023-10-06T03:16:37.605801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:26.370414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589410+0000","last_change":"2023-10-06T03:16:36.595689+0000","last_active":"2023-10-06T03:16:37.589410+0000","last_peered":"2023-10-06T03:16:37.589410+0000","last_clean":"2023-10-06T03:16:37.589410+0000","last_became_active":"2023-10-06T03:16:36.595407+0000","last_became_peered":"2023-10-06T03:16:36.595407+0000","last_unstale":"2023-10-06T03:16:37.589410+0000","last_undegraded":"2023-10-06T03:16:37.589410+0000","last_fullsized":"2023-10-06T03:16:37.589410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:31.721608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589695+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:16:37.589695+0000","last_peered":"2023-10-06T03:16:37.589695+0000","last_clean":"2023-10-06T03:16:37.589695+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:16:37.589695+0000","last_undegraded":"2023-10-06T03:16:37.589695+0000","last_fullsized":"2023-10-06T03:16:37.589695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613401+0000","last_change":"2023-10-06T03:16:37.597937+0000","last_active":"2023-10-06T03:16:37.613401+0000","last_peered":"2023-10-06T03:16:37.613401+0000","last_clean":"2023-10-06T03:16:37.613401+0000","last_became_active":"2023-10-06T03:16:37.597725+0000","last_became_peered":"2023-10-06T03:16:37.597725+0000","last_unstale":"2023-10-06T03:16:37.613401+0000","last_undegraded":"2023-10-06T03:16:37.613401+0000","last_fullsized":"2023-10-06T03:16:37.613401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:35.766427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.596867+0000","last_change":"2023-10-06T03:16:36.593239+0000","last_active":"2023-10-06T03:16:36.596867+0000","last_peered":"2023-10-06T03:16:36.596867+0000","last_clean":"2023-10-06T03:16:36.596867+0000","last_became_active":"2023-10-06T03:16:36.591766+0000","last_became_peered":"2023-10-06T03:16:36.591766+0000","last_unstale":"2023-10-06T03:16:36.596867+0000","last_undegraded":"2023-10-06T03:16:36.596867+0000","last_fullsized":"2023-10-06T03:16:36.596867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:41.134445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.594842+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:16:36.594842+0000","last_peered":"2023-10-06T03:16:36.594842+0000","last_clean":"2023-10-06T03:16:36.594842+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:16:36.594842+0000","last_undegraded":"2023-10-06T03:16:36.594842+0000","last_fullsized":"2023-10-06T03:16:36.594842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.604904+0000","last_change":"2023-10-06T03:16:37.604904+0000","last_active":"2023-10-06T03:16:37.604904+0000","last_peered":"2023-10-06T03:16:37.604904+0000","last_clean":"2023-10-06T03:16:37.604904+0000","last_became_active":"2023-10-06T03:16:37.604682+0000","last_became_peered":"2023-10-06T03:16:37.604682+0000","last_unstale":"2023-10-06T03:16:37.604904+0000","last_undegraded":"2023-10-06T03:16:37.604904+0000","last_fullsized":"2023-10-06T03:16:37.604904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:06.918970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.615664+0000","last_change":"2023-10-06T03:16:36.601467+0000","last_active":"2023-10-06T03:16:37.615664+0000","last_peered":"2023-10-06T03:16:37.615664+0000","last_clean":"2023-10-06T03:16:37.615664+0000","last_became_active":"2023-10-06T03:16:36.601193+0000","last_became_peered":"2023-10-06T03:16:36.601193+0000","last_unstale":"2023-10-06T03:16:37.615664+0000","last_undegraded":"2023-10-06T03:16:37.615664+0000","last_fullsized":"2023-10-06T03:16:37.615664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.308093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.586388+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:16:36.586388+0000","last_peered":"2023-10-06T03:16:36.586388+0000","last_clean":"2023-10-06T03:16:36.586388+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:16:36.586388+0000","last_undegraded":"2023-10-06T03:16:36.586388+0000","last_fullsized":"2023-10-06T03:16:36.586388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.588640+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:16:37.588640+0000","last_peered":"2023-10-06T03:16:37.588640+0000","last_clean":"2023-10-06T03:16:37.588640+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:16:37.588640+0000","last_undegraded":"2023-10-06T03:16:37.588640+0000","last_fullsized":"2023-10-06T03:16:37.588640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613614+0000","last_change":"2023-10-06T03:16:37.600184+0000","last_active":"2023-10-06T03:16:37.613614+0000","last_peered":"2023-10-06T03:16:37.613614+0000","last_clean":"2023-10-06T03:16:37.613614+0000","last_became_active":"2023-10-06T03:16:37.599869+0000","last_became_peered":"2023-10-06T03:16:37.599869+0000","last_unstale":"2023-10-06T03:16:37.613614+0000","last_undegraded":"2023-10-06T03:16:37.613614+0000","last_fullsized":"2023-10-06T03:16:37.613614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.913463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.591260+0000","last_change":"2023-10-06T03:16:36.597512+0000","last_active":"2023-10-06T03:16:37.591260+0000","last_peered":"2023-10-06T03:16:37.591260+0000","last_clean":"2023-10-06T03:16:37.591260+0000","last_became_active":"2023-10-06T03:16:36.597273+0000","last_became_peered":"2023-10-06T03:16:36.597273+0000","last_unstale":"2023-10-06T03:16:37.591260+0000","last_undegraded":"2023-10-06T03:16:37.591260+0000","last_fullsized":"2023-10-06T03:16:37.591260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:46.993350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.590330+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:16:37.590330+0000","last_peered":"2023-10-06T03:16:37.590330+0000","last_clean":"2023-10-06T03:16:37.590330+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:16:37.590330+0000","last_undegraded":"2023-10-06T03:16:37.590330+0000","last_fullsized":"2023-10-06T03:16:37.590330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.610920+0000","last_change":"2023-10-06T03:16:37.607733+0000","last_active":"2023-10-06T03:16:37.610920+0000","last_peered":"2023-10-06T03:16:37.610920+0000","last_clean":"2023-10-06T03:16:37.610920+0000","last_became_active":"2023-10-06T03:16:37.604271+0000","last_became_peered":"2023-10-06T03:16:37.604271+0000","last_unstale":"2023-10-06T03:16:37.610920+0000","last_undegraded":"2023-10-06T03:16:37.610920+0000","last_fullsized":"2023-10-06T03:16:37.610920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:35.766427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589091+0000","last_change":"2023-10-06T03:16:36.601211+0000","last_active":"2023-10-06T03:16:37.589091+0000","last_peered":"2023-10-06T03:16:37.589091+0000","last_clean":"2023-10-06T03:16:37.589091+0000","last_became_active":"2023-10-06T03:16:36.600932+0000","last_became_peered":"2023-10-06T03:16:36.600932+0000","last_unstale":"2023-10-06T03:16:37.589091+0000","last_undegraded":"2023-10-06T03:16:37.589091+0000","last_fullsized":"2023-10-06T03:16:37.589091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:43.319761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.588536+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:16:37.588536+0000","last_peered":"2023-10-06T03:16:37.588536+0000","last_clean":"2023-10-06T03:16:37.588536+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:16:37.588536+0000","last_undegraded":"2023-10-06T03:16:37.588536+0000","last_fullsized":"2023-10-06T03:16:37.588536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.595439+0000","last_change":"2023-10-06T03:16:37.595439+0000","last_active":"2023-10-06T03:16:37.595439+0000","last_peered":"2023-10-06T03:16:37.595439+0000","last_clean":"2023-10-06T03:16:37.595439+0000","last_became_active":"2023-10-06T03:16:37.595193+0000","last_became_peered":"2023-10-06T03:16:37.595193+0000","last_unstale":"2023-10-06T03:16:37.595439+0000","last_undegraded":"2023-10-06T03:16:37.595439+0000","last_fullsized":"2023-10-06T03:16:37.595439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:43.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.584958+0000","last_change":"2023-10-06T03:16:36.601238+0000","last_active":"2023-10-06T03:16:37.584958+0000","last_peered":"2023-10-06T03:16:37.584958+0000","last_clean":"2023-10-06T03:16:37.584958+0000","last_became_active":"2023-10-06T03:16:36.600956+0000","last_became_peered":"2023-10-06T03:16:36.600956+0000","last_unstale":"2023-10-06T03:16:37.584958+0000","last_undegraded":"2023-10-06T03:16:37.584958+0000","last_fullsized":"2023-10-06T03:16:37.584958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:43.319761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.587067+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:16:37.587067+0000","last_peered":"2023-10-06T03:16:37.587067+0000","last_clean":"2023-10-06T03:16:37.587067+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:16:37.587067+0000","last_undegraded":"2023-10-06T03:16:37.587067+0000","last_fullsized":"2023-10-06T03:16:37.587067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.597620+0000","last_change":"2023-10-06T03:16:37.597620+0000","last_active":"2023-10-06T03:16:37.597620+0000","last_peered":"2023-10-06T03:16:37.597620+0000","last_clean":"2023-10-06T03:16:37.597620+0000","last_became_active":"2023-10-06T03:16:37.597400+0000","last_became_peered":"2023-10-06T03:16:37.597400+0000","last_unstale":"2023-10-06T03:16:37.597620+0000","last_undegraded":"2023-10-06T03:16:37.597620+0000","last_fullsized":"2023-10-06T03:16:37.597620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:46.496334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.600000+0000","last_change":"2023-10-06T03:16:36.596796+0000","last_active":"2023-10-06T03:16:36.600000+0000","last_peered":"2023-10-06T03:16:36.600000+0000","last_clean":"2023-10-06T03:16:36.600000+0000","last_became_active":"2023-10-06T03:16:36.596529+0000","last_became_peered":"2023-10-06T03:16:36.596529+0000","last_unstale":"2023-10-06T03:16:36.600000+0000","last_undegraded":"2023-10-06T03:16:36.600000+0000","last_fullsized":"2023-10-06T03:16:36.600000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:44.980760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.593517+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:16:36.593517+0000","last_peered":"2023-10-06T03:16:36.593517+0000","last_clean":"2023-10-06T03:16:36.593517+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:16:36.593517+0000","last_undegraded":"2023-10-06T03:16:36.593517+0000","last_fullsized":"2023-10-06T03:16:36.593517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600701+0000","last_change":"2023-10-06T03:16:37.598828+0000","last_active":"2023-10-06T03:16:37.600701+0000","last_peered":"2023-10-06T03:16:37.600701+0000","last_clean":"2023-10-06T03:16:37.600701+0000","last_became_active":"2023-10-06T03:16:37.598573+0000","last_became_peered":"2023-10-06T03:16:37.598573+0000","last_unstale":"2023-10-06T03:16:37.600701+0000","last_undegraded":"2023-10-06T03:16:37.600701+0000","last_fullsized":"2023-10-06T03:16:37.600701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:47.686372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.585328+0000","last_change":"2023-10-06T03:16:36.598981+0000","last_active":"2023-10-06T03:16:37.585328+0000","last_peered":"2023-10-06T03:16:37.585328+0000","last_clean":"2023-10-06T03:16:37.585328+0000","last_became_active":"2023-10-06T03:16:36.598734+0000","last_became_peered":"2023-10-06T03:16:36.598734+0000","last_unstale":"2023-10-06T03:16:37.585328+0000","last_undegraded":"2023-10-06T03:16:37.585328+0000","last_fullsized":"2023-10-06T03:16:37.585328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:51.519145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.593558+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:16:36.593558+0000","last_peered":"2023-10-06T03:16:36.593558+0000","last_clean":"2023-10-06T03:16:36.593558+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:16:36.593558+0000","last_undegraded":"2023-10-06T03:16:36.593558+0000","last_fullsized":"2023-10-06T03:16:36.593558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":725115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":133695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.185}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":133211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":134711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:16:41.645 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:16:41.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.793+0000 7f6c46e62700 1 Processor -- start 2023-10-06T03:16:41.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.793+0000 7f6c46e62700 1 -- start start 2023-10-06T03:16:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c46e62700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c400add70 0x7f6c400ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c46e62700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c401580d0 con 0x7f6c400b4060 2023-10-06T03:16:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c46e62700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c400ae6d0 con 0x7f6c40157570 2023-10-06T03:16:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c46e62700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c40158c70 con 0x7f6c400add70 2023-10-06T03:16:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c453ff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c400add70 0x7f6c400ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c3ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6c400b4060 0x7f6c40158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41712/0 (socket says 172.21.15.82:41712) 2023-10-06T03:16:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c3ffff700 1 -- 172.21.15.82:0/1807265098 learned_addr learned my addr 172.21.15.82:0/1807265098 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c453ff700 1 -- 172.21.15.82:0/1807265098 >> v1:172.21.15.134:6789/0 conn(0x7f6c40157570 legacy=0x7f6c4015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c453ff700 1 -- 172.21.15.82:0/1807265098 >> v1:172.21.15.82:6789/0 conn(0x7f6c400b4060 legacy=0x7f6c40158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c453ff700 1 -- 172.21.15.82:0/1807265098 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4015ba40 con 0x7f6c400add70 2023-10-06T03:16:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c3f7fe700 1 -- 172.21.15.82:0/1807265098 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100912812 0 0) 0x7f6c401580d0 con 0x7f6c400b4060 2023-10-06T03:16:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c453ff700 1 --2- 172.21.15.82:0/1807265098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400add70 0x7f6c400ae190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009e60 tx=0x7f6c38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e90060908b8fc40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c3f7fe700 1 -- 172.21.15.82:0/1807265098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800e070 con 0x7f6c400add70 2023-10-06T03:16:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c3f7fe700 1 -- 172.21.15.82:0/1807265098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3800bc30 con 0x7f6c400add70 2023-10-06T03:16:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.794+0000 7f6c3f7fe700 1 -- 172.21.15.82:0/1807265098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38012430 con 0x7f6c400add70 2023-10-06T03:16:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.795+0000 7f6c46e62700 1 -- 172.21.15.82:0/1807265098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400add70 msgr2=0x7f6c400ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.795+0000 7f6c46e62700 1 --2- 172.21.15.82:0/1807265098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400add70 0x7f6c400ae190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009e60 tx=0x7f6c38009780 comp rx=0 tx=0).stop 2023-10-06T03:16:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.795+0000 7f6c46e62700 1 -- 172.21.15.82:0/1807265098 shutdown_connections 2023-10-06T03:16:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.795+0000 7f6c46e62700 1 --2- 172.21.15.82:0/1807265098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400add70 0x7f6c400ae190 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.795+0000 7f6c46e62700 1 -- 172.21.15.82:0/1807265098 >> 172.21.15.82:0/1807265098 conn(0x7f6c40067630 msgr2=0x7f6c40067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.795+0000 7f6c46e62700 1 -- 172.21.15.82:0/1807265098 shutdown_connections 2023-10-06T03:16:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.795+0000 7f6c46e62700 1 -- 172.21.15.82:0/1807265098 wait complete. 2023-10-06T03:16:41.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.796+0000 7f6c46e62700 1 Processor -- start 2023-10-06T03:16:41.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.796+0000 7f6c46e62700 1 -- start start 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c46e62700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c400add70 0x7f6c40155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c46e62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400b4060 0x7f6c400c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c46e62700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c40157570 0x7f6c40154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c46e62700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40159bd0 con 0x7f6c400b4060 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c46e62700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c400c9bc0 con 0x7f6c40157570 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c46e62700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c400c9ea0 con 0x7f6c400add70 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400b4060 0x7f6c400c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400b4060 0x7f6c400c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52888/0 (socket says 172.21.15.82:52888) 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 -- 172.21.15.82:0/188235093 learned_addr learned my addr 172.21.15.82:0/188235093 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c44bfe700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c400add70 0x7f6c40155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c453ff700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c40157570 0x7f6c40154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 -- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c400add70 msgr2=0x7f6c40155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c400add70 0x7f6c40155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 -- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c40157570 msgr2=0x7f6c40154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c40157570 0x7f6c40154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 -- 172.21.15.82:0/188235093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38009a20 con 0x7f6c400b4060 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c44bfe700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c400add70 0x7f6c40155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3ffff700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400b4060 0x7f6c400c54b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c7e0 tx=0x7f6c28007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3cff9700 1 -- 172.21.15.82:0/188235093 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28005b30 con 0x7f6c400b4060 2023-10-06T03:16:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3cff9700 1 -- 172.21.15.82:0/188235093 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28005c90 con 0x7f6c400b4060 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c3cff9700 1 -- 172.21.15.82:0/188235093 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28007300 con 0x7f6c400b4060 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.797+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c400ca180 con 0x7f6c400b4060 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.798+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c400c59f0 con 0x7f6c400b4060 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.798+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c40064050 con 0x7f6c400b4060 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.799+0000 7f6c3cff9700 1 -- 172.21.15.82:0/188235093 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c2801b400 con 0x7f6c400b4060 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.799+0000 7f6c3cff9700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6c20066f30 0x7f6c200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.799+0000 7f6c3cff9700 1 -- 172.21.15.82:0/188235093 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6c280841f0 con 0x7f6c400b4060 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.800+0000 7f6c44bfe700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6c20066f30 0x7f6c200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.800+0000 7f6c44bfe700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6c20066f30 0x7f6c200693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c30006fd0 tx=0x7f6c30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:41.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.804+0000 7f6c3cff9700 1 -- 172.21.15.82:0/188235093 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c28051300 con 0x7f6c400b4060 2023-10-06T03:16:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.982+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c400cdf50 con 0x7f6c20066f30 2023-10-06T03:16:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.991+0000 7f6c3cff9700 1 -- 172.21.15.82:0/188235093 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286880 (secure 0 0 0) 0x7f6c400cdf50 con 0x7f6c20066f30 2023-10-06T03:16:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.993+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6c20066f30 msgr2=0x7f6c200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.993+0000 7f6c46e62700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6c20066f30 0x7f6c200693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c30006fd0 tx=0x7f6c30008040 comp rx=0 tx=0).stop 2023-10-06T03:16:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400b4060 msgr2=0x7f6c400c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400b4060 0x7f6c400c54b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c7e0 tx=0x7f6c28007df0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 shutdown_connections 2023-10-06T03:16:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c40157570 0x7f6c40154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6c20066f30 0x7f6c200693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c400add70 0x7f6c40155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 --2- 172.21.15.82:0/188235093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400b4060 0x7f6c400c54b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:41.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 >> 172.21.15.82:0/188235093 conn(0x7f6c40067630 msgr2=0x7f6c4006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:41.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 shutdown_connections 2023-10-06T03:16:41.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:41.994+0000 7f6c46e62700 1 -- 172.21.15.82:0/188235093 wait complete. 2023-10-06T03:16:41.999 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:16:42.007 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-06T03:16:41.160241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382168,"kb_used_data":3864,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592552,"statfs":{"total":773094113280,"available":770654773248,"internally_reserved":0,"allocated":3956736,"data_stored":2274458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.583678"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.598184+0000","last_change":"2023-10-06T03:16:37.598184+0000","last_active":"2023-10-06T03:16:37.598184+0000","last_peered":"2023-10-06T03:16:37.598184+0000","last_clean":"2023-10-06T03:16:37.598184+0000","last_became_active":"2023-10-06T03:16:37.597830+0000","last_became_peered":"2023-10-06T03:16:37.597830+0000","last_unstale":"2023-10-06T03:16:37.598184+0000","last_undegraded":"2023-10-06T03:16:37.598184+0000","last_fullsized":"2023-10-06T03:16:37.598184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:35.766427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600019+0000","last_change":"2023-10-06T03:16:37.600019+0000","last_active":"2023-10-06T03:16:37.600019+0000","last_peered":"2023-10-06T03:16:37.600019+0000","last_clean":"2023-10-06T03:16:37.600019+0000","last_became_active":"2023-10-06T03:16:37.599712+0000","last_became_peered":"2023-10-06T03:16:37.599712+0000","last_unstale":"2023-10-06T03:16:37.600019+0000","last_undegraded":"2023-10-06T03:16:37.600019+0000","last_fullsized":"2023-10-06T03:16:37.600019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:38.046558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601170+0000","last_change":"2023-10-06T03:16:37.597760+0000","last_active":"2023-10-06T03:16:37.601170+0000","last_peered":"2023-10-06T03:16:37.601170+0000","last_clean":"2023-10-06T03:16:37.601170+0000","last_became_active":"2023-10-06T03:16:37.597510+0000","last_became_peered":"2023-10-06T03:16:37.597510+0000","last_unstale":"2023-10-06T03:16:37.601170+0000","last_undegraded":"2023-10-06T03:16:37.601170+0000","last_fullsized":"2023-10-06T03:16:37.601170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:23.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602258+0000","last_change":"2023-10-06T03:16:37.597743+0000","last_active":"2023-10-06T03:16:37.602258+0000","last_peered":"2023-10-06T03:16:37.602258+0000","last_clean":"2023-10-06T03:16:37.602258+0000","last_became_active":"2023-10-06T03:16:37.597494+0000","last_became_peered":"2023-10-06T03:16:37.597494+0000","last_unstale":"2023-10-06T03:16:37.602258+0000","last_undegraded":"2023-10-06T03:16:37.602258+0000","last_fullsized":"2023-10-06T03:16:37.602258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:41.123513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605327+0000","last_change":"2023-10-06T03:16:37.602820+0000","last_active":"2023-10-06T03:16:37.605327+0000","last_peered":"2023-10-06T03:16:37.605327+0000","last_clean":"2023-10-06T03:16:37.605327+0000","last_became_active":"2023-10-06T03:16:37.602519+0000","last_became_peered":"2023-10-06T03:16:37.602519+0000","last_unstale":"2023-10-06T03:16:37.605327+0000","last_undegraded":"2023-10-06T03:16:37.605327+0000","last_fullsized":"2023-10-06T03:16:37.605327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:39.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.597927+0000","last_change":"2023-10-06T03:16:37.597927+0000","last_active":"2023-10-06T03:16:37.597927+0000","last_peered":"2023-10-06T03:16:37.597927+0000","last_clean":"2023-10-06T03:16:37.597927+0000","last_became_active":"2023-10-06T03:16:37.597676+0000","last_became_peered":"2023-10-06T03:16:37.597676+0000","last_unstale":"2023-10-06T03:16:37.597927+0000","last_undegraded":"2023-10-06T03:16:37.597927+0000","last_fullsized":"2023-10-06T03:16:37.597927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:52.523580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601525+0000","last_change":"2023-10-06T03:16:37.595405+0000","last_active":"2023-10-06T03:16:37.601525+0000","last_peered":"2023-10-06T03:16:37.601525+0000","last_clean":"2023-10-06T03:16:37.601525+0000","last_became_active":"2023-10-06T03:16:37.595111+0000","last_became_peered":"2023-10-06T03:16:37.595111+0000","last_unstale":"2023-10-06T03:16:37.601525+0000","last_undegraded":"2023-10-06T03:16:37.601525+0000","last_fullsized":"2023-10-06T03:16:37.601525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:20.748360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.607264+0000","last_change":"2023-10-06T03:16:37.607264+0000","last_active":"2023-10-06T03:16:37.607264+0000","last_peered":"2023-10-06T03:16:37.607264+0000","last_clean":"2023-10-06T03:16:37.607264+0000","last_became_active":"2023-10-06T03:16:37.606884+0000","last_became_peered":"2023-10-06T03:16:37.606884+0000","last_unstale":"2023-10-06T03:16:37.607264+0000","last_undegraded":"2023-10-06T03:16:37.607264+0000","last_fullsized":"2023-10-06T03:16:37.607264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:33.692348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.593308+0000","last_change":"2023-10-06T03:16:37.591574+0000","last_active":"2023-10-06T03:16:37.593308+0000","last_peered":"2023-10-06T03:16:37.593308+0000","last_clean":"2023-10-06T03:16:37.593308+0000","last_became_active":"2023-10-06T03:16:37.591271+0000","last_became_peered":"2023-10-06T03:16:37.591271+0000","last_unstale":"2023-10-06T03:16:37.593308+0000","last_undegraded":"2023-10-06T03:16:37.593308+0000","last_fullsized":"2023-10-06T03:16:37.593308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:37.168785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.612848+0000","last_change":"2023-10-06T03:16:37.611064+0000","last_active":"2023-10-06T03:16:37.612848+0000","last_peered":"2023-10-06T03:16:37.612848+0000","last_clean":"2023-10-06T03:16:37.612848+0000","last_became_active":"2023-10-06T03:16:37.610528+0000","last_became_peered":"2023-10-06T03:16:37.610528+0000","last_unstale":"2023-10-06T03:16:37.612848+0000","last_undegraded":"2023-10-06T03:16:37.612848+0000","last_fullsized":"2023-10-06T03:16:37.612848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:54.678016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.603876+0000","last_change":"2023-10-06T03:16:37.595461+0000","last_active":"2023-10-06T03:16:37.603876+0000","last_peered":"2023-10-06T03:16:37.603876+0000","last_clean":"2023-10-06T03:16:37.603876+0000","last_became_active":"2023-10-06T03:16:37.595185+0000","last_became_peered":"2023-10-06T03:16:37.595185+0000","last_unstale":"2023-10-06T03:16:37.603876+0000","last_undegraded":"2023-10-06T03:16:37.603876+0000","last_fullsized":"2023-10-06T03:16:37.603876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:23.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600974+0000","last_change":"2023-10-06T03:16:37.599197+0000","last_active":"2023-10-06T03:16:37.600974+0000","last_peered":"2023-10-06T03:16:37.600974+0000","last_clean":"2023-10-06T03:16:37.600974+0000","last_became_active":"2023-10-06T03:16:37.598858+0000","last_became_peered":"2023-10-06T03:16:37.598858+0000","last_unstale":"2023-10-06T03:16:37.600974+0000","last_undegraded":"2023-10-06T03:16:37.600974+0000","last_fullsized":"2023-10-06T03:16:37.600974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:26.068931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.610342+0000","last_change":"2023-10-06T03:16:37.607782+0000","last_active":"2023-10-06T03:16:37.610342+0000","last_peered":"2023-10-06T03:16:37.610342+0000","last_clean":"2023-10-06T03:16:37.610342+0000","last_became_active":"2023-10-06T03:16:37.606775+0000","last_became_peered":"2023-10-06T03:16:37.606775+0000","last_unstale":"2023-10-06T03:16:37.610342+0000","last_undegraded":"2023-10-06T03:16:37.610342+0000","last_fullsized":"2023-10-06T03:16:37.610342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:25.322353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.611033+0000","last_change":"2023-10-06T03:16:37.606681+0000","last_active":"2023-10-06T03:16:37.611033+0000","last_peered":"2023-10-06T03:16:37.611033+0000","last_clean":"2023-10-06T03:16:37.611033+0000","last_became_active":"2023-10-06T03:16:37.606420+0000","last_became_peered":"2023-10-06T03:16:37.606420+0000","last_unstale":"2023-10-06T03:16:37.611033+0000","last_undegraded":"2023-10-06T03:16:37.611033+0000","last_fullsized":"2023-10-06T03:16:37.611033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:29.145161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602620+0000","last_change":"2023-10-06T03:16:37.601213+0000","last_active":"2023-10-06T03:16:37.602620+0000","last_peered":"2023-10-06T03:16:37.602620+0000","last_clean":"2023-10-06T03:16:37.602620+0000","last_became_active":"2023-10-06T03:16:37.600913+0000","last_became_peered":"2023-10-06T03:16:37.600913+0000","last_unstale":"2023-10-06T03:16:37.602620+0000","last_undegraded":"2023-10-06T03:16:37.602620+0000","last_fullsized":"2023-10-06T03:16:37.602620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:37.168785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614286+0000","last_change":"2023-10-06T03:16:37.605205+0000","last_active":"2023-10-06T03:16:37.614286+0000","last_peered":"2023-10-06T03:16:37.614286+0000","last_clean":"2023-10-06T03:16:37.614286+0000","last_became_active":"2023-10-06T03:16:37.604948+0000","last_became_peered":"2023-10-06T03:16:37.604948+0000","last_unstale":"2023-10-06T03:16:37.614286+0000","last_undegraded":"2023-10-06T03:16:37.614286+0000","last_fullsized":"2023-10-06T03:16:37.614286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:25.322353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613934+0000","last_change":"2023-10-06T03:16:37.606611+0000","last_active":"2023-10-06T03:16:37.613934+0000","last_peered":"2023-10-06T03:16:37.613934+0000","last_clean":"2023-10-06T03:16:37.613934+0000","last_became_active":"2023-10-06T03:16:37.606344+0000","last_became_peered":"2023-10-06T03:16:37.606344+0000","last_unstale":"2023-10-06T03:16:37.613934+0000","last_undegraded":"2023-10-06T03:16:37.613934+0000","last_fullsized":"2023-10-06T03:16:37.613934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:54.678016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.604009+0000","last_change":"2023-10-06T03:16:37.604009+0000","last_active":"2023-10-06T03:16:37.604009+0000","last_peered":"2023-10-06T03:16:37.604009+0000","last_clean":"2023-10-06T03:16:37.604009+0000","last_became_active":"2023-10-06T03:16:37.603701+0000","last_became_peered":"2023-10-06T03:16:37.603701+0000","last_unstale":"2023-10-06T03:16:37.604009+0000","last_undegraded":"2023-10-06T03:16:37.604009+0000","last_fullsized":"2023-10-06T03:16:37.604009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:44.324197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601051+0000","last_change":"2023-10-06T03:16:37.596013+0000","last_active":"2023-10-06T03:16:37.601051+0000","last_peered":"2023-10-06T03:16:37.601051+0000","last_clean":"2023-10-06T03:16:37.601051+0000","last_became_active":"2023-10-06T03:16:37.595780+0000","last_became_peered":"2023-10-06T03:16:37.595780+0000","last_unstale":"2023-10-06T03:16:37.601051+0000","last_undegraded":"2023-10-06T03:16:37.601051+0000","last_fullsized":"2023-10-06T03:16:37.601051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:11.043471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.604975+0000","last_change":"2023-10-06T03:16:37.604975+0000","last_active":"2023-10-06T03:16:37.604975+0000","last_peered":"2023-10-06T03:16:37.604975+0000","last_clean":"2023-10-06T03:16:37.604975+0000","last_became_active":"2023-10-06T03:16:37.604717+0000","last_became_peered":"2023-10-06T03:16:37.604717+0000","last_unstale":"2023-10-06T03:16:37.604975+0000","last_undegraded":"2023-10-06T03:16:37.604975+0000","last_fullsized":"2023-10-06T03:16:37.604975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:06.918970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602838+0000","last_change":"2023-10-06T03:16:37.596100+0000","last_active":"2023-10-06T03:16:37.602838+0000","last_peered":"2023-10-06T03:16:37.602838+0000","last_clean":"2023-10-06T03:16:37.602838+0000","last_became_active":"2023-10-06T03:16:37.595829+0000","last_became_peered":"2023-10-06T03:16:37.595829+0000","last_unstale":"2023-10-06T03:16:37.602838+0000","last_undegraded":"2023-10-06T03:16:37.602838+0000","last_fullsized":"2023-10-06T03:16:37.602838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:26.068931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602635+0000","last_change":"2023-10-06T03:16:37.599584+0000","last_active":"2023-10-06T03:16:37.602635+0000","last_peered":"2023-10-06T03:16:37.602635+0000","last_clean":"2023-10-06T03:16:37.602635+0000","last_became_active":"2023-10-06T03:16:37.598957+0000","last_became_peered":"2023-10-06T03:16:37.598957+0000","last_unstale":"2023-10-06T03:16:37.602635+0000","last_undegraded":"2023-10-06T03:16:37.602635+0000","last_fullsized":"2023-10-06T03:16:37.602635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:28.972124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614135+0000","last_change":"2023-10-06T03:16:37.607319+0000","last_active":"2023-10-06T03:16:37.614135+0000","last_peered":"2023-10-06T03:16:37.614135+0000","last_clean":"2023-10-06T03:16:37.614135+0000","last_became_active":"2023-10-06T03:16:37.607052+0000","last_became_peered":"2023-10-06T03:16:37.607052+0000","last_unstale":"2023-10-06T03:16:37.614135+0000","last_undegraded":"2023-10-06T03:16:37.614135+0000","last_fullsized":"2023-10-06T03:16:37.614135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:37.168785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.615682+0000","last_change":"2023-10-06T03:16:37.612724+0000","last_active":"2023-10-06T03:16:37.615682+0000","last_peered":"2023-10-06T03:16:37.615682+0000","last_clean":"2023-10-06T03:16:37.615682+0000","last_became_active":"2023-10-06T03:16:37.612408+0000","last_became_peered":"2023-10-06T03:16:37.612408+0000","last_unstale":"2023-10-06T03:16:37.615682+0000","last_undegraded":"2023-10-06T03:16:37.615682+0000","last_fullsized":"2023-10-06T03:16:37.615682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:36.177339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.599436+0000","last_change":"2023-10-06T03:16:37.599436+0000","last_active":"2023-10-06T03:16:37.599436+0000","last_peered":"2023-10-06T03:16:37.599436+0000","last_clean":"2023-10-06T03:16:37.599436+0000","last_became_active":"2023-10-06T03:16:37.599101+0000","last_became_peered":"2023-10-06T03:16:37.599101+0000","last_unstale":"2023-10-06T03:16:37.599436+0000","last_undegraded":"2023-10-06T03:16:37.599436+0000","last_fullsized":"2023-10-06T03:16:37.599436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:48.312529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605047+0000","last_change":"2023-10-06T03:16:37.605047+0000","last_active":"2023-10-06T03:16:37.605047+0000","last_peered":"2023-10-06T03:16:37.605047+0000","last_clean":"2023-10-06T03:16:37.605047+0000","last_became_active":"2023-10-06T03:16:37.604792+0000","last_became_peered":"2023-10-06T03:16:37.604792+0000","last_unstale":"2023-10-06T03:16:37.605047+0000","last_undegraded":"2023-10-06T03:16:37.605047+0000","last_fullsized":"2023-10-06T03:16:37.605047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:27.450298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.603651+0000","last_change":"2023-10-06T03:16:37.603651+0000","last_active":"2023-10-06T03:16:37.603651+0000","last_peered":"2023-10-06T03:16:37.603651+0000","last_clean":"2023-10-06T03:16:37.603651+0000","last_became_active":"2023-10-06T03:16:37.603385+0000","last_became_peered":"2023-10-06T03:16:37.603385+0000","last_unstale":"2023-10-06T03:16:37.603651+0000","last_undegraded":"2023-10-06T03:16:37.603651+0000","last_fullsized":"2023-10-06T03:16:37.603651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:46.496334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.610072+0000","last_change":"2023-10-06T03:16:37.606497+0000","last_active":"2023-10-06T03:16:37.610072+0000","last_peered":"2023-10-06T03:16:37.610072+0000","last_clean":"2023-10-06T03:16:37.610072+0000","last_became_active":"2023-10-06T03:16:37.604178+0000","last_became_peered":"2023-10-06T03:16:37.604178+0000","last_unstale":"2023-10-06T03:16:37.610072+0000","last_undegraded":"2023-10-06T03:16:37.610072+0000","last_fullsized":"2023-10-06T03:16:37.610072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:26.370414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601936+0000","last_change":"2023-10-06T03:16:37.601936+0000","last_active":"2023-10-06T03:16:37.601936+0000","last_peered":"2023-10-06T03:16:37.601936+0000","last_clean":"2023-10-06T03:16:37.601936+0000","last_became_active":"2023-10-06T03:16:37.601677+0000","last_became_peered":"2023-10-06T03:16:37.601677+0000","last_unstale":"2023-10-06T03:16:37.601936+0000","last_undegraded":"2023-10-06T03:16:37.601936+0000","last_fullsized":"2023-10-06T03:16:37.601936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:36.177339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601434+0000","last_change":"2023-10-06T03:16:37.601434+0000","last_active":"2023-10-06T03:16:37.601434+0000","last_peered":"2023-10-06T03:16:37.601434+0000","last_clean":"2023-10-06T03:16:37.601434+0000","last_became_active":"2023-10-06T03:16:37.600516+0000","last_became_peered":"2023-10-06T03:16:37.600516+0000","last_unstale":"2023-10-06T03:16:37.601434+0000","last_undegraded":"2023-10-06T03:16:37.601434+0000","last_fullsized":"2023-10-06T03:16:37.601434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:52.523580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614094+0000","last_change":"2023-10-06T03:16:37.607257+0000","last_active":"2023-10-06T03:16:37.614094+0000","last_peered":"2023-10-06T03:16:37.614094+0000","last_clean":"2023-10-06T03:16:37.614094+0000","last_became_active":"2023-10-06T03:16:37.606916+0000","last_became_peered":"2023-10-06T03:16:37.606916+0000","last_unstale":"2023-10-06T03:16:37.614094+0000","last_undegraded":"2023-10-06T03:16:37.614094+0000","last_fullsized":"2023-10-06T03:16:37.614094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:47.686372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602680+0000","last_change":"2023-10-06T03:16:37.602680+0000","last_active":"2023-10-06T03:16:37.602680+0000","last_peered":"2023-10-06T03:16:37.602680+0000","last_clean":"2023-10-06T03:16:37.602680+0000","last_became_active":"2023-10-06T03:16:37.602377+0000","last_became_peered":"2023-10-06T03:16:37.602377+0000","last_unstale":"2023-10-06T03:16:37.602680+0000","last_undegraded":"2023-10-06T03:16:37.602680+0000","last_fullsized":"2023-10-06T03:16:37.602680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:44.324197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613909+0000","last_change":"2023-10-06T03:16:37.605796+0000","last_active":"2023-10-06T03:16:37.613909+0000","last_peered":"2023-10-06T03:16:37.613909+0000","last_clean":"2023-10-06T03:16:37.613909+0000","last_became_active":"2023-10-06T03:16:37.605544+0000","last_became_peered":"2023-10-06T03:16:37.605544+0000","last_unstale":"2023-10-06T03:16:37.613909+0000","last_undegraded":"2023-10-06T03:16:37.613909+0000","last_fullsized":"2023-10-06T03:16:37.613909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:26.068931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614793+0000","last_change":"2023-10-06T03:16:36.598810+0000","last_active":"2023-10-06T03:16:37.614793+0000","last_peered":"2023-10-06T03:16:37.614793+0000","last_clean":"2023-10-06T03:16:37.614793+0000","last_became_active":"2023-10-06T03:16:36.598481+0000","last_became_peered":"2023-10-06T03:16:36.598481+0000","last_unstale":"2023-10-06T03:16:37.614793+0000","last_undegraded":"2023-10-06T03:16:37.614793+0000","last_fullsized":"2023-10-06T03:16:37.614793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:23.651906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.606800+0000","last_change":"2023-10-06T03:16:37.606800+0000","last_active":"2023-10-06T03:16:37.606800+0000","last_peered":"2023-10-06T03:16:37.606800+0000","last_clean":"2023-10-06T03:16:37.606800+0000","last_became_active":"2023-10-06T03:16:37.606545+0000","last_became_peered":"2023-10-06T03:16:37.606545+0000","last_unstale":"2023-10-06T03:16:37.606800+0000","last_undegraded":"2023-10-06T03:16:37.606800+0000","last_fullsized":"2023-10-06T03:16:37.606800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:42.138880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614871+0000","last_change":"2023-10-06T03:16:36.599798+0000","last_active":"2023-10-06T03:16:37.614871+0000","last_peered":"2023-10-06T03:16:37.614871+0000","last_clean":"2023-10-06T03:16:37.614871+0000","last_became_active":"2023-10-06T03:16:36.599519+0000","last_became_peered":"2023-10-06T03:16:36.599519+0000","last_unstale":"2023-10-06T03:16:37.614871+0000","last_undegraded":"2023-10-06T03:16:37.614871+0000","last_fullsized":"2023-10-06T03:16:37.614871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:45.491899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605870+0000","last_change":"2023-10-06T03:16:37.600312+0000","last_active":"2023-10-06T03:16:37.605870+0000","last_peered":"2023-10-06T03:16:37.605870+0000","last_clean":"2023-10-06T03:16:37.605870+0000","last_became_active":"2023-10-06T03:16:37.600017+0000","last_became_peered":"2023-10-06T03:16:37.600017+0000","last_unstale":"2023-10-06T03:16:37.605870+0000","last_undegraded":"2023-10-06T03:16:37.605870+0000","last_fullsized":"2023-10-06T03:16:37.605870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:29.168173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.607885+0000","last_change":"2023-10-06T03:16:36.593003+0000","last_active":"2023-10-06T03:16:37.607885+0000","last_peered":"2023-10-06T03:16:37.607885+0000","last_clean":"2023-10-06T03:16:37.607885+0000","last_became_active":"2023-10-06T03:16:36.592686+0000","last_became_peered":"2023-10-06T03:16:36.592686+0000","last_unstale":"2023-10-06T03:16:37.607885+0000","last_undegraded":"2023-10-06T03:16:37.607885+0000","last_fullsized":"2023-10-06T03:16:37.607885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:23.651906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601226+0000","last_change":"2023-10-06T03:16:37.601226+0000","last_active":"2023-10-06T03:16:37.601226+0000","last_peered":"2023-10-06T03:16:37.601226+0000","last_clean":"2023-10-06T03:16:37.601226+0000","last_became_active":"2023-10-06T03:16:37.600991+0000","last_became_peered":"2023-10-06T03:16:37.600991+0000","last_unstale":"2023-10-06T03:16:37.601226+0000","last_undegraded":"2023-10-06T03:16:37.601226+0000","last_fullsized":"2023-10-06T03:16:37.601226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:25.322353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613482+0000","last_change":"2023-10-06T03:16:36.605013+0000","last_active":"2023-10-06T03:16:37.613482+0000","last_peered":"2023-10-06T03:16:37.613482+0000","last_clean":"2023-10-06T03:16:37.613482+0000","last_became_active":"2023-10-06T03:16:36.604744+0000","last_became_peered":"2023-10-06T03:16:36.604744+0000","last_unstale":"2023-10-06T03:16:37.613482+0000","last_undegraded":"2023-10-06T03:16:37.613482+0000","last_fullsized":"2023-10-06T03:16:37.613482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:13.642996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600665+0000","last_change":"2023-10-06T03:16:37.596287+0000","last_active":"2023-10-06T03:16:37.600665+0000","last_peered":"2023-10-06T03:16:37.600665+0000","last_clean":"2023-10-06T03:16:37.600665+0000","last_became_active":"2023-10-06T03:16:37.596019+0000","last_became_peered":"2023-10-06T03:16:37.596019+0000","last_unstale":"2023-10-06T03:16:37.600665+0000","last_undegraded":"2023-10-06T03:16:37.600665+0000","last_fullsized":"2023-10-06T03:16:37.600665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:43.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613985+0000","last_change":"2023-10-06T03:16:36.597252+0000","last_active":"2023-10-06T03:16:37.613985+0000","last_peered":"2023-10-06T03:16:37.613985+0000","last_clean":"2023-10-06T03:16:37.613985+0000","last_became_active":"2023-10-06T03:16:36.596974+0000","last_became_peered":"2023-10-06T03:16:36.596974+0000","last_unstale":"2023-10-06T03:16:37.613985+0000","last_undegraded":"2023-10-06T03:16:37.613985+0000","last_fullsized":"2023-10-06T03:16:37.613985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:40.119077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601546+0000","last_change":"2023-10-06T03:16:37.595909+0000","last_active":"2023-10-06T03:16:37.601546+0000","last_peered":"2023-10-06T03:16:37.601546+0000","last_clean":"2023-10-06T03:16:37.601546+0000","last_became_active":"2023-10-06T03:16:37.595658+0000","last_became_peered":"2023-10-06T03:16:37.595658+0000","last_unstale":"2023-10-06T03:16:37.601546+0000","last_undegraded":"2023-10-06T03:16:37.601546+0000","last_fullsized":"2023-10-06T03:16:37.601546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:47.686372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613623+0000","last_change":"2023-10-06T03:16:36.598078+0000","last_active":"2023-10-06T03:16:37.613623+0000","last_peered":"2023-10-06T03:16:37.613623+0000","last_clean":"2023-10-06T03:16:37.613623+0000","last_became_active":"2023-10-06T03:16:36.597801+0000","last_became_peered":"2023-10-06T03:16:36.597801+0000","last_unstale":"2023-10-06T03:16:37.613623+0000","last_undegraded":"2023-10-06T03:16:37.613623+0000","last_fullsized":"2023-10-06T03:16:37.613623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.308093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601428+0000","last_change":"2023-10-06T03:16:37.598043+0000","last_active":"2023-10-06T03:16:37.601428+0000","last_peered":"2023-10-06T03:16:37.601428+0000","last_clean":"2023-10-06T03:16:37.601428+0000","last_became_active":"2023-10-06T03:16:37.597813+0000","last_became_peered":"2023-10-06T03:16:37.597813+0000","last_unstale":"2023-10-06T03:16:37.601428+0000","last_undegraded":"2023-10-06T03:16:37.601428+0000","last_fullsized":"2023-10-06T03:16:37.601428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:54.678016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.604128+0000","last_change":"2023-10-06T03:16:36.599282+0000","last_active":"2023-10-06T03:16:36.604128+0000","last_peered":"2023-10-06T03:16:36.604128+0000","last_clean":"2023-10-06T03:16:36.604128+0000","last_became_active":"2023-10-06T03:16:36.598679+0000","last_became_peered":"2023-10-06T03:16:36.598679+0000","last_unstale":"2023-10-06T03:16:36.604128+0000","last_undegraded":"2023-10-06T03:16:36.604128+0000","last_fullsized":"2023-10-06T03:16:36.604128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:26.175878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.607496+0000","last_change":"2023-10-06T03:16:37.607496+0000","last_active":"2023-10-06T03:16:37.607496+0000","last_peered":"2023-10-06T03:16:37.607496+0000","last_clean":"2023-10-06T03:16:37.607496+0000","last_became_active":"2023-10-06T03:16:37.607258+0000","last_became_peered":"2023-10-06T03:16:37.607258+0000","last_unstale":"2023-10-06T03:16:37.607496+0000","last_undegraded":"2023-10-06T03:16:37.607496+0000","last_fullsized":"2023-10-06T03:16:37.607496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:29.145161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589879+0000","last_change":"2023-10-06T03:16:36.592980+0000","last_active":"2023-10-06T03:16:37.589879+0000","last_peered":"2023-10-06T03:16:37.589879+0000","last_clean":"2023-10-06T03:16:37.589879+0000","last_became_active":"2023-10-06T03:16:36.592722+0000","last_became_peered":"2023-10-06T03:16:36.592722+0000","last_unstale":"2023-10-06T03:16:37.589879+0000","last_undegraded":"2023-10-06T03:16:37.589879+0000","last_fullsized":"2023-10-06T03:16:37.589879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:48.373403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602242+0000","last_change":"2023-10-06T03:16:37.597710+0000","last_active":"2023-10-06T03:16:37.602242+0000","last_peered":"2023-10-06T03:16:37.602242+0000","last_clean":"2023-10-06T03:16:37.602242+0000","last_became_active":"2023-10-06T03:16:37.597448+0000","last_became_peered":"2023-10-06T03:16:37.597448+0000","last_unstale":"2023-10-06T03:16:37.602242+0000","last_undegraded":"2023-10-06T03:16:37.602242+0000","last_fullsized":"2023-10-06T03:16:37.602242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:45.650720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.606767+0000","last_change":"2023-10-06T03:16:36.601293+0000","last_active":"2023-10-06T03:16:36.606767+0000","last_peered":"2023-10-06T03:16:36.606767+0000","last_clean":"2023-10-06T03:16:36.606767+0000","last_became_active":"2023-10-06T03:16:36.601046+0000","last_became_peered":"2023-10-06T03:16:36.601046+0000","last_unstale":"2023-10-06T03:16:36.606767+0000","last_undegraded":"2023-10-06T03:16:36.606767+0000","last_fullsized":"2023-10-06T03:16:36.606767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:26.445862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613362+0000","last_change":"2023-10-06T03:16:37.597737+0000","last_active":"2023-10-06T03:16:37.613362+0000","last_peered":"2023-10-06T03:16:37.613362+0000","last_clean":"2023-10-06T03:16:37.613362+0000","last_became_active":"2023-10-06T03:16:37.597468+0000","last_became_peered":"2023-10-06T03:16:37.597468+0000","last_unstale":"2023-10-06T03:16:37.613362+0000","last_undegraded":"2023-10-06T03:16:37.613362+0000","last_fullsized":"2023-10-06T03:16:37.613362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:20.748360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.587176+0000","last_change":"2023-10-06T03:16:36.597998+0000","last_active":"2023-10-06T03:16:37.587176+0000","last_peered":"2023-10-06T03:16:37.587176+0000","last_clean":"2023-10-06T03:16:37.587176+0000","last_became_active":"2023-10-06T03:16:36.597729+0000","last_became_peered":"2023-10-06T03:16:36.597729+0000","last_unstale":"2023-10-06T03:16:37.587176+0000","last_undegraded":"2023-10-06T03:16:37.587176+0000","last_fullsized":"2023-10-06T03:16:37.587176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:35.172904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600621+0000","last_change":"2023-10-06T03:16:37.596985+0000","last_active":"2023-10-06T03:16:37.600621+0000","last_peered":"2023-10-06T03:16:37.600621+0000","last_clean":"2023-10-06T03:16:37.600621+0000","last_became_active":"2023-10-06T03:16:37.596733+0000","last_became_peered":"2023-10-06T03:16:37.596733+0000","last_unstale":"2023-10-06T03:16:37.600621+0000","last_undegraded":"2023-10-06T03:16:37.600621+0000","last_fullsized":"2023-10-06T03:16:37.600621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.913463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.615772+0000","last_change":"2023-10-06T03:16:36.594703+0000","last_active":"2023-10-06T03:16:37.615772+0000","last_peered":"2023-10-06T03:16:37.615772+0000","last_clean":"2023-10-06T03:16:37.615772+0000","last_became_active":"2023-10-06T03:16:36.594382+0000","last_became_peered":"2023-10-06T03:16:36.594382+0000","last_unstale":"2023-10-06T03:16:37.615772+0000","last_undegraded":"2023-10-06T03:16:37.615772+0000","last_fullsized":"2023-10-06T03:16:37.615772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:43.319761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.602630+0000","last_change":"2023-10-06T03:16:37.599404+0000","last_active":"2023-10-06T03:16:37.602630+0000","last_peered":"2023-10-06T03:16:37.602630+0000","last_clean":"2023-10-06T03:16:37.602630+0000","last_became_active":"2023-10-06T03:16:37.598982+0000","last_became_peered":"2023-10-06T03:16:37.598982+0000","last_unstale":"2023-10-06T03:16:37.602630+0000","last_undegraded":"2023-10-06T03:16:37.602630+0000","last_fullsized":"2023-10-06T03:16:37.602630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.913463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.615350+0000","last_change":"2023-10-06T03:16:36.604270+0000","last_active":"2023-10-06T03:16:37.615350+0000","last_peered":"2023-10-06T03:16:37.615350+0000","last_clean":"2023-10-06T03:16:37.615350+0000","last_became_active":"2023-10-06T03:16:36.604060+0000","last_became_peered":"2023-10-06T03:16:36.604060+0000","last_unstale":"2023-10-06T03:16:37.615350+0000","last_undegraded":"2023-10-06T03:16:37.615350+0000","last_fullsized":"2023-10-06T03:16:37.615350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:09.255469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.593336+0000","last_change":"2023-10-06T03:16:37.591571+0000","last_active":"2023-10-06T03:16:37.593336+0000","last_peered":"2023-10-06T03:16:37.593336+0000","last_clean":"2023-10-06T03:16:37.593336+0000","last_became_active":"2023-10-06T03:16:37.591284+0000","last_became_peered":"2023-10-06T03:16:37.591284+0000","last_unstale":"2023-10-06T03:16:37.593336+0000","last_undegraded":"2023-10-06T03:16:37.593336+0000","last_fullsized":"2023-10-06T03:16:37.593336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.361049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.609338+0000","last_change":"2023-10-06T03:16:36.604178+0000","last_active":"2023-10-06T03:16:37.609338+0000","last_peered":"2023-10-06T03:16:37.609338+0000","last_clean":"2023-10-06T03:16:37.609338+0000","last_became_active":"2023-10-06T03:16:36.603978+0000","last_became_peered":"2023-10-06T03:16:36.603978+0000","last_unstale":"2023-10-06T03:16:37.609338+0000","last_undegraded":"2023-10-06T03:16:37.609338+0000","last_fullsized":"2023-10-06T03:16:37.609338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:31.404294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.595439+0000","last_change":"2023-10-06T03:16:37.595439+0000","last_active":"2023-10-06T03:16:37.595439+0000","last_peered":"2023-10-06T03:16:37.595439+0000","last_clean":"2023-10-06T03:16:37.595439+0000","last_became_active":"2023-10-06T03:16:37.594879+0000","last_became_peered":"2023-10-06T03:16:37.594879+0000","last_unstale":"2023-10-06T03:16:37.595439+0000","last_undegraded":"2023-10-06T03:16:37.595439+0000","last_fullsized":"2023-10-06T03:16:37.595439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:37.168785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.604101+0000","last_change":"2023-10-06T03:16:36.599110+0000","last_active":"2023-10-06T03:16:36.604101+0000","last_peered":"2023-10-06T03:16:36.604101+0000","last_clean":"2023-10-06T03:16:36.604101+0000","last_became_active":"2023-10-06T03:16:36.598669+0000","last_became_peered":"2023-10-06T03:16:36.598669+0000","last_unstale":"2023-10-06T03:16:36.604101+0000","last_undegraded":"2023-10-06T03:16:36.604101+0000","last_fullsized":"2023-10-06T03:16:36.604101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:09.501526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613982+0000","last_change":"2023-10-06T03:16:37.606269+0000","last_active":"2023-10-06T03:16:37.613982+0000","last_peered":"2023-10-06T03:16:37.613982+0000","last_clean":"2023-10-06T03:16:37.613982+0000","last_became_active":"2023-10-06T03:16:37.605995+0000","last_became_peered":"2023-10-06T03:16:37.605995+0000","last_unstale":"2023-10-06T03:16:37.613982+0000","last_undegraded":"2023-10-06T03:16:37.613982+0000","last_fullsized":"2023-10-06T03:16:37.613982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:43.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.604251+0000","last_change":"2023-10-06T03:16:36.598871+0000","last_active":"2023-10-06T03:16:36.604251+0000","last_peered":"2023-10-06T03:16:36.604251+0000","last_clean":"2023-10-06T03:16:36.604251+0000","last_became_active":"2023-10-06T03:16:36.598601+0000","last_became_peered":"2023-10-06T03:16:36.598601+0000","last_unstale":"2023-10-06T03:16:36.604251+0000","last_undegraded":"2023-10-06T03:16:36.604251+0000","last_fullsized":"2023-10-06T03:16:36.604251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:12.733826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.597230+0000","last_change":"2023-10-06T03:16:37.597230+0000","last_active":"2023-10-06T03:16:37.597230+0000","last_peered":"2023-10-06T03:16:37.597230+0000","last_clean":"2023-10-06T03:16:37.597230+0000","last_became_active":"2023-10-06T03:16:37.596987+0000","last_became_peered":"2023-10-06T03:16:37.596987+0000","last_unstale":"2023-10-06T03:16:37.597230+0000","last_undegraded":"2023-10-06T03:16:37.597230+0000","last_fullsized":"2023-10-06T03:16:37.597230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:28.972124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614557+0000","last_change":"2023-10-06T03:16:36.600369+0000","last_active":"2023-10-06T03:16:37.614557+0000","last_peered":"2023-10-06T03:16:37.614557+0000","last_clean":"2023-10-06T03:16:37.614557+0000","last_became_active":"2023-10-06T03:16:36.600045+0000","last_became_peered":"2023-10-06T03:16:36.600045+0000","last_unstale":"2023-10-06T03:16:37.614557+0000","last_undegraded":"2023-10-06T03:16:37.614557+0000","last_fullsized":"2023-10-06T03:16:37.614557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:35.172904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605737+0000","last_change":"2023-10-06T03:16:37.605737+0000","last_active":"2023-10-06T03:16:37.605737+0000","last_peered":"2023-10-06T03:16:37.605737+0000","last_clean":"2023-10-06T03:16:37.605737+0000","last_became_active":"2023-10-06T03:16:37.605495+0000","last_became_peered":"2023-10-06T03:16:37.605495+0000","last_unstale":"2023-10-06T03:16:37.605737+0000","last_undegraded":"2023-10-06T03:16:37.605737+0000","last_fullsized":"2023-10-06T03:16:37.605737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:26.370414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614995+0000","last_change":"2023-10-06T03:16:36.598971+0000","last_active":"2023-10-06T03:16:37.614995+0000","last_peered":"2023-10-06T03:16:37.614995+0000","last_clean":"2023-10-06T03:16:37.614995+0000","last_became_active":"2023-10-06T03:16:36.598728+0000","last_became_peered":"2023-10-06T03:16:36.598728+0000","last_unstale":"2023-10-06T03:16:37.614995+0000","last_undegraded":"2023-10-06T03:16:37.614995+0000","last_fullsized":"2023-10-06T03:16:37.614995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:44.646284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.608833+0000","last_change":"2023-10-06T03:16:37.603499+0000","last_active":"2023-10-06T03:16:37.608833+0000","last_peered":"2023-10-06T03:16:37.608833+0000","last_clean":"2023-10-06T03:16:37.608833+0000","last_became_active":"2023-10-06T03:16:37.603032+0000","last_became_peered":"2023-10-06T03:16:37.603032+0000","last_unstale":"2023-10-06T03:16:37.608833+0000","last_undegraded":"2023-10-06T03:16:37.608833+0000","last_fullsized":"2023-10-06T03:16:37.608833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.913463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.612575+0000","last_change":"2023-10-06T03:16:36.597449+0000","last_active":"2023-10-06T03:16:37.612575+0000","last_peered":"2023-10-06T03:16:37.612575+0000","last_clean":"2023-10-06T03:16:37.612575+0000","last_became_active":"2023-10-06T03:16:36.597199+0000","last_became_peered":"2023-10-06T03:16:36.597199+0000","last_unstale":"2023-10-06T03:16:37.612575+0000","last_undegraded":"2023-10-06T03:16:37.612575+0000","last_fullsized":"2023-10-06T03:16:37.612575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:36.412042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601559+0000","last_change":"2023-10-06T03:16:37.598001+0000","last_active":"2023-10-06T03:16:37.601559+0000","last_peered":"2023-10-06T03:16:37.601559+0000","last_clean":"2023-10-06T03:16:37.601559+0000","last_became_active":"2023-10-06T03:16:37.596864+0000","last_became_peered":"2023-10-06T03:16:37.596864+0000","last_unstale":"2023-10-06T03:16:37.601559+0000","last_undegraded":"2023-10-06T03:16:37.601559+0000","last_fullsized":"2023-10-06T03:16:37.601559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:35.766427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614583+0000","last_change":"2023-10-06T03:16:36.599579+0000","last_active":"2023-10-06T03:16:37.614583+0000","last_peered":"2023-10-06T03:16:37.614583+0000","last_clean":"2023-10-06T03:16:37.614583+0000","last_became_active":"2023-10-06T03:16:36.599299+0000","last_became_peered":"2023-10-06T03:16:36.599299+0000","last_unstale":"2023-10-06T03:16:37.614583+0000","last_undegraded":"2023-10-06T03:16:37.614583+0000","last_fullsized":"2023-10-06T03:16:37.614583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:57.189332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.601303+0000","last_change":"2023-10-06T03:16:37.598904+0000","last_active":"2023-10-06T03:16:37.601303+0000","last_peered":"2023-10-06T03:16:37.601303+0000","last_clean":"2023-10-06T03:16:37.601303+0000","last_became_active":"2023-10-06T03:16:37.598620+0000","last_became_peered":"2023-10-06T03:16:37.598620+0000","last_unstale":"2023-10-06T03:16:37.601303+0000","last_undegraded":"2023-10-06T03:16:37.601303+0000","last_fullsized":"2023-10-06T03:16:37.601303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:48.312529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.604054+0000","last_change":"2023-10-06T03:16:36.597293+0000","last_active":"2023-10-06T03:16:36.604054+0000","last_peered":"2023-10-06T03:16:36.604054+0000","last_clean":"2023-10-06T03:16:36.604054+0000","last_became_active":"2023-10-06T03:16:36.597048+0000","last_became_peered":"2023-10-06T03:16:36.597048+0000","last_unstale":"2023-10-06T03:16:36.604054+0000","last_undegraded":"2023-10-06T03:16:36.604054+0000","last_fullsized":"2023-10-06T03:16:36.604054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:44.980760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.614315+0000","last_change":"2023-10-06T03:16:37.606154+0000","last_active":"2023-10-06T03:16:37.614315+0000","last_peered":"2023-10-06T03:16:37.614315+0000","last_clean":"2023-10-06T03:16:37.614315+0000","last_became_active":"2023-10-06T03:16:37.605906+0000","last_became_peered":"2023-10-06T03:16:37.605906+0000","last_unstale":"2023-10-06T03:16:37.614315+0000","last_undegraded":"2023-10-06T03:16:37.614315+0000","last_fullsized":"2023-10-06T03:16:37.614315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:23.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.608059+0000","last_change":"2023-10-06T03:16:36.597288+0000","last_active":"2023-10-06T03:16:37.608059+0000","last_peered":"2023-10-06T03:16:37.608059+0000","last_clean":"2023-10-06T03:16:37.608059+0000","last_became_active":"2023-10-06T03:16:36.597026+0000","last_became_peered":"2023-10-06T03:16:36.597026+0000","last_unstale":"2023-10-06T03:16:37.608059+0000","last_undegraded":"2023-10-06T03:16:37.608059+0000","last_fullsized":"2023-10-06T03:16:37.608059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:55.930244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600655+0000","last_change":"2023-10-06T03:16:37.597010+0000","last_active":"2023-10-06T03:16:37.600655+0000","last_peered":"2023-10-06T03:16:37.600655+0000","last_clean":"2023-10-06T03:16:37.600655+0000","last_became_active":"2023-10-06T03:16:37.596759+0000","last_became_peered":"2023-10-06T03:16:37.596759+0000","last_unstale":"2023-10-06T03:16:37.600655+0000","last_undegraded":"2023-10-06T03:16:37.600655+0000","last_fullsized":"2023-10-06T03:16:37.600655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:20.748360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589570+0000","last_change":"2023-10-06T03:16:36.597896+0000","last_active":"2023-10-06T03:16:37.589570+0000","last_peered":"2023-10-06T03:16:37.589570+0000","last_clean":"2023-10-06T03:16:37.589570+0000","last_became_active":"2023-10-06T03:16:36.597652+0000","last_became_peered":"2023-10-06T03:16:36.597652+0000","last_unstale":"2023-10-06T03:16:37.589570+0000","last_undegraded":"2023-10-06T03:16:37.589570+0000","last_fullsized":"2023-10-06T03:16:37.589570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:11.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.610349+0000","last_change":"2023-10-06T03:16:37.607443+0000","last_active":"2023-10-06T03:16:37.610349+0000","last_peered":"2023-10-06T03:16:37.610349+0000","last_clean":"2023-10-06T03:16:37.610349+0000","last_became_active":"2023-10-06T03:16:37.607200+0000","last_became_peered":"2023-10-06T03:16:37.607200+0000","last_unstale":"2023-10-06T03:16:37.610349+0000","last_undegraded":"2023-10-06T03:16:37.610349+0000","last_fullsized":"2023-10-06T03:16:37.610349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:43.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589196+0000","last_change":"2023-10-06T03:16:36.601435+0000","last_active":"2023-10-06T03:16:37.589196+0000","last_peered":"2023-10-06T03:16:37.589196+0000","last_clean":"2023-10-06T03:16:37.589196+0000","last_became_active":"2023-10-06T03:16:36.600979+0000","last_became_peered":"2023-10-06T03:16:36.600979+0000","last_unstale":"2023-10-06T03:16:37.589196+0000","last_undegraded":"2023-10-06T03:16:37.589196+0000","last_fullsized":"2023-10-06T03:16:37.589196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:40.119077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.607580+0000","last_change":"2023-10-06T03:16:37.607580+0000","last_active":"2023-10-06T03:16:37.607580+0000","last_peered":"2023-10-06T03:16:37.607580+0000","last_clean":"2023-10-06T03:16:37.607580+0000","last_became_active":"2023-10-06T03:16:37.607295+0000","last_became_peered":"2023-10-06T03:16:37.607295+0000","last_unstale":"2023-10-06T03:16:37.607580+0000","last_undegraded":"2023-10-06T03:16:37.607580+0000","last_fullsized":"2023-10-06T03:16:37.607580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:29.168173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589963+0000","last_change":"2023-10-06T03:16:36.591569+0000","last_active":"2023-10-06T03:16:37.589963+0000","last_peered":"2023-10-06T03:16:37.589963+0000","last_clean":"2023-10-06T03:16:37.589963+0000","last_became_active":"2023-10-06T03:16:36.591282+0000","last_became_peered":"2023-10-06T03:16:36.591282+0000","last_unstale":"2023-10-06T03:16:37.589963+0000","last_undegraded":"2023-10-06T03:16:37.589963+0000","last_fullsized":"2023-10-06T03:16:37.589963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:26.073879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.605801+0000","last_change":"2023-10-06T03:16:37.601096+0000","last_active":"2023-10-06T03:16:37.605801+0000","last_peered":"2023-10-06T03:16:37.605801+0000","last_clean":"2023-10-06T03:16:37.605801+0000","last_became_active":"2023-10-06T03:16:37.600367+0000","last_became_peered":"2023-10-06T03:16:37.600367+0000","last_unstale":"2023-10-06T03:16:37.605801+0000","last_undegraded":"2023-10-06T03:16:37.605801+0000","last_fullsized":"2023-10-06T03:16:37.605801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:26.370414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589410+0000","last_change":"2023-10-06T03:16:36.595689+0000","last_active":"2023-10-06T03:16:37.589410+0000","last_peered":"2023-10-06T03:16:37.589410+0000","last_clean":"2023-10-06T03:16:37.589410+0000","last_became_active":"2023-10-06T03:16:36.595407+0000","last_became_peered":"2023-10-06T03:16:36.595407+0000","last_unstale":"2023-10-06T03:16:37.589410+0000","last_undegraded":"2023-10-06T03:16:37.589410+0000","last_fullsized":"2023-10-06T03:16:37.589410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:31.721608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589695+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:16:37.589695+0000","last_peered":"2023-10-06T03:16:37.589695+0000","last_clean":"2023-10-06T03:16:37.589695+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:16:37.589695+0000","last_undegraded":"2023-10-06T03:16:37.589695+0000","last_fullsized":"2023-10-06T03:16:37.589695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613401+0000","last_change":"2023-10-06T03:16:37.597937+0000","last_active":"2023-10-06T03:16:37.613401+0000","last_peered":"2023-10-06T03:16:37.613401+0000","last_clean":"2023-10-06T03:16:37.613401+0000","last_became_active":"2023-10-06T03:16:37.597725+0000","last_became_peered":"2023-10-06T03:16:37.597725+0000","last_unstale":"2023-10-06T03:16:37.613401+0000","last_undegraded":"2023-10-06T03:16:37.613401+0000","last_fullsized":"2023-10-06T03:16:37.613401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:35.766427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.596867+0000","last_change":"2023-10-06T03:16:36.593239+0000","last_active":"2023-10-06T03:16:36.596867+0000","last_peered":"2023-10-06T03:16:36.596867+0000","last_clean":"2023-10-06T03:16:36.596867+0000","last_became_active":"2023-10-06T03:16:36.591766+0000","last_became_peered":"2023-10-06T03:16:36.591766+0000","last_unstale":"2023-10-06T03:16:36.596867+0000","last_undegraded":"2023-10-06T03:16:36.596867+0000","last_fullsized":"2023-10-06T03:16:36.596867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:41.134445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.594842+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:16:36.594842+0000","last_peered":"2023-10-06T03:16:36.594842+0000","last_clean":"2023-10-06T03:16:36.594842+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:16:36.594842+0000","last_undegraded":"2023-10-06T03:16:36.594842+0000","last_fullsized":"2023-10-06T03:16:36.594842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.604904+0000","last_change":"2023-10-06T03:16:37.604904+0000","last_active":"2023-10-06T03:16:37.604904+0000","last_peered":"2023-10-06T03:16:37.604904+0000","last_clean":"2023-10-06T03:16:37.604904+0000","last_became_active":"2023-10-06T03:16:37.604682+0000","last_became_peered":"2023-10-06T03:16:37.604682+0000","last_unstale":"2023-10-06T03:16:37.604904+0000","last_undegraded":"2023-10-06T03:16:37.604904+0000","last_fullsized":"2023-10-06T03:16:37.604904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:06.918970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.615664+0000","last_change":"2023-10-06T03:16:36.601467+0000","last_active":"2023-10-06T03:16:37.615664+0000","last_peered":"2023-10-06T03:16:37.615664+0000","last_clean":"2023-10-06T03:16:37.615664+0000","last_became_active":"2023-10-06T03:16:36.601193+0000","last_became_peered":"2023-10-06T03:16:36.601193+0000","last_unstale":"2023-10-06T03:16:37.615664+0000","last_undegraded":"2023-10-06T03:16:37.615664+0000","last_fullsized":"2023-10-06T03:16:37.615664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.308093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.586388+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:16:36.586388+0000","last_peered":"2023-10-06T03:16:36.586388+0000","last_clean":"2023-10-06T03:16:36.586388+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:16:36.586388+0000","last_undegraded":"2023-10-06T03:16:36.586388+0000","last_fullsized":"2023-10-06T03:16:36.586388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.588640+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:16:37.588640+0000","last_peered":"2023-10-06T03:16:37.588640+0000","last_clean":"2023-10-06T03:16:37.588640+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:16:37.588640+0000","last_undegraded":"2023-10-06T03:16:37.588640+0000","last_fullsized":"2023-10-06T03:16:37.588640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.613614+0000","last_change":"2023-10-06T03:16:37.600184+0000","last_active":"2023-10-06T03:16:37.613614+0000","last_peered":"2023-10-06T03:16:37.613614+0000","last_clean":"2023-10-06T03:16:37.613614+0000","last_became_active":"2023-10-06T03:16:37.599869+0000","last_became_peered":"2023-10-06T03:16:37.599869+0000","last_unstale":"2023-10-06T03:16:37.613614+0000","last_undegraded":"2023-10-06T03:16:37.613614+0000","last_fullsized":"2023-10-06T03:16:37.613614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.913463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.591260+0000","last_change":"2023-10-06T03:16:36.597512+0000","last_active":"2023-10-06T03:16:37.591260+0000","last_peered":"2023-10-06T03:16:37.591260+0000","last_clean":"2023-10-06T03:16:37.591260+0000","last_became_active":"2023-10-06T03:16:36.597273+0000","last_became_peered":"2023-10-06T03:16:36.597273+0000","last_unstale":"2023-10-06T03:16:37.591260+0000","last_undegraded":"2023-10-06T03:16:37.591260+0000","last_fullsized":"2023-10-06T03:16:37.591260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:46.993350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.590330+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:16:37.590330+0000","last_peered":"2023-10-06T03:16:37.590330+0000","last_clean":"2023-10-06T03:16:37.590330+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:16:37.590330+0000","last_undegraded":"2023-10-06T03:16:37.590330+0000","last_fullsized":"2023-10-06T03:16:37.590330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.610920+0000","last_change":"2023-10-06T03:16:37.607733+0000","last_active":"2023-10-06T03:16:37.610920+0000","last_peered":"2023-10-06T03:16:37.610920+0000","last_clean":"2023-10-06T03:16:37.610920+0000","last_became_active":"2023-10-06T03:16:37.604271+0000","last_became_peered":"2023-10-06T03:16:37.604271+0000","last_unstale":"2023-10-06T03:16:37.610920+0000","last_undegraded":"2023-10-06T03:16:37.610920+0000","last_fullsized":"2023-10-06T03:16:37.610920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:35.766427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.589091+0000","last_change":"2023-10-06T03:16:36.601211+0000","last_active":"2023-10-06T03:16:37.589091+0000","last_peered":"2023-10-06T03:16:37.589091+0000","last_clean":"2023-10-06T03:16:37.589091+0000","last_became_active":"2023-10-06T03:16:36.600932+0000","last_became_peered":"2023-10-06T03:16:36.600932+0000","last_unstale":"2023-10-06T03:16:37.589091+0000","last_undegraded":"2023-10-06T03:16:37.589091+0000","last_fullsized":"2023-10-06T03:16:37.589091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:43.319761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.588536+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:16:37.588536+0000","last_peered":"2023-10-06T03:16:37.588536+0000","last_clean":"2023-10-06T03:16:37.588536+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:16:37.588536+0000","last_undegraded":"2023-10-06T03:16:37.588536+0000","last_fullsized":"2023-10-06T03:16:37.588536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.595439+0000","last_change":"2023-10-06T03:16:37.595439+0000","last_active":"2023-10-06T03:16:37.595439+0000","last_peered":"2023-10-06T03:16:37.595439+0000","last_clean":"2023-10-06T03:16:37.595439+0000","last_became_active":"2023-10-06T03:16:37.595193+0000","last_became_peered":"2023-10-06T03:16:37.595193+0000","last_unstale":"2023-10-06T03:16:37.595439+0000","last_undegraded":"2023-10-06T03:16:37.595439+0000","last_fullsized":"2023-10-06T03:16:37.595439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:43.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.584958+0000","last_change":"2023-10-06T03:16:36.601238+0000","last_active":"2023-10-06T03:16:37.584958+0000","last_peered":"2023-10-06T03:16:37.584958+0000","last_clean":"2023-10-06T03:16:37.584958+0000","last_became_active":"2023-10-06T03:16:36.600956+0000","last_became_peered":"2023-10-06T03:16:36.600956+0000","last_unstale":"2023-10-06T03:16:37.584958+0000","last_undegraded":"2023-10-06T03:16:37.584958+0000","last_fullsized":"2023-10-06T03:16:37.584958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:43.319761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.587067+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:16:37.587067+0000","last_peered":"2023-10-06T03:16:37.587067+0000","last_clean":"2023-10-06T03:16:37.587067+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:16:37.587067+0000","last_undegraded":"2023-10-06T03:16:37.587067+0000","last_fullsized":"2023-10-06T03:16:37.587067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.597620+0000","last_change":"2023-10-06T03:16:37.597620+0000","last_active":"2023-10-06T03:16:37.597620+0000","last_peered":"2023-10-06T03:16:37.597620+0000","last_clean":"2023-10-06T03:16:37.597620+0000","last_became_active":"2023-10-06T03:16:37.597400+0000","last_became_peered":"2023-10-06T03:16:37.597400+0000","last_unstale":"2023-10-06T03:16:37.597620+0000","last_undegraded":"2023-10-06T03:16:37.597620+0000","last_fullsized":"2023-10-06T03:16:37.597620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:46.496334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.600000+0000","last_change":"2023-10-06T03:16:36.596796+0000","last_active":"2023-10-06T03:16:36.600000+0000","last_peered":"2023-10-06T03:16:36.600000+0000","last_clean":"2023-10-06T03:16:36.600000+0000","last_became_active":"2023-10-06T03:16:36.596529+0000","last_became_peered":"2023-10-06T03:16:36.596529+0000","last_unstale":"2023-10-06T03:16:36.600000+0000","last_undegraded":"2023-10-06T03:16:36.600000+0000","last_fullsized":"2023-10-06T03:16:36.600000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:44.980760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.593517+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:16:36.593517+0000","last_peered":"2023-10-06T03:16:36.593517+0000","last_clean":"2023-10-06T03:16:36.593517+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:16:36.593517+0000","last_undegraded":"2023-10-06T03:16:36.593517+0000","last_fullsized":"2023-10-06T03:16:36.593517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.600701+0000","last_change":"2023-10-06T03:16:37.598828+0000","last_active":"2023-10-06T03:16:37.600701+0000","last_peered":"2023-10-06T03:16:37.600701+0000","last_clean":"2023-10-06T03:16:37.600701+0000","last_became_active":"2023-10-06T03:16:37.598573+0000","last_became_peered":"2023-10-06T03:16:37.598573+0000","last_unstale":"2023-10-06T03:16:37.600701+0000","last_undegraded":"2023-10-06T03:16:37.600701+0000","last_fullsized":"2023-10-06T03:16:37.600701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:36.576306+0000","last_clean_scrub_stamp":"2023-10-06T03:16:36.576306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:47.686372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:16:37.585328+0000","last_change":"2023-10-06T03:16:36.598981+0000","last_active":"2023-10-06T03:16:37.585328+0000","last_peered":"2023-10-06T03:16:37.585328+0000","last_clean":"2023-10-06T03:16:37.585328+0000","last_became_active":"2023-10-06T03:16:36.598734+0000","last_became_peered":"2023-10-06T03:16:36.598734+0000","last_unstale":"2023-10-06T03:16:37.585328+0000","last_undegraded":"2023-10-06T03:16:37.585328+0000","last_fullsized":"2023-10-06T03:16:37.585328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:16:35.571871+0000","last_clean_scrub_stamp":"2023-10-06T03:16:35.571871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:51.519145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:16:36.593558+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:16:36.593558+0000","last_peered":"2023-10-06T03:16:36.593558+0000","last_clean":"2023-10-06T03:16:36.593558+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:16:36.593558+0000","last_undegraded":"2023-10-06T03:16:36.593558+0000","last_fullsized":"2023-10-06T03:16:36.593558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":725115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":133695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.185}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":133211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":134711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:16:42.014 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:16:42.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:16:42.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.165+0000 7fb50c91b700 1 Processor -- start 2023-10-06T03:16:42.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.165+0000 7fb50c91b700 1 -- start start 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.166+0000 7fb50c91b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb508157c60 0x7fb5080aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.166+0000 7fb50c91b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5080b0460 0x7fb5080ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.166+0000 7fb50c91b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5080aee80 con 0x7fb5080cd160 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.166+0000 7fb50c91b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5080cd5c0 con 0x7fb5080b0460 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.166+0000 7fb50c91b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080af160 con 0x7fb508157c60 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.166+0000 7fb4fe59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5080b0460 0x7fb5080ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.166+0000 7fb4fe59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5080b0460 0x7fb5080ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52902/0 (socket says 172.21.15.82:52902) 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.166+0000 7fb4fe59c700 1 -- 172.21.15.82:0/2256317162 learned_addr learned my addr 172.21.15.82:0/2256317162 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb506d9d700 1 --2- 172.21.15.82:0/2256317162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb508157c60 0x7fb5080aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb4fe59c700 1 -- 172.21.15.82:0/2256317162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb508157c60 msgr2=0x7fb5080aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:42.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb4fe59c700 1 --2- 172.21.15.82:0/2256317162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb508157c60 0x7fb5080aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb4fe59c700 1 -- 172.21.15.82:0/2256317162 >> v1:172.21.15.134:6789/0 conn(0x7fb5080cd160 legacy=0x7fb508158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb4fe59c700 1 -- 172.21.15.82:0/2256317162 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080af440 con 0x7fb5080b0460 2023-10-06T03:16:42.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb506d9d700 1 --2- 172.21.15.82:0/2256317162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb508157c60 0x7fb5080aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:42.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb4fe59c700 1 --2- 172.21.15.82:0/2256317162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080b0460 0x7fb5080ccc20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00099b0 tx=0x7fb4f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfa9d4288ee42f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:42.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb50659c700 1 -- 172.21.15.82:0/2256317162 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000b860 con 0x7fb5080b0460 2023-10-06T03:16:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb50659c700 1 -- 172.21.15.82:0/2256317162 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f000b9c0 con 0x7fb5080b0460 2023-10-06T03:16:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb50659c700 1 -- 172.21.15.82:0/2256317162 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000bd60 con 0x7fb5080b0460 2023-10-06T03:16:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb50c91b700 1 -- 172.21.15.82:0/2256317162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080b0460 msgr2=0x7fb5080ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.167+0000 7fb50c91b700 1 --2- 172.21.15.82:0/2256317162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080b0460 0x7fb5080ccc20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00099b0 tx=0x7fb4f0009250 comp rx=0 tx=0).stop 2023-10-06T03:16:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.168+0000 7fb50c91b700 1 -- 172.21.15.82:0/2256317162 shutdown_connections 2023-10-06T03:16:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.168+0000 7fb50c91b700 1 --2- 172.21.15.82:0/2256317162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb508157c60 0x7fb5080aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.168+0000 7fb50c91b700 1 --2- 172.21.15.82:0/2256317162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080b0460 0x7fb5080ccc20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.168+0000 7fb50c91b700 1 -- 172.21.15.82:0/2256317162 >> 172.21.15.82:0/2256317162 conn(0x7fb5080ce310 msgr2=0x7fb5080ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.168+0000 7fb50c91b700 1 -- 172.21.15.82:0/2256317162 shutdown_connections 2023-10-06T03:16:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.168+0000 7fb50c91b700 1 -- 172.21.15.82:0/2256317162 wait complete. 2023-10-06T03:16:42.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.169+0000 7fb50c91b700 1 Processor -- start 2023-10-06T03:16:42.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.169+0000 7fb50c91b700 1 -- start start 2023-10-06T03:16:42.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50c91b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5080b0460 0x7fb50806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50c91b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5080cd160 0x7fb508168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50c91b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508157c60 0x7fb508166600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50c91b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50816a2c0 con 0x7fb508157c60 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50c91b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081696b0 con 0x7fb5080cd160 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50c91b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb508169990 con 0x7fb5080b0460 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508157c60 0x7fb508166600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508157c60 0x7fb508166600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52908/0 (socket says 172.21.15.82:52908) 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 -- 172.21.15.82:0/1360562000 learned_addr learned my addr 172.21.15.82:0/1360562000 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb506d9d700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5080b0460 0x7fb50806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb4fe59c700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5080cd160 0x7fb508168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 -- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5080b0460 msgr2=0x7fb50806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5080b0460 0x7fb50806bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 -- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5080cd160 msgr2=0x7fb508168ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5080cd160 0x7fb508168ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 -- 172.21.15.82:0/1360562000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00094f0 con 0x7fb508157c60 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50759e700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508157c60 0x7fb508166600 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb50000c8e0 tx=0x7fb500001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb4ff7fe700 1 -- 172.21.15.82:0/1360562000 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500012630 con 0x7fb508157c60 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb4ff7fe700 1 -- 172.21.15.82:0/1360562000 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500012790 con 0x7fb508157c60 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb4ff7fe700 1 -- 172.21.15.82:0/1360562000 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500012b50 con 0x7fb508157c60 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb508169c70 con 0x7fb508157c60 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.170+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50806c140 con 0x7fb508157c60 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.171+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50804c3c0 con 0x7fb508157c60 2023-10-06T03:16:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.172+0000 7fb4ff7fe700 1 -- 172.21.15.82:0/1360562000 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb50001a3a0 con 0x7fb508157c60 2023-10-06T03:16:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.172+0000 7fb4ff7fe700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb4e8066f60 0x7fb4e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.172+0000 7fb4ff7fe700 1 -- 172.21.15.82:0/1360562000 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb5000847d0 con 0x7fb508157c60 2023-10-06T03:16:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.172+0000 7fb506d9d700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb4e8066f60 0x7fb4e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.173+0000 7fb506d9d700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb4e8066f60 0x7fb4e8069410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb508157430 tx=0x7fb4f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.176+0000 7fb4ff7fe700 1 -- 172.21.15.82:0/1360562000 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb500055370 con 0x7fb508157c60 2023-10-06T03:16:42.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.430+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb5080af720 con 0x7fb508157c60 2023-10-06T03:16:42.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.433+0000 7fb4ff7fe700 1 -- 172.21.15.82:0/1360562000 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb500054f00 con 0x7fb508157c60 2023-10-06T03:16:42.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb4e8066f60 msgr2=0x7fb4e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb4e8066f60 0x7fb4e8069410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb508157430 tx=0x7fb4f8008040 comp rx=0 tx=0).stop 2023-10-06T03:16:42.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508157c60 msgr2=0x7fb508166600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508157c60 0x7fb508166600 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb50000c8e0 tx=0x7fb500001710 comp rx=0 tx=0).stop 2023-10-06T03:16:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 shutdown_connections 2023-10-06T03:16:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb508157c60 0x7fb508166600 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb4e8066f60 0x7fb4e8069410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5080b0460 0x7fb50806bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 --2- 172.21.15.82:0/1360562000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5080cd160 0x7fb508168ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 >> 172.21.15.82:0/1360562000 conn(0x7fb5080ce310 msgr2=0x7fb50806c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:42.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 shutdown_connections 2023-10-06T03:16:42.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.436+0000 7fb50c91b700 1 -- 172.21.15.82:0/1360562000 wait complete. 2023-10-06T03:16:42.442 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-10-06T03:16:42.450 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.563+0000 7fc6a0a0a700 1 Processor -- start 2023-10-06T03:16:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.563+0000 7fc6a0a0a700 1 -- start start 2023-10-06T03:16:42.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc6a0a0a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc69c0b0310 0x7fc69c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc6a0a0a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c069f70 con 0x7fc69c15d480 2023-10-06T03:16:42.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc6a0a0a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c0b0c90 con 0x7fc69c15d850 2023-10-06T03:16:42.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc6a0a0a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c0687c0 con 0x7fc69c0b0310 2023-10-06T03:16:42.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc69ad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc69c15d480 0x7fc69c069860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41716/0 (socket says 172.21.15.82:41716) 2023-10-06T03:16:42.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc69ad9d700 1 -- 172.21.15.82:0/573727157 learned_addr learned my addr 172.21.15.82:0/573727157 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc69b59e700 1 --2- 172.21.15.82:0/573727157 >> v2:172.21.15.134:3300/0 conn(0x7fc69c0b0310 0x7fc69c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc69a59c700 1 -- 172.21.15.82:0/573727157 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499634702 0 0) 0x7fc69c069f70 con 0x7fc69c15d480 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc69a59c700 1 -- 172.21.15.82:0/573727157 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc688003570 con 0x7fc69c15d480 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc69b59e700 1 -- 172.21.15.82:0/573727157 >> v1:172.21.15.134:6789/0 conn(0x7fc69c15d850 legacy=0x7fc69c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc69b59e700 1 -- 172.21.15.82:0/573727157 >> v1:172.21.15.82:6789/0 conn(0x7fc69c15d480 legacy=0x7fc69c069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.564+0000 7fc69b59e700 1 -- 172.21.15.82:0/573727157 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c068aa0 con 0x7fc69c0b0310 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc69b59e700 1 --2- 172.21.15.82:0/573727157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc69c0b0310 0x7fc69c0b0750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc694009e60 tx=0x7fc694009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eac000da1bff1a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc69a59c700 1 -- 172.21.15.82:0/573727157 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400e070 con 0x7fc69c0b0310 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc69a59c700 1 -- 172.21.15.82:0/573727157 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69400bb60 con 0x7fc69c0b0310 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc69a59c700 1 -- 172.21.15.82:0/573727157 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694012430 con 0x7fc69c0b0310 2023-10-06T03:16:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/573727157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc69c0b0310 msgr2=0x7fc69c0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc6a0a0a700 1 --2- 172.21.15.82:0/573727157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc69c0b0310 0x7fc69c0b0750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc694009e60 tx=0x7fc694009780 comp rx=0 tx=0).stop 2023-10-06T03:16:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/573727157 shutdown_connections 2023-10-06T03:16:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc6a0a0a700 1 --2- 172.21.15.82:0/573727157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc69c0b0310 0x7fc69c0b0750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/573727157 >> 172.21.15.82:0/573727157 conn(0x7fc69c0ccf80 msgr2=0x7fc69c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/573727157 shutdown_connections 2023-10-06T03:16:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.565+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/573727157 wait complete. 2023-10-06T03:16:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.566+0000 7fc6a0a0a700 1 Processor -- start 2023-10-06T03:16:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc6a0a0a700 1 -- start start 2023-10-06T03:16:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc6a0a0a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc69c0b0310 0x7fc69c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc6a0a0a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc69c15d480 0x7fc69c0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc6a0a0a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc69c15d850 0x7fc69c159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc6a0a0a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0c8810 con 0x7fc69c0b0310 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc6a0a0a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c16cda0 con 0x7fc69c15d850 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc6a0a0a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c16d080 con 0x7fc69c15d480 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc69ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc69c0b0310 0x7fc69c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc69ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc69c0b0310 0x7fc69c0ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52914/0 (socket says 172.21.15.82:52914) 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.567+0000 7fc69ad9d700 1 -- 172.21.15.82:0/3256825421 learned_addr learned my addr 172.21.15.82:0/3256825421 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc69ad9d700 1 -- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc69c15d480 msgr2=0x7fc69c0c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc69ad9d700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc69c15d480 0x7fc69c0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc69ad9d700 1 -- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc69c15d850 msgr2=0x7fc69c159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc69ad9d700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc69c15d850 0x7fc69c159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc69ad9d700 1 -- 172.21.15.82:0/3256825421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009a20 con 0x7fc69c0b0310 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc69ad9d700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc69c0b0310 0x7fc69c0ca4a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00c7c0 tx=0x7fc68c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc6937fe700 1 -- 172.21.15.82:0/3256825421 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c005b30 con 0x7fc69c0b0310 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc6937fe700 1 -- 172.21.15.82:0/3256825421 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c005c90 con 0x7fc69c0b0310 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c16d360 con 0x7fc69c0b0310 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc6937fe700 1 -- 172.21.15.82:0/3256825421 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c007340 con 0x7fc69c0b0310 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.568+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c16d920 con 0x7fc69c0b0310 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.569+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c04c3c0 con 0x7fc69c0b0310 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.569+0000 7fc6937fe700 1 -- 172.21.15.82:0/3256825421 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc68c01b400 con 0x7fc69c0b0310 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.570+0000 7fc6937fe700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc67c066f60 0x7fc67c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.570+0000 7fc6937fe700 1 -- 172.21.15.82:0/3256825421 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc68c0841d0 con 0x7fc69c0b0310 2023-10-06T03:16:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.570+0000 7fc69259c700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc67c066f60 0x7fc67c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.570+0000 7fc69259c700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc67c066f60 0x7fc67c069410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc69c140600 tx=0x7fc684007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.574+0000 7fc6937fe700 1 -- 172.21.15.82:0/3256825421 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc68c0512e0 con 0x7fc69c0b0310 2023-10-06T03:16:42.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.802+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc69c068d80 con 0x7fc69c0b0310 2023-10-06T03:16:42.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.803+0000 7fc6937fe700 1 -- 172.21.15.82:0/3256825421 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fc68c054900 con 0x7fc69c0b0310 2023-10-06T03:16:42.805 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:42.805 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/968017372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":968017372},{"type":"v1","addr":"172.21.15.134:6836","nonce":968017372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1664218192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1664218192},{"type":"v1","addr":"172.21.15.82:6834","nonce":1664218192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2857365191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":2857365191},{"type":"v1","addr":"172.21.15.82:6835","nonce":2857365191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:16:36.965976+0000","modified":"2023-10-06T03:16:40.600885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/4000888931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":4000888931},{"type":"v1","addr":"172.21.15.134:6837","nonce":4000888931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:16:42.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc67c066f60 msgr2=0x7fc67c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc67c066f60 0x7fc67c069410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc69c140600 tx=0x7fc684007b40 comp rx=0 tx=0).stop 2023-10-06T03:16:42.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc69c0b0310 msgr2=0x7fc69c0ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:42.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc69c0b0310 0x7fc69c0ca4a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00c7c0 tx=0x7fc68c007e00 comp rx=0 tx=0).stop 2023-10-06T03:16:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 shutdown_connections 2023-10-06T03:16:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc69c15d850 0x7fc69c159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc69c0b0310 0x7fc69c0ca4a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc67c066f60 0x7fc67c069410 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 --2- 172.21.15.82:0/3256825421 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc69c15d480 0x7fc69c0c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 >> 172.21.15.82:0/3256825421 conn(0x7fc69c0ccf80 msgr2=0x7fc69c1413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 shutdown_connections 2023-10-06T03:16:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:42.805+0000 7fc6a0a0a700 1 -- 172.21.15.82:0/3256825421 wait complete. 2023-10-06T03:16:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2023-10-06T03:16:43.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:16:36.965976+0000', 'modified': '2023-10-06T03:16:40.600885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5019}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5019': {'gid': 5019, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6837/4000888931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6835', 'nonce': 4000888931}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 4000888931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:16:43.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:16:43.222 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T03:16:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.339+0000 7fdc2f42a700 1 Processor -- start 2023-10-06T03:16:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.339+0000 7fdc2f42a700 1 -- start start 2023-10-06T03:16:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc2f42a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc2806b470 0x7fdc2815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc2f42a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc280ae340 con 0x7fdc280c80d0 2023-10-06T03:16:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc2f42a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc280afaa0 con 0x7fdc2806f270 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc2f42a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2815e290 con 0x7fdc2806b470 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc2d9c7700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdc280c80d0 0x7fdc28159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41728/0 (socket says 172.21.15.82:41728) 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1630944869 learned_addr learned my addr 172.21.15.82:0/1630944869 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/1630944869 >> v2:172.21.15.134:3300/0 conn(0x7fdc2806b470 0x7fdc2815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135103068 0 0) 0x7fdc280ae340 con 0x7fdc280c80d0 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc14003570 con 0x7fdc280c80d0 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782727773 0 0) 0x7fdc14003570 con 0x7fdc280c80d0 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 >> v2:172.21.15.134:3300/0 conn(0x7fdc2806b470 msgr2=0x7fdc2815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 --2- 172.21.15.82:0/1630944869 >> v2:172.21.15.134:3300/0 conn(0x7fdc2806b470 0x7fdc2815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 >> v1:172.21.15.134:6789/0 conn(0x7fdc2806f270 legacy=0x7fdc280c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2806b840 con 0x7fdc280c80d0 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fdc200017f0 con 0x7fdc280c80d0 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 >> v1:172.21.15.82:6789/0 conn(0x7fdc280c80d0 legacy=0x7fdc28159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc14003a60 0x7fdc14003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc14004810 0x7fdc14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc140051c0 0x7fdc1400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2815e290 con 0x7fdc140051c0 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1400c0d0 con 0x7fdc14003a60 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.340+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1400c290 con 0x7fdc14004810 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc140051c0 0x7fdc1400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc14003a60 0x7fdc14003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc14004810 0x7fdc14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc14004810 msgr2=0x7fdc14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc14004810 0x7fdc14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc14003a60 msgr2=0x7fdc14003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc14003a60 0x7fdc14003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1630944869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc14003570 con 0x7fdc140051c0 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc14003a60 0x7fdc14003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1630944869 reap_dead start 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc140051c0 0x7fdc1400ba60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000a900 tx=0x7fdc200021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32451b13e4fe4b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200070d0 con 0x7fdc140051c0 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20007230 con 0x7fdc140051c0 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.341+0000 7fdc1ffff700 1 -- 172.21.15.82:0/1630944869 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200075d0 con 0x7fdc140051c0 2023-10-06T03:16:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.342+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1630944869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc140051c0 msgr2=0x7fdc1400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.342+0000 7fdc2f42a700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc140051c0 0x7fdc1400ba60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000a900 tx=0x7fdc200021d0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.342+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1630944869 shutdown_connections 2023-10-06T03:16:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.342+0000 7fdc2f42a700 1 --2- 172.21.15.82:0/1630944869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc140051c0 0x7fdc1400ba60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.342+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1630944869 >> 172.21.15.82:0/1630944869 conn(0x7fdc2806e760 msgr2=0x7fdc2806eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.342+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1630944869 shutdown_connections 2023-10-06T03:16:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.342+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1630944869 wait complete. 2023-10-06T03:16:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.343+0000 7fdc2f42a700 1 Processor -- start 2023-10-06T03:16:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.343+0000 7fdc2f42a700 1 -- start start 2023-10-06T03:16:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2f42a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc140051c0 0x7fdc2815c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2f42a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc28157fc0 0x7fdc28158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2f42a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc280b1230 0x7fdc280b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2f42a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28158970 con 0x7fdc280b1230 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2f42a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280b1f60 con 0x7fdc140051c0 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2f42a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280b2240 con 0x7fdc28157fc0 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc280b1230 0x7fdc280b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc280b1230 0x7fdc280b16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52926/0 (socket says 172.21.15.82:52926) 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1528730518 learned_addr learned my addr 172.21.15.82:0/1528730518 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc140051c0 0x7fdc2815c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc28157fc0 0x7fdc28158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc28157fc0 msgr2=0x7fdc28158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc28157fc0 0x7fdc28158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc140051c0 msgr2=0x7fdc2815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc140051c0 0x7fdc2815c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/1528730518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280b2520 con 0x7fdc280b1230 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc280b1230 0x7fdc280b16d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000a900 tx=0x7fdc20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.344+0000 7fdc1d7fa700 1 -- 172.21.15.82:0/1528730518 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20001250 con 0x7fdc280b1230 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.345+0000 7fdc1d7fa700 1 -- 172.21.15.82:0/1528730518 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc200017f0 con 0x7fdc280b1230 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.345+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1528730518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc280b2800 con 0x7fdc280b1230 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.345+0000 7fdc1d7fa700 1 -- 172.21.15.82:0/1528730518 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2001d880 con 0x7fdc280b1230 2023-10-06T03:16:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.345+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1528730518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc280b1c10 con 0x7fdc280b1230 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.346+0000 7fdc1d7fa700 1 -- 172.21.15.82:0/1528730518 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc2001dbf0 con 0x7fdc280b1230 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.346+0000 7fdc1d7fa700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc0c066f30 0x7fdc0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.346+0000 7fdc1d7fa700 1 -- 172.21.15.82:0/1528730518 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc20086810 con 0x7fdc280b1230 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.346+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc0c066f30 0x7fdc0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.347+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc0c066f30 0x7fdc0c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009720 tx=0x7fdc240091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.348+0000 7fdc38722b80 1 Processor -- start 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.348+0000 7fdc38722b80 1 -- start start 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 0x55fb92e2cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2dcc0 0x55fb92e7c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 0x55fb92e7d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc38722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb92d83a70 con 0x55fb92e2dcc0 2023-10-06T03:16:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc38722b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb92d81270 con 0x55fb92e2c840 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc38722b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb92d7d060 con 0x55fb92e7cc00 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2dcc0 0x55fb92e7c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2dcc0 0x55fb92e7c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52940/0 (socket says 172.21.15.82:52940) 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 -- 172.21.15.82:0/3836905413 learned_addr learned my addr 172.21.15.82:0/3836905413 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 0x55fb92e2cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 0x55fb92e7d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 -- 172.21.15.82:0/3836905413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 msgr2=0x55fb92e7d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 0x55fb92e7d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 -- 172.21.15.82:0/3836905413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 msgr2=0x55fb92e2cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 0x55fb92e2cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 -- 172.21.15.82:0/3836905413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb92c17270 con 0x55fb92e2dcc0 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2dcc0 0x55fb92e7c6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdc180038e0 tx=0x7fdc18007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de667b30bab34b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.349+0000 7fdc127fc700 1 -- 172.21.15.82:0/3836905413 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18012780 con 0x55fb92e2dcc0 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc127fc700 1 -- 172.21.15.82:0/3836905413 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180128e0 con 0x55fb92e2dcc0 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc127fc700 1 -- 172.21.15.82:0/3836905413 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18012c60 con 0x55fb92e2dcc0 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 -- 172.21.15.82:0/3836905413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2dcc0 msgr2=0x55fb92e7c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2dcc0 0x55fb92e7c6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdc180038e0 tx=0x7fdc18007d30 comp rx=0 tx=0).stop 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 -- 172.21.15.82:0/3836905413 shutdown_connections 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 0x55fb92e7d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 0x55fb92e2cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3836905413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2dcc0 0x55fb92e7c6c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 -- 172.21.15.82:0/3836905413 >> 172.21.15.82:0/3836905413 conn(0x55fb92e2e160 msgr2=0x55fb92e2e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 -- 172.21.15.82:0/3836905413 shutdown_connections 2023-10-06T03:16:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.350+0000 7fdc38722b80 1 -- 172.21.15.82:0/3836905413 wait complete. 2023-10-06T03:16:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.351+0000 7fdc38722b80 1 -- start start 2023-10-06T03:16:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.351+0000 7fdc38722b80 1 Processor -- start 2023-10-06T03:16:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92e6b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2dcc0 0x55fb92e6b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 0x55fb92e6bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc38722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb92d28890 con 0x55fb92e2c840 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc38722b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb92d43ea0 con 0x55fb92e2dcc0 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc38722b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb92bffe30 con 0x55fb92e7cc00 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc38722b80 10 client.0 _ll_register_callbacks cb 0x55fb92defe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92e6b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92e6b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52956/0 (socket says 172.21.15.82:52956) 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 -- 172.21.15.82:0/3194708771 learned_addr learned my addr 172.21.15.82:0/3194708771 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2dcc0 0x55fb92e6b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 0x55fb92e6bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 -- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 msgr2=0x55fb92e6bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 0x55fb92e6bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 -- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2dcc0 msgr2=0x55fb92e6b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2dcc0 0x55fb92e6b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 -- 172.21.15.82:0/3194708771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc280afaa0 con 0x55fb92e2c840 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92e6b130 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdc24015bc0 tx=0x7fdc2401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23680fbafc21e4ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc077fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc077fe700 1 -- 172.21.15.82:0/3194708771 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240227e0 con 0x55fb92e2c840 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc077fe700 1 -- 172.21.15.82:0/3194708771 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc2402dc50 con 0x55fb92e2c840 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.352+0000 7fdc38722b80 1 -- 172.21.15.82:0/3194708771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb92e21940 con 0x55fb92e2c840 2023-10-06T03:16:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc077fe700 1 -- 172.21.15.82:0/3194708771 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc2402de50 con 0x55fb92e2c840 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc38722b80 10 client.5211 fetch_fsmap learned FSMap version 15 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc38722b80 1 -- 172.21.15.82:0/3194708771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55fb92bb9fe0 con 0x55fb92e2c840 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc077fe700 1 -- 172.21.15.82:0/3194708771 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb92e21940 con 0x55fb92e2c840 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc077fe700 1 -- 172.21.15.82:0/3194708771 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdc2401d070 con 0x55fb92e2c840 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc38722b80 10 client.5211 fetch_fsmap finished waiting for FSMap version 15 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc38722b80 10 client.5211 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc38722b80 20 client.5211 populate_metadata read hostname 'smithi082' 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] conn(0x55fb92e5c120 0x55fb92e5c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc38722b80 4 client.5211 mds_command: new command op to 5019 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc38722b80 1 -- 172.21.15.82:0/3194708771 --> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb92dfe870 con 0x55fb92e5c120 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] conn(0x55fb92e5c120 0x55fb92e5c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc077fe700 10 client.5211 ms_handle_connect on v2:172.21.15.134:6835/4000888931 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.353+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] conn(0x55fb92e5c120 0x55fb92e5c4f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5144d31bb61ad63 server_cookie=fd33021fcad8d31b in_seq=0 out_seq=0 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.354+0000 7fdc077fe700 1 -- 172.21.15.82:0/3194708771 <== mds.0 v2:172.21.15.134:6835/4000888931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55fb92dfe870 con 0x55fb92e5c120 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.354+0000 7fdc077fe700 10 client.5211 handle_command_reply: tid=0 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.354+0000 7fdc38722b80 1 client.5211 shutdown 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.354+0000 7fdc38722b80 1 -- 172.21.15.82:0/3194708771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 msgr2=0x55fb92e6b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.354+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92e6b130 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdc24015bc0 tx=0x7fdc2401c000 comp rx=0 tx=0).stop 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.354+0000 7fdc38722b80 1 -- 172.21.15.82:0/3194708771 shutdown_connections 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.354+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] conn(0x55fb92e5c120 0x55fb92e5c4f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.355+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e7cc00 0x55fb92e6bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.355+0000 7fdc077fe700 0 client.5211 ms_handle_reset on v2:172.21.15.134:6835/4000888931 2023-10-06T03:16:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.355+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92e6b130 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.355+0000 7fdc38722b80 1 --2- 172.21.15.82:0/3194708771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2dcc0 0x55fb92e6b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.355+0000 7fdc38722b80 1 -- 172.21.15.82:0/3194708771 >> 172.21.15.82:0/3194708771 conn(0x55fb92e2e160 msgr2=0x55fb92e2d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.355+0000 7fdc38722b80 1 -- 172.21.15.82:0/3194708771 shutdown_connections 2023-10-06T03:16:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.355+0000 7fdc38722b80 1 -- 172.21.15.82:0/3194708771 wait complete. 2023-10-06T03:16:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.355+0000 7fdc38722b80 20 client.5211 trim_cache size 0 max 16384 2023-10-06T03:16:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.371+0000 7fdc38722b80 1 Processor -- start 2023-10-06T03:16:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.371+0000 7fdc38722b80 1 -- start start 2023-10-06T03:16:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 0x55fb92e2eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 0x55fb92e70490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e7cc00 0x55fb92e709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc38722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb92e70330 con 0x55fb92e7cc00 2023-10-06T03:16:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc38722b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb92e948a0 con 0x55fb92e2c840 2023-10-06T03:16:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc38722b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb92e55af0 con 0x55fb92e2dcc0 2023-10-06T03:16:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e7cc00 0x55fb92e709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e7cc00 0x55fb92e709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52964/0 (socket says 172.21.15.82:52964) 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/4217524005 learned_addr learned my addr 172.21.15.82:0/4217524005 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/4217524005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 msgr2=0x55fb92e70490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/4217524005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 0x55fb92e70490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/4217524005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 msgr2=0x55fb92e2eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/4217524005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 0x55fb92e2eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 -- 172.21.15.82:0/4217524005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb92d4b780 con 0x55fb92e7cc00 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/4217524005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e7cc00 0x55fb92e709d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c210 tx=0x7fdc2005a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a58aad81d4adc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc12ffd700 1 -- 172.21.15.82:0/4217524005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2001dea0 con 0x55fb92e7cc00 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc12ffd700 1 -- 172.21.15.82:0/4217524005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20057ce0 con 0x55fb92e7cc00 2023-10-06T03:16:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.372+0000 7fdc12ffd700 1 -- 172.21.15.82:0/4217524005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200575e0 con 0x55fb92e7cc00 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 -- 172.21.15.82:0/4217524005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e7cc00 msgr2=0x55fb92e709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 --2- 172.21.15.82:0/4217524005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e7cc00 0x55fb92e709d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c210 tx=0x7fdc2005a040 comp rx=0 tx=0).stop 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 -- 172.21.15.82:0/4217524005 shutdown_connections 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 --2- 172.21.15.82:0/4217524005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e7cc00 0x55fb92e709d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 --2- 172.21.15.82:0/4217524005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e2c840 0x55fb92e2eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 --2- 172.21.15.82:0/4217524005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 0x55fb92e70490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 -- 172.21.15.82:0/4217524005 >> 172.21.15.82:0/4217524005 conn(0x55fb92e2e160 msgr2=0x55fb92e2d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 -- 172.21.15.82:0/4217524005 shutdown_connections 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 -- 172.21.15.82:0/4217524005 wait complete. 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.373+0000 7fdc38722b80 1 -- start start 2023-10-06T03:16:43.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc38722b80 1 Processor -- start 2023-10-06T03:16:43.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92ed2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 0x55fb92e74e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc38722b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e7cc00 0x55fb92e8b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc38722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb92e5a850 con 0x55fb92e2c840 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc38722b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb92ed30f0 con 0x55fb92e7cc00 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc38722b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb92e7bb10 con 0x55fb92e2dcc0 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc38722b80 10 client.0 _ll_register_callbacks cb 0x55fb92defe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.374+0000 7fdc2d1c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92ed2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d1c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92ed2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52976/0 (socket says 172.21.15.82:52976) 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d1c6700 1 -- 172.21.15.82:0/2998952253 learned_addr learned my addr 172.21.15.82:0/2998952253 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 0x55fb92e74e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e7cc00 0x55fb92e8b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d1c6700 1 -- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 msgr2=0x55fb92e74e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 0x55fb92e74e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d1c6700 1 -- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e7cc00 msgr2=0x55fb92e8b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e7cc00 0x55fb92e8b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d1c6700 1 -- 172.21.15.82:0/2998952253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc280b1c10 con 0x55fb92e2c840 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d9c7700 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e7cc00 0x55fb92e8b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc2d1c6700 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92ed2bb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdc24015b90 tx=0x7fdc2401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdb0bb0ae4fc313 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc077fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc077fe700 1 -- 172.21.15.82:0/2998952253 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24022e40 con 0x55fb92e2c840 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc077fe700 1 -- 172.21.15.82:0/2998952253 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc24036680 con 0x55fb92e2c840 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc38722b80 1 -- 172.21.15.82:0/2998952253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc180128e0 con 0x55fb92e2c840 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc077fe700 1 -- 172.21.15.82:0/2998952253 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc24036a90 con 0x55fb92e2c840 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc38722b80 10 client.5217 fetch_fsmap learned FSMap version 15 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc38722b80 1 -- 172.21.15.82:0/2998952253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55fb92d32470 con 0x55fb92e2c840 2023-10-06T03:16:43.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc077fe700 1 -- 172.21.15.82:0/2998952253 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180128e0 con 0x55fb92e2c840 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc077fe700 1 -- 172.21.15.82:0/2998952253 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdc24036bf0 con 0x55fb92e2c840 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc38722b80 10 client.5217 fetch_fsmap finished waiting for FSMap version 15 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.375+0000 7fdc38722b80 10 client.5217 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc38722b80 20 client.5217 populate_metadata read hostname 'smithi082' 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc38722b80 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] conn(0x55fb92ed92f0 0x55fb92ed96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc38722b80 4 client.5217 mds_command: new command op to 5019 tid=0[{"prefix": "status"}] 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc38722b80 1 -- 172.21.15.82:0/2998952253 --> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fb92d1fe00 con 0x55fb92ed92f0 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] conn(0x55fb92ed92f0 0x55fb92ed96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc077fe700 10 client.5217 ms_handle_connect on v2:172.21.15.134:6835/4000888931 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc2c9c5700 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] conn(0x55fb92ed92f0 0x55fb92ed96c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=911729e54b24ed36 server_cookie=fdce1a3655014dbb in_seq=0 out_seq=0 2023-10-06T03:16:43.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc077fe700 1 -- 172.21.15.82:0/2998952253 <== mds.0 v2:172.21.15.134:6835/4000888931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55fb92d1fe00 con 0x55fb92ed92f0 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc077fe700 10 client.5217 handle_command_reply: tid=0 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc38722b80 1 client.5217 shutdown 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc38722b80 1 -- 172.21.15.82:0/2998952253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 msgr2=0x55fb92ed2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.376+0000 7fdc38722b80 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92ed2bb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdc24015b90 tx=0x7fdc2401d000 comp rx=0 tx=0).stop 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 1 -- 172.21.15.82:0/2998952253 shutdown_connections 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:6835/4000888931,v1:172.21.15.134:6837/4000888931] conn(0x55fb92ed92f0 0x55fb92ed96c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fb92e7cc00 0x55fb92e8b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc077fe700 0 client.5217 ms_handle_reset on v2:172.21.15.134:6835/4000888931 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb92e2c840 0x55fb92ed2bb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 1 --2- 172.21.15.82:0/2998952253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55fb92e2dcc0 0x55fb92e74e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 1 -- 172.21.15.82:0/2998952253 >> 172.21.15.82:0/2998952253 conn(0x55fb92e2e160 msgr2=0x55fb92e56d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:43.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 1 -- 172.21.15.82:0/2998952253 shutdown_connections 2023-10-06T03:16:43.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 1 -- 172.21.15.82:0/2998952253 wait complete. 2023-10-06T03:16:43.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc38722b80 20 client.5217 trim_cache size 0 max 16384 2023-10-06T03:16:43.386 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:16:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "968d6894-b90c-4b96-8e67-09d8a805d810", 2023-10-06T03:16:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-10-06T03:16:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5019, 2023-10-06T03:16:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-10-06T03:16:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-10-06T03:16:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-10-06T03:16:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 5.7832357779999999, 2023-10-06T03:16:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 15, 2023-10-06T03:16:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 31, 2023-10-06T03:16:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 31, 2023-10-06T03:16:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 13.669025427999999 2023-10-06T03:16:43.387 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:16:43.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc0c066f30 msgr2=0x7fdc0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc0c066f30 0x7fdc0c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009720 tx=0x7fdc240091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1528730518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc280b1230 msgr2=0x7fdc280b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc280b1230 0x7fdc280b16d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000a900 tx=0x7fdc20016000 comp rx=0 tx=0).stop 2023-10-06T03:16:43.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1528730518 shutdown_connections 2023-10-06T03:16:43.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc280b1230 0x7fdc280b16d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc140051c0 0x7fdc2815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc0c066f30 0x7fdc0c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 --2- 172.21.15.82:0/1528730518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc28157fc0 0x7fdc28158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1528730518 >> 172.21.15.82:0/1528730518 conn(0x7fdc2806e760 msgr2=0x7fdc2806eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:43.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1528730518 shutdown_connections 2023-10-06T03:16:43.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.377+0000 7fdc2f42a700 1 -- 172.21.15.82:0/1528730518 wait complete. 2023-10-06T03:16:43.391 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:16:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.502+0000 7f9b2122d700 1 Processor -- start 2023-10-06T03:16:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.502+0000 7f9b2122d700 1 -- start start 2023-10-06T03:16:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b2122d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b1c0b5600 0x7f9b1c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b2122d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0b2ad0 con 0x7f9b1c15d930 2023-10-06T03:16:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b2122d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0b4160 con 0x7f9b1c15d560 2023-10-06T03:16:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b2122d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b2230 con 0x7f9b1c0b5600 2023-10-06T03:16:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b1b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b1c0b5600 0x7f9b1c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b1259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9b1c15d930 0x7f9b1c1591b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41742/0 (socket says 172.21.15.82:41742) 2023-10-06T03:16:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b1259c700 1 -- 172.21.15.82:0/1744925468 learned_addr learned my addr 172.21.15.82:0/1744925468 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b1b59e700 1 -- 172.21.15.82:0/1744925468 >> v1:172.21.15.134:6789/0 conn(0x7f9b1c15d560 legacy=0x7f9b1c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b1b59e700 1 -- 172.21.15.82:0/1744925468 >> v1:172.21.15.82:6789/0 conn(0x7f9b1c15d930 legacy=0x7f9b1c1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.503+0000 7f9b1b59e700 1 -- 172.21.15.82:0/1744925468 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0b2510 con 0x7f9b1c0b5600 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b1b59e700 1 --2- 172.21.15.82:0/1744925468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c0b5600 0x7f9b1c0d0030 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009e60 tx=0x7f9b14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52c6efd7ba9d9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b1a59c700 1 -- 172.21.15.82:0/1744925468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400e070 con 0x7f9b1c0b5600 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b1a59c700 1 -- 172.21.15.82:0/1744925468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400bc30 con 0x7f9b1c0b5600 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b1a59c700 1 -- 172.21.15.82:0/1744925468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14012430 con 0x7f9b1c0b5600 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b2122d700 1 -- 172.21.15.82:0/1744925468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c0b5600 msgr2=0x7f9b1c0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b2122d700 1 --2- 172.21.15.82:0/1744925468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c0b5600 0x7f9b1c0d0030 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009e60 tx=0x7f9b14009780 comp rx=0 tx=0).stop 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b2122d700 1 -- 172.21.15.82:0/1744925468 shutdown_connections 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b2122d700 1 --2- 172.21.15.82:0/1744925468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c0b5600 0x7f9b1c0d0030 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b2122d700 1 -- 172.21.15.82:0/1744925468 >> 172.21.15.82:0/1744925468 conn(0x7f9b1c0d1180 msgr2=0x7f9b1c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b2122d700 1 -- 172.21.15.82:0/1744925468 shutdown_connections 2023-10-06T03:16:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.504+0000 7f9b2122d700 1 -- 172.21.15.82:0/1744925468 wait complete. 2023-10-06T03:16:43.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.505+0000 7f9b2122d700 1 Processor -- start 2023-10-06T03:16:43.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.505+0000 7f9b2122d700 1 -- start start 2023-10-06T03:16:43.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b2122d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b1c0b5600 0x7f9b1c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b2122d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c15d560 0x7f9b1c0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b2122d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b1c15d930 0x7f9b1c14a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b2122d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c15b5e0 con 0x7f9b1c15d560 2023-10-06T03:16:43.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b2122d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0c6770 con 0x7f9b1c15d930 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b2122d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0c7b10 con 0x7f9b1c0b5600 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b1259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c15d560 0x7f9b1c0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b1259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c15d560 0x7f9b1c0c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52996/0 (socket says 172.21.15.82:52996) 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b1259c700 1 -- 172.21.15.82:0/2611462259 learned_addr learned my addr 172.21.15.82:0/2611462259 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b1b59e700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b1c15d930 0x7f9b1c14a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.506+0000 7f9b1ad9d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b1c0b5600 0x7f9b1c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b1259c700 1 -- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b1c0b5600 msgr2=0x7f9b1c0c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b1259c700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b1c0b5600 0x7f9b1c0c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b1259c700 1 -- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b1c15d930 msgr2=0x7f9b1c14a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b1259c700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b1c15d930 0x7f9b1c14a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b1259c700 1 -- 172.21.15.82:0/2611462259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14009a20 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b1b59e700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b1c15d930 0x7f9b1c14a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b1259c700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c15d560 0x7f9b1c0c6230 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400c560 tx=0x7f9b04001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b137fe700 1 -- 172.21.15.82:0/2611462259 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04005b30 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b137fe700 1 -- 172.21.15.82:0/2611462259 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04005cb0 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c0c7df0 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b137fe700 1 -- 172.21.15.82:0/2611462259 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04007320 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.507+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c14a640 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.508+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c0c68e0 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.508+0000 7f9b137fe700 1 -- 172.21.15.82:0/2611462259 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b0401b3b0 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.508+0000 7f9b137fe700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9afc066f30 0x7f9afc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.509+0000 7f9b137fe700 1 -- 172.21.15.82:0/2611462259 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b04083b10 con 0x7f9b1c15d560 2023-10-06T03:16:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.509+0000 7f9b1ad9d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9afc066f30 0x7f9afc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.509+0000 7f9b1ad9d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9afc066f30 0x7f9afc0693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c003880 tx=0x7f9b0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.513+0000 7f9b137fe700 1 -- 172.21.15.82:0/2611462259 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b04050c20 con 0x7f9b1c15d560 2023-10-06T03:16:43.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.740+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9b1c15b0d0 con 0x7f9b1c15d560 2023-10-06T03:16:43.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.740+0000 7f9b137fe700 1 -- 172.21.15.82:0/2611462259 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9b1c15b0d0 con 0x7f9b1c15d560 2023-10-06T03:16:43.742 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:16:43.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9afc066f30 msgr2=0x7f9afc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9afc066f30 0x7f9afc0693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c003880 tx=0x7f9b0c009040 comp rx=0 tx=0).stop 2023-10-06T03:16:43.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c15d560 msgr2=0x7f9b1c0c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:43.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c15d560 0x7f9b1c0c6230 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400c560 tx=0x7f9b04001020 comp rx=0 tx=0).stop 2023-10-06T03:16:43.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 shutdown_connections 2023-10-06T03:16:43.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b1c15d930 0x7f9b1c14a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9afc066f30 0x7f9afc0693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b1c0b5600 0x7f9b1c0c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 --2- 172.21.15.82:0/2611462259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1c15d560 0x7f9b1c0c6230 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:43.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 >> 172.21.15.82:0/2611462259 conn(0x7f9b1c0d1180 msgr2=0x7f9b1c155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:43.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 shutdown_connections 2023-10-06T03:16:43.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:43.742+0000 7f9b2122d700 1 -- 172.21.15.82:0/2611462259 wait complete. 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:16:43.756 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:16:43.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:43.757 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-10-06T03:16:43.771 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42459sec preferred_lft 42459sec 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 36:95:8d:ad:89:e0 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:16:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::8c5f:c4ff:fe3a:9eac/64 scope link 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether be:dd:8c:84:42:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::bcdd:8cff:fe84:42c0/64 scope link 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 36:95:8d:ad:89:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::3495:8dff:fead:89e0/64 scope link 2023-10-06T03:16:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:43.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:43.775 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:16:43.834 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-10-06T03:16:43.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:43.836 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-10-06T03:16:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-10-06T03:16:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:16:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:16:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:16:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:16:43.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:43.893 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:16:43.893 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:16:43.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:16:43.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:16:43.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:16:43.893 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:16:43.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:43.992 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:16:44.006 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:16:44.006 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:16:44.006 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:16:44.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:44.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-10-06T03:16:44.070 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:44.071 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:44.125 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:16:44.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:44.125 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:44.179 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:16:44.180 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:16:44.180 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:16:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:16:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:16:44.259 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:16:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:16:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:16:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:16:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:16:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:44.290 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:16:44.291 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:16:44.291 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:16:44.292 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:16:44.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:44.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:44.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:16:44.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.510+0000 7fdad2577700 1 Processor -- start 2023-10-06T03:16:44.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.510+0000 7fdad2577700 1 -- start start 2023-10-06T03:16:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdad2577700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdacc15d560 0x7fdacc0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdad2577700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 0x7fdacc0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdad2577700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc0b2ad0 con 0x7fdacc1591b0 2023-10-06T03:16:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdad2577700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0b4160 con 0x7fdacc15d560 2023-10-06T03:16:44.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdad2577700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0b1f80 con 0x7fdacc15d930 2023-10-06T03:16:44.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdad0b14700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdacc1591b0 0x7fdacc159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41758/0 (socket says 172.21.15.82:41758) 2023-10-06T03:16:44.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdad0b14700 1 -- 172.21.15.82:0/525654625 learned_addr learned my addr 172.21.15.82:0/525654625 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:44.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacb7fe700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 0x7fdacc0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacbfff700 1 --2- 172.21.15.82:0/525654625 >> v2:172.21.15.134:3300/0 conn(0x7fdacc15d560 0x7fdacc0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639022175 0 0) 0x7fdacc0b2ad0 con 0x7fdacc1591b0 2023-10-06T03:16:44.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab4003570 con 0x7fdacc1591b0 2023-10-06T03:16:44.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2035961283 0 0) 0x7fdab4003570 con 0x7fdacc1591b0 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 msgr2=0x7fdacc0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacaffd700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 0x7fdacc0b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 >> v2:172.21.15.134:3300/0 conn(0x7fdacc15d560 msgr2=0x7fdacc0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacaffd700 1 --2- 172.21.15.82:0/525654625 >> v2:172.21.15.134:3300/0 conn(0x7fdacc15d560 0x7fdacc0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.511+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0b2230 con 0x7fdacc1591b0 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fdac40017f0 con 0x7fdacc1591b0 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 >> v1:172.21.15.82:6789/0 conn(0x7fdacc1591b0 legacy=0x7fdacc159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab4003a60 0x7fdab4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 0x7fdab4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4004d50 0x7fdab40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0b4160 con 0x7fdab4003a60 2023-10-06T03:16:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0b1f80 con 0x7fdab4004d50 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab400ba60 con 0x7fdacc15d930 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacbfff700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab4003a60 0x7fdab4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacb7fe700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 0x7fdab4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdad0b14700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4004d50 0x7fdab40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacbfff700 1 -- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 msgr2=0x7fdab4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacbfff700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 0x7fdab4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacbfff700 1 -- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4004d50 msgr2=0x7fdab40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacbfff700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4004d50 0x7fdab40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacbfff700 1 -- 172.21.15.82:0/525654625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4003570 con 0x7fdab4003a60 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacb7fe700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc15d930 0x7fdab4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacbfff700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab4003a60 0x7fdab4003e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009c00 tx=0x7fdabc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e2a745ad1f949a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00e6b0 con 0x7fdab4003a60 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00e810 con 0x7fdab4003a60 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.512+0000 7fdacaffd700 1 -- 172.21.15.82:0/525654625 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00ebd0 con 0x7fdab4003a60 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.513+0000 7fdad2577700 1 -- 172.21.15.82:0/525654625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab4003a60 msgr2=0x7fdab4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.513+0000 7fdad2577700 1 --2- 172.21.15.82:0/525654625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab4003a60 0x7fdab4003e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009c00 tx=0x7fdabc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.513+0000 7fdad0b14700 1 -- 172.21.15.82:0/525654625 reap_dead start 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.513+0000 7fdad2577700 1 -- 172.21.15.82:0/525654625 shutdown_connections 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.513+0000 7fdad2577700 1 -- 172.21.15.82:0/525654625 >> 172.21.15.82:0/525654625 conn(0x7fdacc0d1180 msgr2=0x7fdacc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.513+0000 7fdad2577700 1 -- 172.21.15.82:0/525654625 shutdown_connections 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.513+0000 7fdad2577700 1 -- 172.21.15.82:0/525654625 wait complete. 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.514+0000 7fdad2577700 1 Processor -- start 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.514+0000 7fdad2577700 1 -- start start 2023-10-06T03:16:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad2577700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4003a60 0x7fdacc151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad2577700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc14fb90 0x7fdacc14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad2577700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc16d8a0 0x7fdacc0b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad2577700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc16d410 con 0x7fdacc16d8a0 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad2577700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1526d0 con 0x7fdab4003a60 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad2577700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1529b0 con 0x7fdacc14fb90 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc16d8a0 0x7fdacc0b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc16d8a0 0x7fdacc0b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53024/0 (socket says 172.21.15.82:53024) 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 -- 172.21.15.82:0/3667815878 learned_addr learned my addr 172.21.15.82:0/3667815878 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdacbfff700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4003a60 0x7fdacc151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdacb7fe700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc14fb90 0x7fdacc14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 -- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc14fb90 msgr2=0x7fdacc14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc14fb90 0x7fdacc14c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 -- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4003a60 msgr2=0x7fdacc151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4003a60 0x7fdacc151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 -- 172.21.15.82:0/3667815878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc16d0a0 con 0x7fdacc16d8a0 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdad0b14700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc16d8a0 0x7fdacc0b5670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdacc15e440 tx=0x7fdacc0d0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdab3fff700 1 -- 172.21.15.82:0/3667815878 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400e900 con 0x7fdacc16d8a0 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.515+0000 7fdab3fff700 1 -- 172.21.15.82:0/3667815878 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400ea80 con 0x7fdacc16d8a0 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.516+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc150000 con 0x7fdacc16d8a0 2023-10-06T03:16:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.516+0000 7fdab3fff700 1 -- 172.21.15.82:0/3667815878 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400ee40 con 0x7fdacc16d8a0 2023-10-06T03:16:44.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.516+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc152c90 con 0x7fdacc16d8a0 2023-10-06T03:16:44.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.516+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc064050 con 0x7fdacc16d8a0 2023-10-06T03:16:44.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.517+0000 7fdab3fff700 1 -- 172.21.15.82:0/3667815878 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdac4013630 con 0x7fdacc16d8a0 2023-10-06T03:16:44.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.517+0000 7fdab3fff700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:44.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.517+0000 7fdab3fff700 1 -- 172.21.15.82:0/3667815878 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdac4084820 con 0x7fdacc16d8a0 2023-10-06T03:16:44.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.518+0000 7fdacbfff700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:44.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.518+0000 7fdacbfff700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdab8066f30 0x7fdab80693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0091e0 tx=0x7fdabc01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:44.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.522+0000 7fdab3fff700 1 -- 172.21.15.82:0/3667815878 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdac4051930 con 0x7fdacc16d8a0 2023-10-06T03:16:44.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.753+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdacc16d230 con 0x7fdacc16d8a0 2023-10-06T03:16:44.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.753+0000 7fdab3fff700 1 -- 172.21.15.82:0/3667815878 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdac4054f50 con 0x7fdacc16d8a0 2023-10-06T03:16:44.755 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:16:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdab8066f30 msgr2=0x7fdab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdab8066f30 0x7fdab80693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0091e0 tx=0x7fdabc01a000 comp rx=0 tx=0).stop 2023-10-06T03:16:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc16d8a0 msgr2=0x7fdacc0b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc16d8a0 0x7fdacc0b5670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdacc15e440 tx=0x7fdacc0d0570 comp rx=0 tx=0).stop 2023-10-06T03:16:44.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 shutdown_connections 2023-10-06T03:16:44.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc16d8a0 0x7fdacc0b5670 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab4003a60 0x7fdacc151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 --2- 172.21.15.82:0/3667815878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdacc14fb90 0x7fdacc14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:44.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 >> 172.21.15.82:0/3667815878 conn(0x7fdacc0d1180 msgr2=0x7fdacc0681a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:44.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 shutdown_connections 2023-10-06T03:16:44.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:44.755+0000 7fdad2577700 1 -- 172.21.15.82:0/3667815878 wait complete. 2023-10-06T03:16:44.768 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:16:44.769 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:16:44.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-10-06T03:16:44.769 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:16:44.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:44.769 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:16:44.769 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:16:44.769 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:16:44.770 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:16:44.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:44.770 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-10-06T03:16:44.790 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:44.790 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42456sec preferred_lft 42456sec 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-10-06T03:16:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::942d:80ff:fe6e:b134/64 scope link 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::7074:feff:fe81:9e88/64 scope link 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:16:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether ee:c9:40:4f:89:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:16:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ecc9:40ff:fe4f:892c/64 scope link 2023-10-06T03:16:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:44.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:44.793 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:16:44.859 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-10-06T03:16:44.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:44.860 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-10-06T03:16:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-10-06T03:16:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:16:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:16:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:16:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:16:44.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:44.920 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:44.920 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:44.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:16:44.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:16:44.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:16:44.921 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:45.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:45.026 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:16:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:16:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:16:45.042 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:16:45.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:45.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-10-06T03:16:45.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:45.107 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:45.163 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:16:45.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:45.164 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:45.218 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:16:45.218 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:16:45.218 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:45.298 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:45.298 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:45.298 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:45.306 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:45.306 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:45.307 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:45.307 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:45.307 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:45.328 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:45.328 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:45.328 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:45.328 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:45.328 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:45.329 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:16:45.329 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:16:45.329 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:16:45.330 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:16:45.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:45.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:45.395 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:16:45.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:45.395 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:45.474 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:16:45.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:45.475 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:16:45.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:45.529 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-10-06T03:16:45.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:45.550 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 134217728 ./subdir) 2023-10-06T03:16:45.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:16:45.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.778+0000 7f070a199700 1 Processor -- start 2023-10-06T03:16:45.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.778+0000 7f070a199700 1 -- start start 2023-10-06T03:16:45.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.779+0000 7f070a199700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f070415a930 0x7f0704164260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.779+0000 7f070a199700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070406ab50 con 0x7f07040b35c0 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.779+0000 7f070a199700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040b1e10 con 0x7f0704159550 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.779+0000 7f070a199700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070406afe0 con 0x7f070415a930 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.779+0000 7f0709998700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f070415a930 0x7f0704164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.779+0000 7f0708996700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f07040b35c0 0x7f07040b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41770/0 (socket says 172.21.15.82:41770) 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.779+0000 7f0708996700 1 -- 172.21.15.82:0/2440006511 learned_addr learned my addr 172.21.15.82:0/2440006511 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f0709998700 1 -- 172.21.15.82:0/2440006511 >> v1:172.21.15.134:6789/0 conn(0x7f0704159550 legacy=0x7f0704069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f0709998700 1 -- 172.21.15.82:0/2440006511 >> v1:172.21.15.82:6789/0 conn(0x7f07040b35c0 legacy=0x7f07040b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f0709998700 1 -- 172.21.15.82:0/2440006511 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0704069f40 con 0x7f070415a930 2023-10-06T03:16:45.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f06fbfff700 1 -- 172.21.15.82:0/2440006511 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194964041 0 0) 0x7f070406ab50 con 0x7f07040b35c0 2023-10-06T03:16:45.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f0709998700 1 --2- 172.21.15.82:0/2440006511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704164260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0098e0 tx=0x7f06fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd41a362eb9846a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:45.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f06fbfff700 1 -- 172.21.15.82:0/2440006511 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc009e80 con 0x7f070415a930 2023-10-06T03:16:45.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f06fbfff700 1 -- 172.21.15.82:0/2440006511 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00b860 con 0x7f070415a930 2023-10-06T03:16:45.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f06fbfff700 1 -- 172.21.15.82:0/2440006511 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00bbe0 con 0x7f070415a930 2023-10-06T03:16:45.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f070a199700 1 -- 172.21.15.82:0/2440006511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 msgr2=0x7f0704164260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:45.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f070a199700 1 --2- 172.21.15.82:0/2440006511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704164260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0098e0 tx=0x7f06fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f070a199700 1 -- 172.21.15.82:0/2440006511 shutdown_connections 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f070a199700 1 --2- 172.21.15.82:0/2440006511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704164260 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.780+0000 7f070a199700 1 -- 172.21.15.82:0/2440006511 >> 172.21.15.82:0/2440006511 conn(0x7f07040ce320 msgr2=0x7f07040ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.781+0000 7f070a199700 1 -- 172.21.15.82:0/2440006511 shutdown_connections 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.781+0000 7f070a199700 1 -- 172.21.15.82:0/2440006511 wait complete. 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.782+0000 7f070a199700 1 Processor -- start 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.782+0000 7f070a199700 1 -- start start 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.782+0000 7f070a199700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07040b35c0 0x7f070415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.782+0000 7f070a199700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0704159550 0x7f070415fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:45.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f070a199700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f070a199700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070416a0f0 con 0x7f070415a930 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f070a199700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040c90d0 con 0x7f07040b35c0 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f070a199700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0704156790 con 0x7f0704159550 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704169bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53040/0 (socket says 172.21.15.82:53040) 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 -- 172.21.15.82:0/3463669143 learned_addr learned my addr 172.21.15.82:0/3463669143 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709197700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07040b35c0 0x7f070415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0708996700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0704159550 0x7f070415fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 -- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0704159550 msgr2=0x7f070415fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0704159550 0x7f070415fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:45.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 -- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07040b35c0 msgr2=0x7f070415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07040b35c0 0x7f070415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 -- 172.21.15.82:0/3463669143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc009420 con 0x7f070415a930 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f0709998700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704169bb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f070406f270 tx=0x7f06fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f06f97fa700 1 -- 172.21.15.82:0/3463669143 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc01f070 con 0x7f070415a930 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f06f97fa700 1 -- 172.21.15.82:0/3463669143 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00b9d0 con 0x7f070415a930 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07040c92e0 con 0x7f070415a930 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f06f97fa700 1 -- 172.21.15.82:0/3463669143 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc025670 con 0x7f070415a930 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.783+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07040c98a0 con 0x7f070415a930 2023-10-06T03:16:45.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.784+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07040cc810 con 0x7f070415a930 2023-10-06T03:16:45.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.785+0000 7f06f97fa700 1 -- 172.21.15.82:0/3463669143 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06fc023070 con 0x7f070415a930 2023-10-06T03:16:45.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.785+0000 7f06f97fa700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f06e8066f30 0x7f06e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:45.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.785+0000 7f06f97fa700 1 -- 172.21.15.82:0/3463669143 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06fc085cc0 con 0x7f070415a930 2023-10-06T03:16:45.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.785+0000 7f0709197700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f06e8066f30 0x7f06e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:45.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.786+0000 7f0709197700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f06e8066f30 0x7f06e80693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0700007fd0 tx=0x7f07000016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:45.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:45.789+0000 7f06f97fa700 1 -- 172.21.15.82:0/3463669143 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06fc052dd0 con 0x7f070415a930 2023-10-06T03:16:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.015+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f070404c3f0 con 0x7f070415a930 2023-10-06T03:16:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.015+0000 7f06f97fa700 1 -- 172.21.15.82:0/3463669143 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f06fc015070 con 0x7f070415a930 2023-10-06T03:16:46.017 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:16:46.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.017+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f06e8066f30 msgr2=0x7f06e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.017+0000 7f070a199700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f06e8066f30 0x7f06e80693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0700007fd0 tx=0x7f07000016f0 comp rx=0 tx=0).stop 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.017+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 msgr2=0x7f0704169bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704169bb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f070406f270 tx=0x7f06fc017000 comp rx=0 tx=0).stop 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 shutdown_connections 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070415a930 0x7f0704169bb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07040b35c0 0x7f070415e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f06e8066f30 0x7f06e80693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 --2- 172.21.15.82:0/3463669143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0704159550 0x7f070415fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 >> 172.21.15.82:0/3463669143 conn(0x7f07040ce320 msgr2=0x7f0704156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 shutdown_connections 2023-10-06T03:16:46.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:46.018+0000 7f070a199700 1 -- 172.21.15.82:0/3463669143 wait complete. 2023-10-06T03:16:46.031 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:16:46.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:16:46.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-10-06T03:16:46.031 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:16:46.031 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:46.031 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:16:46.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /subdir 2023-10-06T03:16:46.032 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:16:46.032 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:16:46.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.032 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-10-06T03:16:46.047 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:16:46.047 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:46.048 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42455sec preferred_lft 42455sec 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:16:46.049 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::942d:80ff:fe6e:b134/64 scope link 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::7074:feff:fe81:9e88/64 scope link 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether ee:c9:40:4f:89:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ecc9:40ff:fe4f:892c/64 scope link 2023-10-06T03:16:46.050 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:16:46.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.051 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:16:46.111 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-10-06T03:16:46.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.112 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-10-06T03:16:46.170 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-10-06T03:16:46.171 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:16:46.171 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:16:46.171 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:16:46.171 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:16:46.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.172 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:16:46.172 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:16:46.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:16:46.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:16:46.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:16:46.172 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:16:46.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.270 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:16:46.284 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:16:46.284 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:16:46.284 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:16:46.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-10-06T03:16:46.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:46.348 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:46.402 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:16:46.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:16:46.403 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:46.456 INFO:tasks.cephfs.kernel_mount:mounting using device: :/subdir 2023-10-06T03:16:46.456 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:16:46.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/subdir /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:46.536 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:46.536 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:46.536 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:46.544 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:46.544 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:46.545 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:46.545 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:46.545 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:46.566 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:16:46.566 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:16:46.566 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:16:46.566 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:16:46.567 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:16:46.567 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:16:46.567 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/subdir 2023-10-06T03:16:46.567 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:16:46.568 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:16:46.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:46.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:46.635 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec df -B1 .) 2023-10-06T03:16:46.694 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 1B-blocks Used Available Use% Mounted on 2023-10-06T03:16:46.694 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/subdir 134217728 0 134217728 0% /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:46.695 WARNING:tasks.cephfs.mount:['Filesystem 1B-blocks Used Available Use% Mounted on', '172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/subdir 134217728 0 134217728 0% /home/ubuntu/cephtest/mnt.1'] 2023-10-06T03:16:46.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:46.695 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 268435456 ./subdir) 2023-10-06T03:16:46.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:46.716 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec df -B1 .) 2023-10-06T03:16:46.750 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 1B-blocks Used Available Use% Mounted on 2023-10-06T03:16:46.750 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/subdir 268435456 0 268435456 0% /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:46.750 WARNING:tasks.cephfs.mount:['Filesystem 1B-blocks Used Available Use% Mounted on', '172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/subdir 268435456 0 268435456 0% /home/ubuntu/cephtest/mnt.1'] 2023-10-06T03:16:46.750 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:16:46.750 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:16:46.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:16:46.829 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:16:46.829 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:16:46.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:46.829 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:16:46.879 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:16:46.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.879 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:16:46.894 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:16:46.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:16:46.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:16:46.937 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:16:46.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:16:46.937 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:16:46.992 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:47.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.105+0000 7f15a9882700 1 Processor -- start 2023-10-06T03:16:47.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.105+0000 7f15a9882700 1 -- start start 2023-10-06T03:16:47.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.106+0000 7f15a9882700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a41576f0 0x7f15a4068640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.106+0000 7f15a9882700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15a4068b80 0x7f15a40ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.106+0000 7f15a9882700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a4068fe0 con 0x7f15a4157320 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.106+0000 7f15a9882700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a40c9f40 con 0x7f15a4068b80 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.106+0000 7f15a9882700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4158a90 con 0x7f15a41576f0 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.106+0000 7f15a37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15a4068b80 0x7f15a40ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.106+0000 7f15a37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15a4068b80 0x7f15a40ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53056/0 (socket says 172.21.15.82:53056) 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.106+0000 7f15a37fe700 1 -- 172.21.15.82:0/780177745 learned_addr learned my addr 172.21.15.82:0/780177745 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f159a7fc700 1 --2- 172.21.15.82:0/780177745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a41576f0 0x7f15a4068640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f15a37fe700 1 -- 172.21.15.82:0/780177745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a41576f0 msgr2=0x7f15a4068640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f15a37fe700 1 --2- 172.21.15.82:0/780177745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a41576f0 0x7f15a4068640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f15a37fe700 1 -- 172.21.15.82:0/780177745 >> v1:172.21.15.134:6789/0 conn(0x7f15a4157320 legacy=0x7f15a40ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f15a37fe700 1 -- 172.21.15.82:0/780177745 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4158600 con 0x7f15a4068b80 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f15a37fe700 1 --2- 172.21.15.82:0/780177745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40ca790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f159c009f50 tx=0x7f159c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127ddae73f66120a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f15a27fc700 1 -- 172.21.15.82:0/780177745 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00e070 con 0x7f15a4068b80 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f15a27fc700 1 -- 172.21.15.82:0/780177745 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00ba70 con 0x7f15a4068b80 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.107+0000 7f15a27fc700 1 -- 172.21.15.82:0/780177745 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0092e0 con 0x7f15a4068b80 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.108+0000 7f15a9882700 1 -- 172.21.15.82:0/780177745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 msgr2=0x7f15a40ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.108+0000 7f15a9882700 1 --2- 172.21.15.82:0/780177745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40ca790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f159c009f50 tx=0x7f159c009840 comp rx=0 tx=0).stop 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.108+0000 7f15a9882700 1 -- 172.21.15.82:0/780177745 shutdown_connections 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.108+0000 7f15a9882700 1 --2- 172.21.15.82:0/780177745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40ca790 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.108+0000 7f15a9882700 1 --2- 172.21.15.82:0/780177745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a41576f0 0x7f15a4068640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.108+0000 7f15a9882700 1 -- 172.21.15.82:0/780177745 >> 172.21.15.82:0/780177745 conn(0x7f15a406e500 msgr2=0x7f15a406bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:47.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.108+0000 7f15a9882700 1 -- 172.21.15.82:0/780177745 shutdown_connections 2023-10-06T03:16:47.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.108+0000 7f15a9882700 1 -- 172.21.15.82:0/780177745 wait complete. 2023-10-06T03:16:47.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.109+0000 7f15a9882700 1 Processor -- start 2023-10-06T03:16:47.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.109+0000 7f15a9882700 1 -- start start 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a9882700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a9882700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a4157320 0x7f15a4150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a9882700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15a41576f0 0x7f15a415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a9882700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4150b90 con 0x7f15a4068b80 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a9882700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a415ac40 con 0x7f15a41576f0 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a9882700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a415ba60 con 0x7f15a4157320 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53060/0 (socket says 172.21.15.82:53060) 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 -- 172.21.15.82:0/243317437 learned_addr learned my addr 172.21.15.82:0/243317437 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a37fe700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15a41576f0 0x7f15a415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f159a7fc700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a4157320 0x7f15a4150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 -- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a4157320 msgr2=0x7f15a4150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a4157320 0x7f15a4150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 -- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15a41576f0 msgr2=0x7f15a415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15a41576f0 0x7f15a415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 -- 172.21.15.82:0/243317437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c009ae0 con 0x7f15a4068b80 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a2ffd700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40c2a60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f159400c590 tx=0x7f159400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f159b7fe700 1 -- 172.21.15.82:0/243317437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594011590 con 0x7f15a4068b80 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f159b7fe700 1 -- 172.21.15.82:0/243317437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1594011710 con 0x7f15a4068b80 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a415ae50 con 0x7f15a4068b80 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f159b7fe700 1 -- 172.21.15.82:0/243317437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594011ad0 con 0x7f15a4068b80 2023-10-06T03:16:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.110+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a415b410 con 0x7f15a4068b80 2023-10-06T03:16:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.111+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a4064050 con 0x7f15a4068b80 2023-10-06T03:16:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.112+0000 7f159b7fe700 1 -- 172.21.15.82:0/243317437 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f159401b3b0 con 0x7f15a4068b80 2023-10-06T03:16:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.112+0000 7f159b7fe700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1584066f30 0x7f15840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.112+0000 7f159b7fe700 1 -- 172.21.15.82:0/243317437 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1594083950 con 0x7f15a4068b80 2023-10-06T03:16:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.112+0000 7f159a7fc700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1584066f30 0x7f15840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.113+0000 7f159a7fc700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1584066f30 0x7f15840693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f15a40c7ca0 tx=0x7f158c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.116+0000 7f159b7fe700 1 -- 172.21.15.82:0/243317437 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1594050a60 con 0x7f15a4068b80 2023-10-06T03:16:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.339+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15a4068fe0 con 0x7f15a4068b80 2023-10-06T03:16:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.340+0000 7f159b7fe700 1 -- 172.21.15.82:0/243317437 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f15a4068fe0 con 0x7f15a4068b80 2023-10-06T03:16:47.342 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:47.342 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/968017372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":968017372},{"type":"v1","addr":"172.21.15.134:6836","nonce":968017372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1664218192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1664218192},{"type":"v1","addr":"172.21.15.82:6834","nonce":1664218192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2857365191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":2857365191},{"type":"v1","addr":"172.21.15.82:6835","nonce":2857365191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:16:36.965976+0000","modified":"2023-10-06T03:16:40.600885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/4000888931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":4000888931},{"type":"v1","addr":"172.21.15.134:6837","nonce":4000888931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1584066f30 msgr2=0x7f15840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1584066f30 0x7f15840693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f15a40c7ca0 tx=0x7f158c008040 comp rx=0 tx=0).stop 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 msgr2=0x7f15a40c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40c2a60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f159400c590 tx=0x7f159400c8a0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 shutdown_connections 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15a41576f0 0x7f15a415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4068b80 0x7f15a40c2a60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1584066f30 0x7f15840693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 --2- 172.21.15.82:0/243317437 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15a4157320 0x7f15a4150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 >> 172.21.15.82:0/243317437 conn(0x7f15a406e500 msgr2=0x7f15a4150d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:47.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 shutdown_connections 2023-10-06T03:16:47.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.342+0000 7f15a9882700 1 -- 172.21.15.82:0/243317437 wait complete. 2023-10-06T03:16:47.345 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2023-10-06T03:16:47.356 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.468+0000 7f6324c6a700 1 Processor -- start 2023-10-06T03:16:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.468+0000 7f6324c6a700 1 -- start start 2023-10-06T03:16:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f6324c6a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f632015d930 0x7f63200d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f6324c6a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63201591b0 0x7f6320159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f6324c6a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63200b2ad0 con 0x7f632015d560 2023-10-06T03:16:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f6324c6a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200b4160 con 0x7f63201591b0 2023-10-06T03:16:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f6324c6a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200b2230 con 0x7f632015d930 2023-10-06T03:16:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f631ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63201591b0 0x7f6320159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f631e59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f632015d560 0x7f63200b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56370/0 (socket says 172.21.15.82:56370) 2023-10-06T03:16:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f631e59c700 1 -- 172.21.15.82:0/1517894806 learned_addr learned my addr 172.21.15.82:0/1517894806 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f6315d9b700 1 --2- 172.21.15.82:0/1517894806 >> v2:172.21.15.134:3300/0 conn(0x7f632015d930 0x7f63200d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f631ed9d700 1 -- 172.21.15.82:0/1517894806 >> v2:172.21.15.134:3300/0 conn(0x7f632015d930 msgr2=0x7f63200d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f631ed9d700 1 --2- 172.21.15.82:0/1517894806 >> v2:172.21.15.134:3300/0 conn(0x7f632015d930 0x7f63200d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f631ed9d700 1 -- 172.21.15.82:0/1517894806 >> v1:172.21.15.82:6789/0 conn(0x7f632015d560 legacy=0x7f63200b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f631dd9b700 1 -- 172.21.15.82:0/1517894806 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359927256 0 0) 0x7f63200b2ad0 con 0x7f632015d560 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.469+0000 7f631ed9d700 1 -- 172.21.15.82:0/1517894806 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63200b2510 con 0x7f63201591b0 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f631ed9d700 1 --2- 172.21.15.82:0/1517894806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63201591b0 0x7f6320159600 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f632015e440 tx=0x7f6318009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82668cd2abb6bda6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f631dd9b700 1 -- 172.21.15.82:0/1517894806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800e070 con 0x7f63201591b0 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f631dd9b700 1 -- 172.21.15.82:0/1517894806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631800bc30 con 0x7f63201591b0 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f631dd9b700 1 -- 172.21.15.82:0/1517894806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318012430 con 0x7f63201591b0 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f6324c6a700 1 -- 172.21.15.82:0/1517894806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63201591b0 msgr2=0x7f6320159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f6324c6a700 1 --2- 172.21.15.82:0/1517894806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63201591b0 0x7f6320159600 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f632015e440 tx=0x7f6318009780 comp rx=0 tx=0).stop 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f6324c6a700 1 -- 172.21.15.82:0/1517894806 shutdown_connections 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f6324c6a700 1 --2- 172.21.15.82:0/1517894806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63201591b0 0x7f6320159600 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f6324c6a700 1 --2- 172.21.15.82:0/1517894806 >> v2:172.21.15.134:3300/0 conn(0x7f632015d930 0x7f63200d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f6324c6a700 1 -- 172.21.15.82:0/1517894806 >> 172.21.15.82:0/1517894806 conn(0x7f63200d1180 msgr2=0x7f6320069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f6324c6a700 1 -- 172.21.15.82:0/1517894806 shutdown_connections 2023-10-06T03:16:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.470+0000 7f6324c6a700 1 -- 172.21.15.82:0/1517894806 wait complete. 2023-10-06T03:16:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.471+0000 7f6324c6a700 1 Processor -- start 2023-10-06T03:16:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.471+0000 7f6324c6a700 1 -- start start 2023-10-06T03:16:47.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f6324c6a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63201591b0 0x7f632016c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f6324c6a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f632015d560 0x7f632014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f6324c6a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f632015d930 0x7f6320169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f6324c6a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632016a280 con 0x7f632015d930 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f6324c6a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320153110 con 0x7f63201591b0 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f6324c6a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632016d760 con 0x7f632015d560 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f631ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f632015d930 0x7f6320169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f631ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f632015d930 0x7f6320169d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36978/0 (socket says 172.21.15.82:36978) 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f631ed9d700 1 -- 172.21.15.82:0/788820018 learned_addr learned my addr 172.21.15.82:0/788820018 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f631e59c700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63201591b0 0x7f632016c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.472+0000 7f6315d9b700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f632015d560 0x7f632014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f631ed9d700 1 -- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f632015d560 msgr2=0x7f632014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f631ed9d700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f632015d560 0x7f632014ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f631ed9d700 1 -- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63201591b0 msgr2=0x7f632016c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f631ed9d700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63201591b0 0x7f632016c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f631ed9d700 1 -- 172.21.15.82:0/788820018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318009a20 con 0x7f632015d930 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f631ed9d700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f632015d930 0x7f6320169d40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6318009fd0 tx=0x7f6318019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f6316ffd700 1 -- 172.21.15.82:0/788820018 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318027470 con 0x7f632015d930 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f6316ffd700 1 -- 172.21.15.82:0/788820018 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318027610 con 0x7f632015d930 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6320151030 con 0x7f632015d930 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f6316ffd700 1 -- 172.21.15.82:0/788820018 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63180279d0 con 0x7f632015d930 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.473+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632016d1a0 con 0x7f632015d930 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.474+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63201511c0 con 0x7f632015d930 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.474+0000 7f6316ffd700 1 -- 172.21.15.82:0/788820018 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6318024070 con 0x7f632015d930 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.474+0000 7f6316ffd700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6300066f30 0x7f63000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.474+0000 7f6316ffd700 1 -- 172.21.15.82:0/788820018 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6318086d60 con 0x7f632015d930 2023-10-06T03:16:47.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.475+0000 7f631e59c700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6300066f30 0x7f63000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.475+0000 7f631e59c700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6300066f30 0x7f63000693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6310007fd0 tx=0x7f6310007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.479+0000 7f6316ffd700 1 -- 172.21.15.82:0/788820018 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6318053e70 con 0x7f632015d930 2023-10-06T03:16:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.665+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63200b27f0 con 0x7f632015d930 2023-10-06T03:16:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.666+0000 7f6316ffd700 1 -- 172.21.15.82:0/788820018 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f631802c020 con 0x7f632015d930 2023-10-06T03:16:47.668 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:47.668 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:16:38.582429+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:16:35.054163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:16:35.928949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6300066f30 msgr2=0x7f63000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6300066f30 0x7f63000693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6310007fd0 tx=0x7f6310007d30 comp rx=0 tx=0).stop 2023-10-06T03:16:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f632015d930 msgr2=0x7f6320169d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f632015d930 0x7f6320169d40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6318009fd0 tx=0x7f6318019000 comp rx=0 tx=0).stop 2023-10-06T03:16:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 shutdown_connections 2023-10-06T03:16:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f632015d930 0x7f6320169d40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63201591b0 0x7f632016c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6300066f30 0x7f63000693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 --2- 172.21.15.82:0/788820018 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f632015d560 0x7f632014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 >> 172.21.15.82:0/788820018 conn(0x7f63200d1180 msgr2=0x7f63200691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 shutdown_connections 2023-10-06T03:16:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.668+0000 7f6324c6a700 1 -- 172.21.15.82:0/788820018 wait complete. 2023-10-06T03:16:47.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:16:35.054163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:16:35.928949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:16:47.682 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:47.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.797+0000 7f97b81dd700 1 Processor -- start 2023-10-06T03:16:47.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.797+0000 7f97b81dd700 1 -- start start 2023-10-06T03:16:47.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b81dd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b81dd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97b015d8e0 0x7f97b00cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b81dd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b015dd20 con 0x7f97b0159500 2023-10-06T03:16:47.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b81dd700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b00b1110 con 0x7f97b015d8e0 2023-10-06T03:16:47.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b81dd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00b13b0 con 0x7f97b01598d0 2023-10-06T03:16:47.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b5f79700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f97b0159500 0x7f97b00b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:36430/0 (socket says 172.21.15.82:36430) 2023-10-06T03:16:47.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b5778700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b677a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97b015d8e0 0x7f97b00cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b5f79700 1 -- 172.21.15.82:0/3495262761 learned_addr learned my addr 172.21.15.82:0/3495262761 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:47.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b4f77700 1 -- 172.21.15.82:0/3495262761 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588600767 0 0) 0x7f97b015dd20 con 0x7f97b0159500 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.798+0000 7f97b4f77700 1 -- 172.21.15.82:0/3495262761 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f979c003570 con 0x7f97b0159500 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b677a700 1 -- 172.21.15.82:0/3495262761 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 msgr2=0x7f97b015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b677a700 1 --2- 172.21.15.82:0/3495262761 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b677a700 1 -- 172.21.15.82:0/3495262761 >> v1:172.21.15.134:6789/0 conn(0x7f97b0159500 legacy=0x7f97b00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b677a700 1 -- 172.21.15.82:0/3495262761 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00b1690 con 0x7f97b015d8e0 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b5778700 1 --2- 172.21.15.82:0/3495262761 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b677a700 1 --2- 172.21.15.82:0/3495262761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b015d8e0 0x7f97b00cf6c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009e60 tx=0x7f97a8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=593e10558e4ddb5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b4f77700 1 -- 172.21.15.82:0/3495262761 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a800e070 con 0x7f97b015d8e0 2023-10-06T03:16:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b4f77700 1 -- 172.21.15.82:0/3495262761 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a800bab0 con 0x7f97b015d8e0 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b4f77700 1 -- 172.21.15.82:0/3495262761 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a800be70 con 0x7f97b015d8e0 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b81dd700 1 -- 172.21.15.82:0/3495262761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b015d8e0 msgr2=0x7f97b00cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b81dd700 1 --2- 172.21.15.82:0/3495262761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b015d8e0 0x7f97b00cf6c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009e60 tx=0x7f97a8009780 comp rx=0 tx=0).stop 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b81dd700 1 -- 172.21.15.82:0/3495262761 shutdown_connections 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b81dd700 1 --2- 172.21.15.82:0/3495262761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b015d8e0 0x7f97b00cf6c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b81dd700 1 --2- 172.21.15.82:0/3495262761 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b81dd700 1 -- 172.21.15.82:0/3495262761 >> 172.21.15.82:0/3495262761 conn(0x7f97b0067630 msgr2=0x7f97b0069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b81dd700 1 -- 172.21.15.82:0/3495262761 shutdown_connections 2023-10-06T03:16:47.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.799+0000 7f97b81dd700 1 -- 172.21.15.82:0/3495262761 wait complete. 2023-10-06T03:16:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.801+0000 7f97b81dd700 1 Processor -- start 2023-10-06T03:16:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.801+0000 7f97b81dd700 1 -- start start 2023-10-06T03:16:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.801+0000 7f97b81dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b0159500 0x7f97b0159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.801+0000 7f97b81dd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b01564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.801+0000 7f97b81dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b015d8e0 0x7f97b0169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.801+0000 7f97b81dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b016a290 con 0x7f97b015d8e0 2023-10-06T03:16:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.801+0000 7f97b81dd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b014cd10 con 0x7f97b0159500 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.801+0000 7f97b81dd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b0169780 con 0x7f97b01598d0 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b015d8e0 0x7f97b0169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b015d8e0 0x7f97b0169240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36988/0 (socket says 172.21.15.82:36988) 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 -- 172.21.15.82:0/1367654698 learned_addr learned my addr 172.21.15.82:0/1367654698 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b5f79700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b0159500 0x7f97b0159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b5778700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b01564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 -- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 msgr2=0x7f97b01564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b01564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 -- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b0159500 msgr2=0x7f97b0159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b0159500 0x7f97b0159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 -- 172.21.15.82:0/1367654698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009420 con 0x7f97b015d8e0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b677a700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b015d8e0 0x7f97b0169240 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f97a800b610 tx=0x7f97a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97a5ffb700 1 -- 172.21.15.82:0/1367654698 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8027470 con 0x7f97b015d8e0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97a5ffb700 1 -- 172.21.15.82:0/1367654698 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a80275f0 con 0x7f97b015d8e0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a8009a20 con 0x7f97b015d8e0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97a5ffb700 1 -- 172.21.15.82:0/1367654698 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a80279b0 con 0x7f97b015d8e0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.802+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b0169cd0 con 0x7f97b015d8e0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.803+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b0064050 con 0x7f97b015d8e0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.804+0000 7f97a5ffb700 1 -- 172.21.15.82:0/1367654698 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97a8024070 con 0x7f97b015d8e0 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.804+0000 7f97a5ffb700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:47.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.804+0000 7f97a5ffb700 1 -- 172.21.15.82:0/1367654698 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f97a8086fb0 con 0x7f97b015d8e0 2023-10-06T03:16:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.804+0000 7f97b5f79700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.805+0000 7f97b5f79700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9794066f30 0x7f97940693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0058d0 tx=0x7f97ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.808+0000 7f97a5ffb700 1 -- 172.21.15.82:0/1367654698 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97a80b85a0 con 0x7f97b015d8e0 2023-10-06T03:16:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.990+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97b014ce50 con 0x7f97b015d8e0 2023-10-06T03:16:47.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.990+0000 7f97a5ffb700 1 -- 172.21.15.82:0/1367654698 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97a80540c0 con 0x7f97b015d8e0 2023-10-06T03:16:47.994 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9794066f30 msgr2=0x7f97940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9794066f30 0x7f97940693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0058d0 tx=0x7f97ac009040 comp rx=0 tx=0).stop 2023-10-06T03:16:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b015d8e0 msgr2=0x7f97b0169240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b015d8e0 0x7f97b0169240 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f97a800b610 tx=0x7f97a8019000 comp rx=0 tx=0).stop 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 shutdown_connections 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b015d8e0 0x7f97b0169240 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b0159500 0x7f97b0159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 --2- 172.21.15.82:0/1367654698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97b01598d0 0x7f97b01564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 >> 172.21.15.82:0/1367654698 conn(0x7f97b0067630 msgr2=0x7f97b0158270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 shutdown_connections 2023-10-06T03:16:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:47.992+0000 7f97b81dd700 1 -- 172.21.15.82:0/1367654698 wait complete. 2023-10-06T03:16:48.006 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:48.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.121+0000 7f21c48b9700 1 Processor -- start 2023-10-06T03:16:48.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.121+0000 7f21c48b9700 1 -- start start 2023-10-06T03:16:48.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.122+0000 7f21c48b9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21c0159500 0x7f21c01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.122+0000 7f21c48b9700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f21c00b3fd0 0x7f21c015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.122+0000 7f21c48b9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c015dd20 con 0x7f21c015d8e0 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.122+0000 7f21c48b9700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00b1110 con 0x7f21c0159500 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.122+0000 7f21c48b9700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00b13b0 con 0x7f21c00b3fd0 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.122+0000 7f21be59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21c0159500 0x7f21c01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.122+0000 7f21be59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21c0159500 0x7f21c01598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37002/0 (socket says 172.21.15.82:37002) 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.122+0000 7f21be59c700 1 -- 172.21.15.82:0/3373120485 learned_addr learned my addr 172.21.15.82:0/3373120485 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21b5d9b700 1 --2- 172.21.15.82:0/3373120485 >> v2:172.21.15.134:3300/0 conn(0x7f21c00b3fd0 0x7f21c015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21be59c700 1 -- 172.21.15.82:0/3373120485 >> v2:172.21.15.134:3300/0 conn(0x7f21c00b3fd0 msgr2=0x7f21c015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:48.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21be59c700 1 --2- 172.21.15.82:0/3373120485 >> v2:172.21.15.134:3300/0 conn(0x7f21c00b3fd0 0x7f21c015d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21be59c700 1 -- 172.21.15.82:0/3373120485 >> v1:172.21.15.134:6789/0 conn(0x7f21c015d8e0 legacy=0x7f21c00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21be59c700 1 -- 172.21.15.82:0/3373120485 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c00b1690 con 0x7f21c0159500 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21be59c700 1 --2- 172.21.15.82:0/3373120485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c0159500 0x7f21c01598d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f21c0063430 tx=0x7f21b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de695d223521081a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21bdd9b700 1 -- 172.21.15.82:0/3373120485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000b820 con 0x7f21c0159500 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21bdd9b700 1 -- 172.21.15.82:0/3373120485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000b980 con 0x7f21c0159500 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21bdd9b700 1 -- 172.21.15.82:0/3373120485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000bd20 con 0x7f21c0159500 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21c48b9700 1 -- 172.21.15.82:0/3373120485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c0159500 msgr2=0x7f21c01598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3373120485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c0159500 0x7f21c01598d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f21c0063430 tx=0x7f21b0009250 comp rx=0 tx=0).stop 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21c48b9700 1 -- 172.21.15.82:0/3373120485 shutdown_connections 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3373120485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c0159500 0x7f21c01598d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3373120485 >> v2:172.21.15.134:3300/0 conn(0x7f21c00b3fd0 0x7f21c015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.123+0000 7f21c48b9700 1 -- 172.21.15.82:0/3373120485 >> 172.21.15.82:0/3373120485 conn(0x7f21c0067630 msgr2=0x7f21c0069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:48.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.124+0000 7f21c48b9700 1 -- 172.21.15.82:0/3373120485 shutdown_connections 2023-10-06T03:16:48.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.124+0000 7f21c48b9700 1 -- 172.21.15.82:0/3373120485 wait complete. 2023-10-06T03:16:48.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.125+0000 7f21c48b9700 1 Processor -- start 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.125+0000 7f21c48b9700 1 -- start start 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.125+0000 7f21c48b9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c00b3fd0 0x7f21c01549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.125+0000 7f21c48b9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21c0159500 0x7f21c015b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.125+0000 7f21c48b9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21c015d8e0 0x7f21c014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.125+0000 7f21c48b9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c015c8b0 con 0x7f21c00b3fd0 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.125+0000 7f21c48b9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01529c0 con 0x7f21c0159500 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.125+0000 7f21c48b9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c015bca0 con 0x7f21c015d8e0 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c00b3fd0 0x7f21c01549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c00b3fd0 0x7f21c01549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37018/0 (socket says 172.21.15.82:37018) 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 -- 172.21.15.82:0/3348857310 learned_addr learned my addr 172.21.15.82:0/3348857310 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21b5d9b700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21c0159500 0x7f21c015b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 -- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21c015d8e0 msgr2=0x7f21c014f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21bed9d700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21c015d8e0 0x7f21c014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21c015d8e0 0x7f21c014f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 -- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21c0159500 msgr2=0x7f21c015b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21c0159500 0x7f21c015b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 -- 172.21.15.82:0/3348857310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00094f0 con 0x7f21c00b3fd0 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21b5d9b700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21c0159500 0x7f21c015b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21bed9d700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21c015d8e0 0x7f21c014f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21be59c700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c00b3fd0 0x7f21c01549e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f21b00030c0 tx=0x7f21b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21b6ffd700 1 -- 172.21.15.82:0/3348857310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0011e60 con 0x7f21c00b3fd0 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21b6ffd700 1 -- 172.21.15.82:0/3348857310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b0020070 con 0x7f21c00b3fd0 2023-10-06T03:16:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c015bf80 con 0x7f21c00b3fd0 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21b6ffd700 1 -- 172.21.15.82:0/3348857310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b001b6a0 con 0x7f21c00b3fd0 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.126+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c015c310 con 0x7f21c00b3fd0 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.127+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c0064050 con 0x7f21c00b3fd0 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.127+0000 7f21b6ffd700 1 -- 172.21.15.82:0/3348857310 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b0022030 con 0x7f21c00b3fd0 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.128+0000 7f21b6ffd700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21a0066f30 0x7f21a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.128+0000 7f21b6ffd700 1 -- 172.21.15.82:0/3348857310 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21b00866d0 con 0x7f21c00b3fd0 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.128+0000 7f21b5d9b700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21a0066f30 0x7f21a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.128+0000 7f21b5d9b700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21a0066f30 0x7f21a00693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f21c00cd600 tx=0x7f21a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.132+0000 7f21b6ffd700 1 -- 172.21.15.82:0/3348857310 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b00537e0 con 0x7f21c00b3fd0 2023-10-06T03:16:48.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.313+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21c0064050 con 0x7f21c00b3fd0 2023-10-06T03:16:48.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.314+0000 7f21b6ffd700 1 -- 172.21.15.82:0/3348857310 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21b0056e00 con 0x7f21c00b3fd0 2023-10-06T03:16:48.316 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.315+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21a0066f30 msgr2=0x7f21a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.315+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21a0066f30 0x7f21a00693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f21c00cd600 tx=0x7f21a8008040 comp rx=0 tx=0).stop 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.315+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c00b3fd0 msgr2=0x7f21c01549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.315+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c00b3fd0 0x7f21c01549e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f21b00030c0 tx=0x7f21b0016000 comp rx=0 tx=0).stop 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.316+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 shutdown_connections 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.316+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f21a0066f30 0x7f21a00693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.316+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f21c015d8e0 0x7f21c014f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.316+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c00b3fd0 0x7f21c01549e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.316+0000 7f21c48b9700 1 --2- 172.21.15.82:0/3348857310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21c0159500 0x7f21c015b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.316+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 >> 172.21.15.82:0/3348857310 conn(0x7f21c0067630 msgr2=0x7f21c015d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.316+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 shutdown_connections 2023-10-06T03:16:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.316+0000 7f21c48b9700 1 -- 172.21.15.82:0/3348857310 wait complete. 2023-10-06T03:16:48.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:16:48.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.445+0000 7ff82e792700 1 Processor -- start 2023-10-06T03:16:48.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.445+0000 7ff82e792700 1 -- start start 2023-10-06T03:16:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff82e792700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fb10 0x7ff82806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff82e792700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8280c80d0 0x7ff8280cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff82e792700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8280c87a0 con 0x7ff82813fee0 2023-10-06T03:16:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff82e792700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82806aaf0 con 0x7ff8280c80d0 2023-10-06T03:16:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff82e792700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82806adb0 con 0x7ff82813fb10 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff82cd2f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8280c80d0 0x7ff8280cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff827fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fb10 0x7ff82806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff8277fe700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff82813fee0 0x7ff8280c79c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:36448/0 (socket says 172.21.15.82:36448) 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff8277fe700 1 -- 172.21.15.82:0/996311872 learned_addr learned my addr 172.21.15.82:0/996311872 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff827fff700 1 -- 172.21.15.82:0/996311872 >> v2:172.21.15.134:3300/0 conn(0x7ff8280c80d0 msgr2=0x7ff8280cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff827fff700 1 --2- 172.21.15.82:0/996311872 >> v2:172.21.15.134:3300/0 conn(0x7ff8280c80d0 0x7ff8280cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff827fff700 1 -- 172.21.15.82:0/996311872 >> v1:172.21.15.134:6789/0 conn(0x7ff82813fee0 legacy=0x7ff8280c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff827fff700 1 -- 172.21.15.82:0/996311872 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82806b090 con 0x7ff82813fb10 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff826ffd700 1 -- 172.21.15.82:0/996311872 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545954652 0 0) 0x7ff8280c87a0 con 0x7ff82813fee0 2023-10-06T03:16:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.446+0000 7ff82cd2f700 1 --2- 172.21.15.82:0/996311872 >> v2:172.21.15.134:3300/0 conn(0x7ff8280c80d0 0x7ff8280cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff827fff700 1 --2- 172.21.15.82:0/996311872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fb10 0x7ff82806a5b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff818009910 tx=0x7ff8180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc2d49d9b1e5074b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff826ffd700 1 -- 172.21.15.82:0/996311872 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81800b640 con 0x7ff82813fb10 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff826ffd700 1 -- 172.21.15.82:0/996311872 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81800b7a0 con 0x7ff82813fb10 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff826ffd700 1 -- 172.21.15.82:0/996311872 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81800bb60 con 0x7ff82813fb10 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff82e792700 1 -- 172.21.15.82:0/996311872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fb10 msgr2=0x7ff82806a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff82e792700 1 --2- 172.21.15.82:0/996311872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fb10 0x7ff82806a5b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff818009910 tx=0x7ff8180091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff82e792700 1 -- 172.21.15.82:0/996311872 shutdown_connections 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff82e792700 1 --2- 172.21.15.82:0/996311872 >> v2:172.21.15.134:3300/0 conn(0x7ff8280c80d0 0x7ff8280cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff82e792700 1 --2- 172.21.15.82:0/996311872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fb10 0x7ff82806a5b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff82e792700 1 -- 172.21.15.82:0/996311872 >> 172.21.15.82:0/996311872 conn(0x7ff82806e760 msgr2=0x7ff82806eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff82e792700 1 -- 172.21.15.82:0/996311872 shutdown_connections 2023-10-06T03:16:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.447+0000 7ff82e792700 1 -- 172.21.15.82:0/996311872 wait complete. 2023-10-06T03:16:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.448+0000 7ff82e792700 1 Processor -- start 2023-10-06T03:16:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.448+0000 7ff82e792700 1 -- start start 2023-10-06T03:16:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff82e792700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8280c80d0 0x7ff828156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff82e792700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82813fb10 0x7ff82815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff82e792700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fee0 0x7ff82806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff82e792700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8281568b0 con 0x7ff82813fb10 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff82e792700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82815bf60 con 0x7ff8280c80d0 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff82e792700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82816a5e0 con 0x7ff82813fee0 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff8277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82813fb10 0x7ff82815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff8277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82813fb10 0x7ff82815b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37026/0 (socket says 172.21.15.82:37026) 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff8277fe700 1 -- 172.21.15.82:0/2778181093 learned_addr learned my addr 172.21.15.82:0/2778181093 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff827fff700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8280c80d0 0x7ff828156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.449+0000 7ff82cd2f700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fee0 0x7ff82806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff8277fe700 1 -- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fee0 msgr2=0x7ff82806eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff8277fe700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fee0 0x7ff82806eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff8277fe700 1 -- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8280c80d0 msgr2=0x7ff828156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff8277fe700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8280c80d0 0x7ff828156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff8277fe700 1 -- 172.21.15.82:0/2778181093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820009a20 con 0x7ff82813fb10 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff8277fe700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82813fb10 0x7ff82815b450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00ea20 tx=0x7ff81c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff80ffff700 1 -- 172.21.15.82:0/2778181093 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00ee00 con 0x7ff82813fb10 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff80ffff700 1 -- 172.21.15.82:0/2778181093 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c005b30 con 0x7ff82813fb10 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff818009420 con 0x7ff82813fb10 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff80ffff700 1 -- 172.21.15.82:0/2778181093 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00c7e0 con 0x7ff82813fb10 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.450+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff828169f90 con 0x7ff82813fb10 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.451+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82816a750 con 0x7ff82813fb10 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.451+0000 7ff80ffff700 1 -- 172.21.15.82:0/2778181093 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff81c00cb50 con 0x7ff82813fb10 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.451+0000 7ff80ffff700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.452+0000 7ff80ffff700 1 -- 172.21.15.82:0/2778181093 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff81c086930 con 0x7ff82813fb10 2023-10-06T03:16:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.452+0000 7ff827fff700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.452+0000 7ff827fff700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff814066f30 0x7ff8140693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8180098e0 tx=0x7ff818017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.456+0000 7ff80ffff700 1 -- 172.21.15.82:0/2778181093 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff81c053ac0 con 0x7ff82813fb10 2023-10-06T03:16:48.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.637+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff828064050 con 0x7ff82813fb10 2023-10-06T03:16:48.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.638+0000 7ff80ffff700 1 -- 172.21.15.82:0/2778181093 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff81c015020 con 0x7ff82813fb10 2023-10-06T03:16:48.640 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff814066f30 msgr2=0x7ff8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff814066f30 0x7ff8140693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8180098e0 tx=0x7ff818017000 comp rx=0 tx=0).stop 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82813fb10 msgr2=0x7ff82815b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82813fb10 0x7ff82815b450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00ea20 tx=0x7ff81c007e80 comp rx=0 tx=0).stop 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 shutdown_connections 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff82813fee0 0x7ff82806eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8280c80d0 0x7ff828156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 --2- 172.21.15.82:0/2778181093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82813fb10 0x7ff82815b450 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 >> 172.21.15.82:0/2778181093 conn(0x7ff82806e760 msgr2=0x7ff82813ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:48.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 shutdown_connections 2023-10-06T03:16:48.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.640+0000 7ff82e792700 1 -- 172.21.15.82:0/2778181093 wait complete. 2023-10-06T03:16:48.653 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:16:48.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.768+0000 7f591e8bd700 1 Processor -- start 2023-10-06T03:16:48.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.768+0000 7f591e8bd700 1 -- start start 2023-10-06T03:16:48.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591e8bd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5918142e90 0x7f5918069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591e8bd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5918069d50 0x7f591815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591e8bd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 0x7f591815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591e8bd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5918069380 con 0x7f5918142e90 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591e8bd700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5918068770 con 0x7f5918069d50 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591e8bd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5918068a50 con 0x7f591815de80 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d8bb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5918142e90 0x7f5918069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d8bb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5918142e90 0x7f5918069810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37032/0 (socket says 172.21.15.82:37032) 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d8bb700 1 -- 172.21.15.82:0/1784577673 learned_addr learned my addr 172.21.15.82:0/1784577673 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d0ba700 1 --2- 172.21.15.82:0/1784577673 >> v2:172.21.15.134:3300/0 conn(0x7f5918069d50 0x7f591815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591e0bc700 1 --2- 172.21.15.82:0/1784577673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 0x7f591815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d8bb700 1 -- 172.21.15.82:0/1784577673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 msgr2=0x7f591815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d8bb700 1 --2- 172.21.15.82:0/1784577673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 0x7f591815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d8bb700 1 -- 172.21.15.82:0/1784577673 >> v2:172.21.15.134:3300/0 conn(0x7f5918069d50 msgr2=0x7f591815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d8bb700 1 --2- 172.21.15.82:0/1784577673 >> v2:172.21.15.134:3300/0 conn(0x7f5918069d50 0x7f591815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d8bb700 1 -- 172.21.15.82:0/1784577673 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918068d30 con 0x7f5918142e90 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591e0bc700 1 --2- 172.21.15.82:0/1784577673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 0x7f591815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.769+0000 7f591d0ba700 1 --2- 172.21.15.82:0/1784577673 >> v2:172.21.15.134:3300/0 conn(0x7f5918069d50 0x7f591815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591d8bb700 1 --2- 172.21.15.82:0/1784577673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918142e90 0x7f5918069810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f591806fd60 tx=0x7f5914009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437dcf64e37fac60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591c8b9700 1 -- 172.21.15.82:0/1784577673 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400b860 con 0x7f5918142e90 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591c8b9700 1 -- 172.21.15.82:0/1784577673 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591400b9c0 con 0x7f5918142e90 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591c8b9700 1 -- 172.21.15.82:0/1784577673 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400bd60 con 0x7f5918142e90 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 -- 172.21.15.82:0/1784577673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918142e90 msgr2=0x7f5918069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 --2- 172.21.15.82:0/1784577673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918142e90 0x7f5918069810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f591806fd60 tx=0x7f5914009250 comp rx=0 tx=0).stop 2023-10-06T03:16:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 -- 172.21.15.82:0/1784577673 shutdown_connections 2023-10-06T03:16:48.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 --2- 172.21.15.82:0/1784577673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918142e90 0x7f5918069810 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 --2- 172.21.15.82:0/1784577673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 0x7f591815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 --2- 172.21.15.82:0/1784577673 >> v2:172.21.15.134:3300/0 conn(0x7f5918069d50 0x7f591815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 -- 172.21.15.82:0/1784577673 >> 172.21.15.82:0/1784577673 conn(0x7f59180ccfe0 msgr2=0x7f59180cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:48.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 -- 172.21.15.82:0/1784577673 shutdown_connections 2023-10-06T03:16:48.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.770+0000 7f591e8bd700 1 -- 172.21.15.82:0/1784577673 wait complete. 2023-10-06T03:16:48.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.771+0000 7f591e8bd700 1 Processor -- start 2023-10-06T03:16:48.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.771+0000 7f591e8bd700 1 -- start start 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591e8bd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918069d50 0x7f59180c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591e8bd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5918142e90 0x7f59180c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591e8bd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 0x7f5918169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591e8bd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59180c6750 con 0x7f5918069d50 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591e8bd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59180c5b40 con 0x7f5918142e90 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591e8bd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59180c5e20 con 0x7f591815de80 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591d8bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918069d50 0x7f59180c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591d8bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918069d50 0x7f59180c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37040/0 (socket says 172.21.15.82:37040) 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.772+0000 7f591d8bb700 1 -- 172.21.15.82:0/119390899 learned_addr learned my addr 172.21.15.82:0/119390899 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f591d8bb700 1 -- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 msgr2=0x7f5918169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f591d8bb700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 0x7f5918169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f591d8bb700 1 -- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5918142e90 msgr2=0x7f59180c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f591d8bb700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5918142e90 0x7f59180c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f591d8bb700 1 -- 172.21.15.82:0/119390899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140094f0 con 0x7f5918069d50 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f591d8bb700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918069d50 0x7f59180c82d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5914009290 tx=0x7f5914017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f590dffb700 1 -- 172.21.15.82:0/119390899 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914026480 con 0x7f5918069d50 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f590dffb700 1 -- 172.21.15.82:0/119390899 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591401f070 con 0x7f5918069d50 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59180c6100 con 0x7f5918069d50 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f590dffb700 1 -- 172.21.15.82:0/119390899 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914026830 con 0x7f5918069d50 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.773+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59180c5850 con 0x7f5918069d50 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.774+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59180c65a0 con 0x7f5918069d50 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.774+0000 7f590dffb700 1 -- 172.21.15.82:0/119390899 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5914026ba0 con 0x7f5918069d50 2023-10-06T03:16:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.775+0000 7f590dffb700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58fc066f30 0x7f58fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.775+0000 7f590dffb700 1 -- 172.21.15.82:0/119390899 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5914021070 con 0x7f5918069d50 2023-10-06T03:16:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.775+0000 7f591d0ba700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58fc066f30 0x7f58fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.775+0000 7f591d0ba700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58fc066f30 0x7f58fc0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5908006f00 tx=0x7f5908008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.779+0000 7f590dffb700 1 -- 172.21.15.82:0/119390899 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5914053650 con 0x7f5918069d50 2023-10-06T03:16:48.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.961+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f591804c3c0 con 0x7f5918069d50 2023-10-06T03:16:48.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.962+0000 7f590dffb700 1 -- 172.21.15.82:0/119390899 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5914056c70 con 0x7f5918069d50 2023-10-06T03:16:48.964 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58fc066f30 msgr2=0x7f58fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58fc066f30 0x7f58fc0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5908006f00 tx=0x7f5908008040 comp rx=0 tx=0).stop 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918069d50 msgr2=0x7f59180c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918069d50 0x7f59180c82d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5914009290 tx=0x7f5914017000 comp rx=0 tx=0).stop 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 shutdown_connections 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f58fc066f30 0x7f58fc0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f591815de80 0x7f5918169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5918069d50 0x7f59180c82d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 --2- 172.21.15.82:0/119390899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5918142e90 0x7f59180c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:48.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 >> 172.21.15.82:0/119390899 conn(0x7f59180ccfe0 msgr2=0x7f5918158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:48.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 shutdown_connections 2023-10-06T03:16:48.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:48.964+0000 7f591e8bd700 1 -- 172.21.15.82:0/119390899 wait complete. 2023-10-06T03:16:48.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.091+0000 7fce769fa700 1 Processor -- start 2023-10-06T03:16:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.091+0000 7fce769fa700 1 -- start start 2023-10-06T03:16:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce769fa700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce7015d560 0x7fce700d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce769fa700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce701591b0 0x7fce70159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce769fa700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce700b2ad0 con 0x7fce7015d930 2023-10-06T03:16:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce769fa700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce700b4160 con 0x7fce701591b0 2023-10-06T03:16:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce769fa700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce70159b70 con 0x7fce7015d560 2023-10-06T03:16:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce74f97700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce701591b0 0x7fce70159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce74f97700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce701591b0 0x7fce70159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37048/0 (socket says 172.21.15.82:37048) 2023-10-06T03:16:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce74f97700 1 -- 172.21.15.82:0/2720251244 learned_addr learned my addr 172.21.15.82:0/2720251244 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce74f97700 1 -- 172.21.15.82:0/2720251244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce7015d560 msgr2=0x7fce700d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce6ffff700 1 --2- 172.21.15.82:0/2720251244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce7015d560 0x7fce700d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce74f97700 1 --2- 172.21.15.82:0/2720251244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce7015d560 0x7fce700d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce74f97700 1 -- 172.21.15.82:0/2720251244 >> v1:172.21.15.134:6789/0 conn(0x7fce7015d930 legacy=0x7fce700b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce74f97700 1 -- 172.21.15.82:0/2720251244 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce700b2230 con 0x7fce701591b0 2023-10-06T03:16:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce6ffff700 1 --2- 172.21.15.82:0/2720251244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce7015d560 0x7fce700d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce74f97700 1 --2- 172.21.15.82:0/2720251244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce701591b0 0x7fce70159630 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fce68009f20 tx=0x7fce68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1146ab542984b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.092+0000 7fce6effd700 1 -- 172.21.15.82:0/2720251244 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6800e070 con 0x7fce701591b0 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce6effd700 1 -- 172.21.15.82:0/2720251244 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6800ba40 con 0x7fce701591b0 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce6effd700 1 -- 172.21.15.82:0/2720251244 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680092e0 con 0x7fce701591b0 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce769fa700 1 -- 172.21.15.82:0/2720251244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce701591b0 msgr2=0x7fce70159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce769fa700 1 --2- 172.21.15.82:0/2720251244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce701591b0 0x7fce70159630 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fce68009f20 tx=0x7fce68009840 comp rx=0 tx=0).stop 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce769fa700 1 -- 172.21.15.82:0/2720251244 shutdown_connections 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce769fa700 1 --2- 172.21.15.82:0/2720251244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce701591b0 0x7fce70159630 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce769fa700 1 --2- 172.21.15.82:0/2720251244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce7015d560 0x7fce700d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce769fa700 1 -- 172.21.15.82:0/2720251244 >> 172.21.15.82:0/2720251244 conn(0x7fce700d1180 msgr2=0x7fce70069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce769fa700 1 -- 172.21.15.82:0/2720251244 shutdown_connections 2023-10-06T03:16:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.093+0000 7fce769fa700 1 -- 172.21.15.82:0/2720251244 wait complete. 2023-10-06T03:16:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.094+0000 7fce769fa700 1 Processor -- start 2023-10-06T03:16:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.094+0000 7fce769fa700 1 -- start start 2023-10-06T03:16:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce769fa700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce701591b0 0x7fce7015b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce769fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce7015d560 0x7fce70149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce769fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce7015d930 0x7fce700a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce769fa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce700a71a0 con 0x7fce7015d560 2023-10-06T03:16:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce769fa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7015bc60 con 0x7fce7015d930 2023-10-06T03:16:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce769fa700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7015bf00 con 0x7fce701591b0 2023-10-06T03:16:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce7015d560 0x7fce70149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce7015d560 0x7fce70149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37058/0 (socket says 172.21.15.82:37058) 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6f7fe700 1 -- 172.21.15.82:0/3327553114 learned_addr learned my addr 172.21.15.82:0/3327553114 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6ffff700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce701591b0 0x7fce7015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce74f97700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce7015d930 0x7fce700a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6f7fe700 1 -- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce701591b0 msgr2=0x7fce7015b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6f7fe700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce701591b0 0x7fce7015b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6f7fe700 1 -- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce7015d930 msgr2=0x7fce700a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6f7fe700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce7015d930 0x7fce700a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.095+0000 7fce6f7fe700 1 -- 172.21.15.82:0/3327553114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68009ae0 con 0x7fce7015d560 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.096+0000 7fce6f7fe700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce7015d560 0x7fce70149030 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b5e0 tx=0x7fce60009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.096+0000 7fce57fff700 1 -- 172.21.15.82:0/3327553114 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000f510 con 0x7fce7015d560 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.096+0000 7fce57fff700 1 -- 172.21.15.82:0/3327553114 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000f670 con 0x7fce7015d560 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.096+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7015c1e0 con 0x7fce7015d560 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.096+0000 7fce57fff700 1 -- 172.21.15.82:0/3327553114 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000fa30 con 0x7fce7015d560 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.096+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce70149570 con 0x7fce7015d560 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.097+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7015c700 con 0x7fce7015d560 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.097+0000 7fce57fff700 1 -- 172.21.15.82:0/3327553114 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce6001a400 con 0x7fce7015d560 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.097+0000 7fce57fff700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fce5c066f30 0x7fce5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.097+0000 7fce57fff700 1 -- 172.21.15.82:0/3327553114 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce600841c0 con 0x7fce7015d560 2023-10-06T03:16:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.098+0000 7fce6ffff700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fce5c066f30 0x7fce5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.098+0000 7fce6ffff700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fce5c066f30 0x7fce5c0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fce6400ac00 tx=0x7fce64006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.102+0000 7fce57fff700 1 -- 172.21.15.82:0/3327553114 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce7015c700 con 0x7fce7015d560 2023-10-06T03:16:49.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.327+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce700a6f70 con 0x7fce7015d560 2023-10-06T03:16:49.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.328+0000 7fce57fff700 1 -- 172.21.15.82:0/3327553114 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fce700a6f70 con 0x7fce7015d560 2023-10-06T03:16:49.329 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:49.330 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/968017372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":968017372},{"type":"v1","addr":"172.21.15.134:6836","nonce":968017372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1664218192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1664218192},{"type":"v1","addr":"172.21.15.82:6834","nonce":1664218192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2857365191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":2857365191},{"type":"v1","addr":"172.21.15.82:6835","nonce":2857365191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:16:36.965976+0000","modified":"2023-10-06T03:16:40.600885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/4000888931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":4000888931},{"type":"v1","addr":"172.21.15.134:6837","nonce":4000888931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:16:49.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fce5c066f30 msgr2=0x7fce5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fce5c066f30 0x7fce5c0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fce6400ac00 tx=0x7fce64006f90 comp rx=0 tx=0).stop 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce7015d560 msgr2=0x7fce70149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce7015d560 0x7fce70149030 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b5e0 tx=0x7fce60009120 comp rx=0 tx=0).stop 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 shutdown_connections 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce7015d930 0x7fce700a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fce5c066f30 0x7fce5c0693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce701591b0 0x7fce7015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 --2- 172.21.15.82:0/3327553114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce7015d560 0x7fce70149030 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 >> 172.21.15.82:0/3327553114 conn(0x7fce700d1180 msgr2=0x7fce700aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 shutdown_connections 2023-10-06T03:16:49.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.330+0000 7fce769fa700 1 -- 172.21.15.82:0/3327553114 wait complete. 2023-10-06T03:16:49.333 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2023-10-06T03:16:49.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.455+0000 7efcaebbc700 1 Processor -- start 2023-10-06T03:16:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.455+0000 7efcaebbc700 1 -- start start 2023-10-06T03:16:49.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcaebbc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efca815d560 0x7efca80d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcaebbc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efca815d930 0x7efca80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcaebbc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca80b2ad0 con 0x7efca81591b0 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcaebbc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80b4160 con 0x7efca815d560 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcaebbc700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80b1f80 con 0x7efca815d930 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcac958700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efca815d560 0x7efca80d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcad159700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efca81591b0 0x7efca8159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56374/0 (socket says 172.21.15.82:56374) 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcac958700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efca815d560 0x7efca80d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37064/0 (socket says 172.21.15.82:37064) 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.456+0000 7efcad159700 1 -- 172.21.15.82:0/881460520 learned_addr learned my addr 172.21.15.82:0/881460520 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efca7fff700 1 --2- 172.21.15.82:0/881460520 >> v2:172.21.15.134:3300/0 conn(0x7efca815d930 0x7efca80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcac958700 1 -- 172.21.15.82:0/881460520 >> v2:172.21.15.134:3300/0 conn(0x7efca815d930 msgr2=0x7efca80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcac958700 1 --2- 172.21.15.82:0/881460520 >> v2:172.21.15.134:3300/0 conn(0x7efca815d930 0x7efca80b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcac958700 1 -- 172.21.15.82:0/881460520 >> v1:172.21.15.82:6789/0 conn(0x7efca81591b0 legacy=0x7efca8159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcac958700 1 -- 172.21.15.82:0/881460520 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80b2230 con 0x7efca815d560 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efca7fff700 1 --2- 172.21.15.82:0/881460520 >> v2:172.21.15.134:3300/0 conn(0x7efca815d930 0x7efca80b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcac958700 1 --2- 172.21.15.82:0/881460520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca815d560 0x7efca80d0030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efca815e440 tx=0x7efc98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5804374d99bca4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efca77fe700 1 -- 172.21.15.82:0/881460520 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800e070 con 0x7efca815d560 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efca77fe700 1 -- 172.21.15.82:0/881460520 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9800bc30 con 0x7efca815d560 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efca77fe700 1 -- 172.21.15.82:0/881460520 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98012430 con 0x7efca815d560 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcaebbc700 1 -- 172.21.15.82:0/881460520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca815d560 msgr2=0x7efca80d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcaebbc700 1 --2- 172.21.15.82:0/881460520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca815d560 0x7efca80d0030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efca815e440 tx=0x7efc98009780 comp rx=0 tx=0).stop 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcaebbc700 1 -- 172.21.15.82:0/881460520 shutdown_connections 2023-10-06T03:16:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcaebbc700 1 --2- 172.21.15.82:0/881460520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca815d560 0x7efca80d0030 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcaebbc700 1 --2- 172.21.15.82:0/881460520 >> v2:172.21.15.134:3300/0 conn(0x7efca815d930 0x7efca80b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcaebbc700 1 -- 172.21.15.82:0/881460520 >> 172.21.15.82:0/881460520 conn(0x7efca80d1180 msgr2=0x7efca8069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:49.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.457+0000 7efcaebbc700 1 -- 172.21.15.82:0/881460520 shutdown_connections 2023-10-06T03:16:49.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.458+0000 7efcaebbc700 1 -- 172.21.15.82:0/881460520 wait complete. 2023-10-06T03:16:49.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.459+0000 7efcaebbc700 1 Processor -- start 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.459+0000 7efcaebbc700 1 -- start start 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.459+0000 7efcaebbc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca81591b0 0x7efca8169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.459+0000 7efcaebbc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efca815d560 0x7efca816d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.459+0000 7efcaebbc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efca815d930 0x7efca816de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcaebbc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80cbe80 con 0x7efca81591b0 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcaebbc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80cb270 con 0x7efca815d560 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcaebbc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80cb550 con 0x7efca815d930 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca81591b0 0x7efca8169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca81591b0 0x7efca8169b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37074/0 (socket says 172.21.15.82:37074) 2023-10-06T03:16:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 -- 172.21.15.82:0/1418946192 learned_addr learned my addr 172.21.15.82:0/1418946192 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efca7fff700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efca815d560 0x7efca816d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcad159700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efca815d930 0x7efca816de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 -- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efca815d930 msgr2=0x7efca816de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efca815d930 0x7efca816de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 -- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efca815d560 msgr2=0x7efca816d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efca815d560 0x7efca816d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 -- 172.21.15.82:0/1418946192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009a20 con 0x7efca81591b0 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efca7fff700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efca815d560 0x7efca816d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcac958700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca81591b0 0x7efca8169b10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efc98009fd0 tx=0x7efc98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efca4ff9700 1 -- 172.21.15.82:0/1418946192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9801d630 con 0x7efca81591b0 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efca4ff9700 1 -- 172.21.15.82:0/1418946192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9801d7b0 con 0x7efca81591b0 2023-10-06T03:16:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca80cb830 con 0x7efca81591b0 2023-10-06T03:16:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efca4ff9700 1 -- 172.21.15.82:0/1418946192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9801db70 con 0x7efca81591b0 2023-10-06T03:16:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.460+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca816a050 con 0x7efca81591b0 2023-10-06T03:16:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.461+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8064050 con 0x7efca81591b0 2023-10-06T03:16:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.461+0000 7efca4ff9700 1 -- 172.21.15.82:0/1418946192 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc98024070 con 0x7efca81591b0 2023-10-06T03:16:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.462+0000 7efca4ff9700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efc94066f30 0x7efc940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.462+0000 7efca4ff9700 1 -- 172.21.15.82:0/1418946192 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efc98086e30 con 0x7efca81591b0 2023-10-06T03:16:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.462+0000 7efca7fff700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efc94066f30 0x7efc940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.462+0000 7efca7fff700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efc94066f30 0x7efc940693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efca816ea10 tx=0x7efc9c006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.466+0000 7efca4ff9700 1 -- 172.21.15.82:0/1418946192 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc98053f40 con 0x7efca81591b0 2023-10-06T03:16:49.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.654+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efca80b2510 con 0x7efca81591b0 2023-10-06T03:16:49.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.654+0000 7efca4ff9700 1 -- 172.21.15.82:0/1418946192 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16866 (secure 0 0 0) 0x7efc98057560 con 0x7efca81591b0 2023-10-06T03:16:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:49.656 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:16:38.582429+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:16:35.054163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:16:35.928949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:49.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efc94066f30 msgr2=0x7efc940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efc94066f30 0x7efc940693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efca816ea10 tx=0x7efc9c006f90 comp rx=0 tx=0).stop 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca81591b0 msgr2=0x7efca8169b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca81591b0 0x7efca8169b10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efc98009fd0 tx=0x7efc98019000 comp rx=0 tx=0).stop 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 shutdown_connections 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7efc94066f30 0x7efc940693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efca815d930 0x7efca816de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca81591b0 0x7efca8169b10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 --2- 172.21.15.82:0/1418946192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efca815d560 0x7efca816d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 >> 172.21.15.82:0/1418946192 conn(0x7efca80d1180 msgr2=0x7efca80688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 shutdown_connections 2023-10-06T03:16:49.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.657+0000 7efcaebbc700 1 -- 172.21.15.82:0/1418946192 wait complete. 2023-10-06T03:16:49.670 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:16:49.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:49.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.783+0000 7fea3236a700 1 Processor -- start 2023-10-06T03:16:49.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.783+0000 7fea3236a700 1 -- start start 2023-10-06T03:16:49.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.784+0000 7fea3236a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea2c0ae860 0x7fea2c0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.784+0000 7fea3236a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2c0ad3c0 con 0x7fea2c159580 2023-10-06T03:16:49.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.784+0000 7fea3236a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2c0b0ec0 con 0x7fea2c159950 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.784+0000 7fea3236a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2c0b11a0 con 0x7fea2c0ae860 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.784+0000 7fea30907700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea2c0ae860 0x7fea2c0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.784+0000 7fea2bfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fea2c159580 0x7fea2c0b2790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56382/0 (socket says 172.21.15.82:56382) 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.784+0000 7fea2bfff700 1 -- 172.21.15.82:0/3518833079 learned_addr learned my addr 172.21.15.82:0/3518833079 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.785+0000 7fea30907700 1 -- 172.21.15.82:0/3518833079 >> v1:172.21.15.134:6789/0 conn(0x7fea2c159950 legacy=0x7fea2c0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.785+0000 7fea30907700 1 -- 172.21.15.82:0/3518833079 >> v1:172.21.15.82:6789/0 conn(0x7fea2c159580 legacy=0x7fea2c0b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.785+0000 7fea2affd700 1 -- 172.21.15.82:0/3518833079 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042332043 0 0) 0x7fea2c0ad3c0 con 0x7fea2c159580 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.785+0000 7fea30907700 1 -- 172.21.15.82:0/3518833079 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c0acd70 con 0x7fea2c0ae860 2023-10-06T03:16:49.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.785+0000 7fea30907700 1 --2- 172.21.15.82:0/3518833079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c0ae860 0x7fea2c0b08a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fea24009e60 tx=0x7fea24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7671119e98b4f50d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.785+0000 7fea2affd700 1 -- 172.21.15.82:0/3518833079 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2400e070 con 0x7fea2c0ae860 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.785+0000 7fea2affd700 1 -- 172.21.15.82:0/3518833079 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2400bbf0 con 0x7fea2c0ae860 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.785+0000 7fea2affd700 1 -- 172.21.15.82:0/3518833079 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24012430 con 0x7fea2c0ae860 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.786+0000 7fea3236a700 1 -- 172.21.15.82:0/3518833079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c0ae860 msgr2=0x7fea2c0b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.786+0000 7fea3236a700 1 --2- 172.21.15.82:0/3518833079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c0ae860 0x7fea2c0b08a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fea24009e60 tx=0x7fea24009780 comp rx=0 tx=0).stop 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.786+0000 7fea3236a700 1 -- 172.21.15.82:0/3518833079 shutdown_connections 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.786+0000 7fea3236a700 1 --2- 172.21.15.82:0/3518833079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c0ae860 0x7fea2c0b08a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.786+0000 7fea3236a700 1 -- 172.21.15.82:0/3518833079 >> 172.21.15.82:0/3518833079 conn(0x7fea2c06e6f0 msgr2=0x7fea2c06afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.786+0000 7fea3236a700 1 -- 172.21.15.82:0/3518833079 shutdown_connections 2023-10-06T03:16:49.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.786+0000 7fea3236a700 1 -- 172.21.15.82:0/3518833079 wait complete. 2023-10-06T03:16:49.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.787+0000 7fea3236a700 1 Processor -- start 2023-10-06T03:16:49.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.787+0000 7fea3236a700 1 -- start start 2023-10-06T03:16:49.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea3236a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea2c0ae860 0x7fea2c151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea3236a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea2c159580 0x7fea2c14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea3236a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c159950 0x7fea2c14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea3236a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c0aa6a0 con 0x7fea2c159950 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea3236a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c14f2c0 con 0x7fea2c159580 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea3236a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c14ed60 con 0x7fea2c0ae860 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c159950 0x7fea2c14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c159950 0x7fea2c14cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37086/0 (socket says 172.21.15.82:37086) 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 -- 172.21.15.82:0/3616398443 learned_addr learned my addr 172.21.15.82:0/3616398443 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea2bfff700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea2c0ae860 0x7fea2c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea2b7fe700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea2c159580 0x7fea2c14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 -- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea2c0ae860 msgr2=0x7fea2c151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea2c0ae860 0x7fea2c151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 -- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea2c159580 msgr2=0x7fea2c14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:49.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea2c159580 0x7fea2c14ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 -- 172.21.15.82:0/3616398443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24009a20 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea30907700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c159950 0x7fea2c14cf70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea2c071140 tx=0x7fea24018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea13fff700 1 -- 172.21.15.82:0/3616398443 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2401e710 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea13fff700 1 -- 172.21.15.82:0/3616398443 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2401e870 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c0aa940 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea13fff700 1 -- 172.21.15.82:0/3616398443 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2401ec30 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.788+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2c151780 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.789+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2c151970 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.790+0000 7fea13fff700 1 -- 172.21.15.82:0/3616398443 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea24024070 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.790+0000 7fea13fff700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.790+0000 7fea13fff700 1 -- 172.21.15.82:0/3616398443 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea24087290 con 0x7fea2c159950 2023-10-06T03:16:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.790+0000 7fea2bfff700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:49.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.791+0000 7fea2bfff700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fea18066f30 0x7fea180693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0011e0 tx=0x7fea1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:49.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:49.794+0000 7fea13fff700 1 -- 172.21.15.82:0/3616398443 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea24054450 con 0x7fea2c159950 2023-10-06T03:16:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.018+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea2c064050 con 0x7fea2c159950 2023-10-06T03:16:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.018+0000 7fea13fff700 1 -- 172.21.15.82:0/3616398443 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fea24057a70 con 0x7fea2c159950 2023-10-06T03:16:50.020 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:50.020 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/968017372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":968017372},{"type":"v1","addr":"172.21.15.134:6836","nonce":968017372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1664218192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1664218192},{"type":"v1","addr":"172.21.15.82:6834","nonce":1664218192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2857365191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":2857365191},{"type":"v1","addr":"172.21.15.82:6835","nonce":2857365191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:16:36.965976+0000","modified":"2023-10-06T03:16:40.600885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/4000888931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":4000888931},{"type":"v1","addr":"172.21.15.134:6837","nonce":4000888931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:16:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fea18066f30 msgr2=0x7fea180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fea18066f30 0x7fea180693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0011e0 tx=0x7fea1c009040 comp rx=0 tx=0).stop 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c159950 msgr2=0x7fea2c14cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c159950 0x7fea2c14cf70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea2c071140 tx=0x7fea24018000 comp rx=0 tx=0).stop 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 shutdown_connections 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2c159950 0x7fea2c14cf70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea2c0ae860 0x7fea2c151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 --2- 172.21.15.82:0/3616398443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea2c159580 0x7fea2c14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 >> 172.21.15.82:0/3616398443 conn(0x7fea2c06e6f0 msgr2=0x7fea2c14e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 shutdown_connections 2023-10-06T03:16:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.020+0000 7fea3236a700 1 -- 172.21.15.82:0/3616398443 wait complete. 2023-10-06T03:16:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2023-10-06T03:16:50.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:50.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.148+0000 7f9928bed700 1 Processor -- start 2023-10-06T03:16:50.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.148+0000 7f9928bed700 1 -- start start 2023-10-06T03:16:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9928bed700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d560 0x7f99240d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9928bed700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99241591b0 0x7f9924159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9928bed700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99240b2ad0 con 0x7f992415d930 2023-10-06T03:16:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9928bed700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99240b4160 con 0x7f99241591b0 2023-10-06T03:16:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9928bed700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9924159b70 con 0x7f992415d560 2023-10-06T03:16:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9922d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99241591b0 0x7f9924159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9921d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f992415d930 0x7f99240b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56388/0 (socket says 172.21.15.82:56388) 2023-10-06T03:16:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9922d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99241591b0 0x7f9924159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37100/0 (socket says 172.21.15.82:37100) 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9921d9b700 1 -- 172.21.15.82:0/1556461383 learned_addr learned my addr 172.21.15.82:0/1556461383 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f992259c700 1 --2- 172.21.15.82:0/1556461383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d560 0x7f99240d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9922d9d700 1 -- 172.21.15.82:0/1556461383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d560 msgr2=0x7f99240d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9922d9d700 1 --2- 172.21.15.82:0/1556461383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d560 0x7f99240d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9922d9d700 1 -- 172.21.15.82:0/1556461383 >> v1:172.21.15.82:6789/0 conn(0x7f992415d930 legacy=0x7f99240b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9922d9d700 1 -- 172.21.15.82:0/1556461383 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99240b2230 con 0x7f99241591b0 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f9922d9d700 1 --2- 172.21.15.82:0/1556461383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924159630 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f991c009e60 tx=0x7f991c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de8b0827799209 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f992159a700 1 -- 172.21.15.82:0/1556461383 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c00e070 con 0x7f99241591b0 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f992159a700 1 -- 172.21.15.82:0/1556461383 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c00bc30 con 0x7f99241591b0 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.149+0000 7f992159a700 1 -- 172.21.15.82:0/1556461383 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c012430 con 0x7f99241591b0 2023-10-06T03:16:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.150+0000 7f9928bed700 1 -- 172.21.15.82:0/1556461383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 msgr2=0x7f9924159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.150+0000 7f9928bed700 1 --2- 172.21.15.82:0/1556461383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924159630 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f991c009e60 tx=0x7f991c009780 comp rx=0 tx=0).stop 2023-10-06T03:16:50.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.150+0000 7f9928bed700 1 -- 172.21.15.82:0/1556461383 shutdown_connections 2023-10-06T03:16:50.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.150+0000 7f9928bed700 1 --2- 172.21.15.82:0/1556461383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924159630 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.150+0000 7f9928bed700 1 --2- 172.21.15.82:0/1556461383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d560 0x7f99240d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.150+0000 7f9928bed700 1 -- 172.21.15.82:0/1556461383 >> 172.21.15.82:0/1556461383 conn(0x7f99240d1180 msgr2=0x7f9924069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:50.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.150+0000 7f9928bed700 1 -- 172.21.15.82:0/1556461383 shutdown_connections 2023-10-06T03:16:50.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.150+0000 7f9928bed700 1 -- 172.21.15.82:0/1556461383 wait complete. 2023-10-06T03:16:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.151+0000 7f9928bed700 1 Processor -- start 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.151+0000 7f9928bed700 1 -- start start 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9928bed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9928bed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992415d560 0x7f992415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9928bed700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d930 0x7f9924144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9928bed700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9924144650 con 0x7f99241591b0 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9928bed700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992415bc30 con 0x7f992415d560 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9928bed700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992415bf10 con 0x7f992415d930 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37110/0 (socket says 172.21.15.82:37110) 2023-10-06T03:16:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 -- 172.21.15.82:0/3262083609 learned_addr learned my addr 172.21.15.82:0/3262083609 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9922d9d700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d930 0x7f9924144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9921d9b700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992415d560 0x7f992415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 -- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d930 msgr2=0x7f9924144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d930 0x7f9924144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 -- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992415d560 msgr2=0x7f992415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992415d560 0x7f992415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 -- 172.21.15.82:0/3262083609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c009a20 con 0x7f99241591b0 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f9921d9b700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992415d560 0x7f992415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.152+0000 7f992259c700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924154a70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f991400d890 tx=0x7f9914008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.153+0000 7f99127fc700 1 -- 172.21.15.82:0/3262083609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400b600 con 0x7f99241591b0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.153+0000 7f99127fc700 1 -- 172.21.15.82:0/3262083609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400b760 con 0x7f99241591b0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.153+0000 7f99127fc700 1 -- 172.21.15.82:0/3262083609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400bae0 con 0x7f99241591b0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.153+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992415c1f0 con 0x7f99241591b0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.153+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992415c7b0 con 0x7f99241591b0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.153+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992415cb20 con 0x7f99241591b0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.154+0000 7f99127fc700 1 -- 172.21.15.82:0/3262083609 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f991401e460 con 0x7f99241591b0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.154+0000 7f99127fc700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9904066f30 0x7f99040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.154+0000 7f99127fc700 1 -- 172.21.15.82:0/3262083609 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9914084d70 con 0x7f99241591b0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.155+0000 7f9921d9b700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9904066f30 0x7f99040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.155+0000 7f9921d9b700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9904066f30 0x7f99040693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f992415b2e0 tx=0x7f9918009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.158+0000 7f99127fc700 1 -- 172.21.15.82:0/3262083609 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9914051e80 con 0x7f99241591b0 2023-10-06T03:16:50.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.383+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9924064050 con 0x7f99241591b0 2023-10-06T03:16:50.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.383+0000 7f99127fc700 1 -- 172.21.15.82:0/3262083609 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f99140554a0 con 0x7f99241591b0 2023-10-06T03:16:50.385 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:50.385 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/968017372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":968017372},{"type":"v1","addr":"172.21.15.134:6836","nonce":968017372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1664218192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1664218192},{"type":"v1","addr":"172.21.15.82:6834","nonce":1664218192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2857365191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":2857365191},{"type":"v1","addr":"172.21.15.82:6835","nonce":2857365191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:16:36.965976+0000","modified":"2023-10-06T03:16:40.600885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6837/4000888931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":4000888931},{"type":"v1","addr":"172.21.15.134:6837","nonce":4000888931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:16:50.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9904066f30 msgr2=0x7f99040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9904066f30 0x7f99040693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f992415b2e0 tx=0x7f9918009040 comp rx=0 tx=0).stop 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 msgr2=0x7f9924154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924154a70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f991400d890 tx=0x7f9914008040 comp rx=0 tx=0).stop 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 shutdown_connections 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9904066f30 0x7f99040693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f992415d930 0x7f9924144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99241591b0 0x7f9924154a70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 --2- 172.21.15.82:0/3262083609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992415d560 0x7f992415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 >> 172.21.15.82:0/3262083609 conn(0x7f99240d1180 msgr2=0x7f99240b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:50.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 shutdown_connections 2023-10-06T03:16:50.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.385+0000 7f9928bed700 1 -- 172.21.15.82:0/3262083609 wait complete. 2023-10-06T03:16:50.389 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2023-10-06T03:16:50.399 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:50.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.512+0000 7f36e96c5700 1 Processor -- start 2023-10-06T03:16:50.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.512+0000 7f36e96c5700 1 -- start start 2023-10-06T03:16:50.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e96c5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e96c5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36e40d1030 0x7f36e40c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e96c5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e40ae140 con 0x7f36e40c6bf0 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e96c5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e40cc390 con 0x7f36e40d1030 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e96c5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40c7070 con 0x7f36e40cdc00 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36da7fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36e40d1030 0x7f36e40c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e2ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e37fe700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f36e40c6bf0 0x7f36e40ae5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:36472/0 (socket says 172.21.15.82:36472) 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e2ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:60426/0 (socket says 172.21.15.82:60426) 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.513+0000 7f36e37fe700 1 -- 172.21.15.82:0/172081980 learned_addr learned my addr 172.21.15.82:0/172081980 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36da7fc700 1 -- 172.21.15.82:0/172081980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 msgr2=0x7f36e40cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:50.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36da7fc700 1 --2- 172.21.15.82:0/172081980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36da7fc700 1 -- 172.21.15.82:0/172081980 >> v1:172.21.15.134:6789/0 conn(0x7f36e40c6bf0 legacy=0x7f36e40ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36da7fc700 1 -- 172.21.15.82:0/172081980 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40ad530 con 0x7f36e40d1030 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36e2ffd700 1 --2- 172.21.15.82:0/172081980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36da7fc700 1 --2- 172.21.15.82:0/172081980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40d1030 0x7f36e40c66b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009910 tx=0x7f36cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5288c9f9dae6ab86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36e27fc700 1 -- 172.21.15.82:0/172081980 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00b640 con 0x7f36e40d1030 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36e27fc700 1 -- 172.21.15.82:0/172081980 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc00b7a0 con 0x7f36e40d1030 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.514+0000 7f36e27fc700 1 -- 172.21.15.82:0/172081980 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00bb60 con 0x7f36e40d1030 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.515+0000 7f36e96c5700 1 -- 172.21.15.82:0/172081980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40d1030 msgr2=0x7f36e40c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.515+0000 7f36e96c5700 1 --2- 172.21.15.82:0/172081980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40d1030 0x7f36e40c66b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009910 tx=0x7f36cc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.515+0000 7f36e96c5700 1 -- 172.21.15.82:0/172081980 shutdown_connections 2023-10-06T03:16:50.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.515+0000 7f36e96c5700 1 --2- 172.21.15.82:0/172081980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.515+0000 7f36e96c5700 1 --2- 172.21.15.82:0/172081980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40d1030 0x7f36e40c66b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.515+0000 7f36e96c5700 1 -- 172.21.15.82:0/172081980 >> 172.21.15.82:0/172081980 conn(0x7f36e4099990 msgr2=0x7f36e40b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:50.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.515+0000 7f36e96c5700 1 -- 172.21.15.82:0/172081980 shutdown_connections 2023-10-06T03:16:50.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.515+0000 7f36e96c5700 1 -- 172.21.15.82:0/172081980 wait complete. 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.516+0000 7f36e96c5700 1 Processor -- start 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.516+0000 7f36e96c5700 1 -- start start 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e96c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40c6bf0 0x7f36e414b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e96c5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e96c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36e40d1030 0x7f36e40afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e96c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40b2440 con 0x7f36e40d1030 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e96c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40b2160 con 0x7f36e40c6bf0 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e96c5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4067760 con 0x7f36e40cdc00 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36e40d1030 0x7f36e40afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36e40d1030 0x7f36e40afe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37124/0 (socket says 172.21.15.82:37124) 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 -- 172.21.15.82:0/2547460943 learned_addr learned my addr 172.21.15.82:0/2547460943 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e2ffd700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40c6bf0 0x7f36e414b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36da7fc700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 -- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 msgr2=0x7f36e40af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 -- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40c6bf0 msgr2=0x7f36e414b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40c6bf0 0x7f36e414b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 -- 172.21.15.82:0/2547460943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40093c0 con 0x7f36e40d1030 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e37fe700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36e40d1030 0x7f36e40afe50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00cc40 tx=0x7f36dc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36db7fe700 1 -- 172.21.15.82:0/2547460943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00a8b0 con 0x7f36e40d1030 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36db7fe700 1 -- 172.21.15.82:0/2547460943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc00aa10 con 0x7f36e40d1030 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc009420 con 0x7f36e40d1030 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36db7fe700 1 -- 172.21.15.82:0/2547460943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00add0 con 0x7f36e40d1030 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.517+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e4067d20 con 0x7f36e40d1030 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.518+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e4064050 con 0x7f36e40d1030 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.519+0000 7f36db7fe700 1 -- 172.21.15.82:0/2547460943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36dc007300 con 0x7f36e40d1030 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.519+0000 7f36db7fe700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f36c4066f30 0x7f36c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.519+0000 7f36db7fe700 1 -- 172.21.15.82:0/2547460943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f36dc084950 con 0x7f36e40d1030 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.519+0000 7f36e2ffd700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f36c4066f30 0x7f36c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.520+0000 7f36e2ffd700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f36c4066f30 0x7f36c40693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009f30 tx=0x7f36d4009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.523+0000 7f36db7fe700 1 -- 172.21.15.82:0/2547460943 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36dc051ae0 con 0x7f36e40d1030 2023-10-06T03:16:50.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.709+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36e40cc0c0 con 0x7f36e40d1030 2023-10-06T03:16:50.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.710+0000 7f36db7fe700 1 -- 172.21.15.82:0/2547460943 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f36dc055100 con 0x7f36e40d1030 2023-10-06T03:16:50.712 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:50.713 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:16:38.582429+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:16:35.054163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:16:35.928949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:50.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f36c4066f30 msgr2=0x7f36c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f36c4066f30 0x7f36c40693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009f30 tx=0x7f36d4009120 comp rx=0 tx=0).stop 2023-10-06T03:16:50.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36e40d1030 msgr2=0x7f36e40afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36e40d1030 0x7f36e40afe50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00cc40 tx=0x7f36dc001a50 comp rx=0 tx=0).stop 2023-10-06T03:16:50.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 shutdown_connections 2023-10-06T03:16:50.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36e40d1030 0x7f36e40afe50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e40c6bf0 0x7f36e414b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f36c4066f30 0x7f36c40693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 --2- 172.21.15.82:0/2547460943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e40cdc00 0x7f36e40af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 >> 172.21.15.82:0/2547460943 conn(0x7f36e4099990 msgr2=0x7f36e41590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:50.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 shutdown_connections 2023-10-06T03:16:50.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.712+0000 7f36e96c5700 1 -- 172.21.15.82:0/2547460943 wait complete. 2023-10-06T03:16:50.726 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:16:50.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.840+0000 7feb1ce80700 1 Processor -- start 2023-10-06T03:16:50.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.840+0000 7feb1ce80700 1 -- start start 2023-10-06T03:16:50.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1ce80700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb181598d0 0x7feb180cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1ce80700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb180cba90 con 0x7feb18159500 2023-10-06T03:16:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1ce80700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb180cbd70 con 0x7feb180cf910 2023-10-06T03:16:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1ce80700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb180cc050 con 0x7feb181598d0 2023-10-06T03:16:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb16d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb181598d0 0x7feb180cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feb18159500 0x7feb180cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56394/0 (socket says 172.21.15.82:56394) 2023-10-06T03:16:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1659c700 1 -- 172.21.15.82:0/2781030378 learned_addr learned my addr 172.21.15.82:0/2781030378 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb16d9d700 1 -- 172.21.15.82:0/2781030378 >> v1:172.21.15.134:6789/0 conn(0x7feb180cf910 legacy=0x7feb180cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb16d9d700 1 -- 172.21.15.82:0/2781030378 >> v1:172.21.15.82:6789/0 conn(0x7feb18159500 legacy=0x7feb180cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1559a700 1 -- 172.21.15.82:0/2781030378 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202070931 0 0) 0x7feb180cba90 con 0x7feb18159500 2023-10-06T03:16:50.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb16d9d700 1 -- 172.21.15.82:0/2781030378 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180cc330 con 0x7feb181598d0 2023-10-06T03:16:50.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb16d9d700 1 --2- 172.21.15.82:0/2781030378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb181598d0 0x7feb180cb450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feb10009e60 tx=0x7feb10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dabb137cf533f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1559a700 1 -- 172.21.15.82:0/2781030378 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000e070 con 0x7feb181598d0 2023-10-06T03:16:50.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1559a700 1 -- 172.21.15.82:0/2781030378 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1000bc30 con 0x7feb181598d0 2023-10-06T03:16:50.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.841+0000 7feb1559a700 1 -- 172.21.15.82:0/2781030378 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10012430 con 0x7feb181598d0 2023-10-06T03:16:50.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.842+0000 7feb1ce80700 1 -- 172.21.15.82:0/2781030378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb181598d0 msgr2=0x7feb180cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.842+0000 7feb1ce80700 1 --2- 172.21.15.82:0/2781030378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb181598d0 0x7feb180cb450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feb10009e60 tx=0x7feb10009780 comp rx=0 tx=0).stop 2023-10-06T03:16:50.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.842+0000 7feb1ce80700 1 -- 172.21.15.82:0/2781030378 shutdown_connections 2023-10-06T03:16:50.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.842+0000 7feb1ce80700 1 --2- 172.21.15.82:0/2781030378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb181598d0 0x7feb180cb450 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.842+0000 7feb1ce80700 1 -- 172.21.15.82:0/2781030378 >> 172.21.15.82:0/2781030378 conn(0x7feb180cd090 msgr2=0x7feb180cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:50.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.842+0000 7feb1ce80700 1 -- 172.21.15.82:0/2781030378 shutdown_connections 2023-10-06T03:16:50.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.842+0000 7feb1ce80700 1 -- 172.21.15.82:0/2781030378 wait complete. 2023-10-06T03:16:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.843+0000 7feb1ce80700 1 Processor -- start 2023-10-06T03:16:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.843+0000 7feb1ce80700 1 -- start start 2023-10-06T03:16:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1ce80700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb180cf910 0x7feb181410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1ce80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb18159500 0x7feb1816a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1ce80700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb181598d0 0x7feb18156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1ce80700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb18153f90 con 0x7feb18159500 2023-10-06T03:16:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1ce80700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb18141600 con 0x7feb181598d0 2023-10-06T03:16:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1ce80700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb18154510 con 0x7feb180cf910 2023-10-06T03:16:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb18159500 0x7feb1816a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb18159500 0x7feb1816a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37138/0 (socket says 172.21.15.82:37138) 2023-10-06T03:16:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 -- 172.21.15.82:0/1969264092 learned_addr learned my addr 172.21.15.82:0/1969264092 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb16d9d700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb181598d0 0x7feb18156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1659c700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb180cf910 0x7feb181410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 -- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb180cf910 msgr2=0x7feb181410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb180cf910 0x7feb181410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 -- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb181598d0 msgr2=0x7feb18156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb181598d0 0x7feb18156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 -- 172.21.15.82:0/1969264092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb10009a20 con 0x7feb18159500 2023-10-06T03:16:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb15d9b700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb18159500 0x7feb1816a5d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00c5c0 tx=0x7feb0c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb067fc700 1 -- 172.21.15.82:0/1969264092 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c011590 con 0x7feb18159500 2023-10-06T03:16:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb067fc700 1 -- 172.21.15.82:0/1969264092 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c011710 con 0x7feb18159500 2023-10-06T03:16:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1816ab10 con 0x7feb18159500 2023-10-06T03:16:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb067fc700 1 -- 172.21.15.82:0/1969264092 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c011ad0 con 0x7feb18159500 2023-10-06T03:16:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.844+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb181538a0 con 0x7feb18159500 2023-10-06T03:16:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.845+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb18064050 con 0x7feb18159500 2023-10-06T03:16:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.846+0000 7feb067fc700 1 -- 172.21.15.82:0/1969264092 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb0c01b3b0 con 0x7feb18159500 2023-10-06T03:16:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.846+0000 7feb067fc700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7feaf8066f30 0x7feaf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.846+0000 7feb067fc700 1 -- 172.21.15.82:0/1969264092 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feb0c083c70 con 0x7feb18159500 2023-10-06T03:16:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.846+0000 7feb1659c700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7feaf8066f30 0x7feaf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.847+0000 7feb1659c700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7feaf8066f30 0x7feaf80693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feb18158850 tx=0x7feb08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:50.850+0000 7feb067fc700 1 -- 172.21.15.82:0/1969264092 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb0c050d80 con 0x7feb18159500 2023-10-06T03:16:51.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.075+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feb18154650 con 0x7feb18159500 2023-10-06T03:16:51.077 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-10-06T03:16:51.075+0000 7fbfe891d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:16:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.079+0000 7feb067fc700 1 -- 172.21.15.82:0/1969264092 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7feb0c017020 con 0x7feb18159500 2023-10-06T03:16:51.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7feaf8066f30 msgr2=0x7feaf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:51.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7feaf8066f30 0x7feaf80693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feb18158850 tx=0x7feb08009040 comp rx=0 tx=0).stop 2023-10-06T03:16:51.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb18159500 msgr2=0x7feb1816a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:51.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb18159500 0x7feb1816a5d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00c5c0 tx=0x7feb0c00c980 comp rx=0 tx=0).stop 2023-10-06T03:16:51.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 shutdown_connections 2023-10-06T03:16:51.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb181598d0 0x7feb18156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7feaf8066f30 0x7feaf80693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb180cf910 0x7feb181410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 --2- 172.21.15.82:0/1969264092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb18159500 0x7feb1816a5d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.081+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 >> 172.21.15.82:0/1969264092 conn(0x7feb180cd090 msgr2=0x7feb180c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:51.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.082+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 shutdown_connections 2023-10-06T03:16:51.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.082+0000 7feb1ce80700 1 -- 172.21.15.82:0/1969264092 wait complete. 2023-10-06T03:16:51.085 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:16:51.086 INFO:tasks.ceph.mds.d.smithi134.stderr: -2391> 2023-10-06T03:16:41.570+0000 7fce4aae4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:16:51.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:16:51.109 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-10-06T03:16:51.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.209+0000 7fae54cbf700 1 Processor -- start 2023-10-06T03:16:51.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.209+0000 7fae54cbf700 1 -- start start 2023-10-06T03:16:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae54cbf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae50159500 0x7fae501598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae54cbf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae5015dab0 0x7fae500cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae54cbf700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae500b1110 con 0x7fae500b3fd0 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae54cbf700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500b13b0 con 0x7fae5015dab0 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae54cbf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500b1690 con 0x7fae50159500 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae5015dab0 0x7fae500cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae5015dab0 0x7fae500cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37148/0 (socket says 172.21.15.82:37148) 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4ed9d700 1 -- 172.21.15.82:0/3110673942 learned_addr learned my addr 172.21.15.82:0/3110673942 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4e59c700 1 --2- 172.21.15.82:0/3110673942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae50159500 0x7fae501598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4ed9d700 1 -- 172.21.15.82:0/3110673942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae50159500 msgr2=0x7fae501598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4ed9d700 1 --2- 172.21.15.82:0/3110673942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae50159500 0x7fae501598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4ed9d700 1 -- 172.21.15.82:0/3110673942 >> v1:172.21.15.134:6789/0 conn(0x7fae500b3fd0 legacy=0x7fae5015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4ed9d700 1 -- 172.21.15.82:0/3110673942 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500b1970 con 0x7fae5015dab0 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.210+0000 7fae4e59c700 1 --2- 172.21.15.82:0/3110673942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae50159500 0x7fae501598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae4ed9d700 1 --2- 172.21.15.82:0/3110673942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5015dab0 0x7fae500cf6c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fae48009f20 tx=0x7fae48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb45443334162b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae4dd9b700 1 -- 172.21.15.82:0/3110673942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800e070 con 0x7fae5015dab0 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae4dd9b700 1 -- 172.21.15.82:0/3110673942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800ba40 con 0x7fae5015dab0 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae4dd9b700 1 -- 172.21.15.82:0/3110673942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480092e0 con 0x7fae5015dab0 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae54cbf700 1 -- 172.21.15.82:0/3110673942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5015dab0 msgr2=0x7fae500cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae54cbf700 1 --2- 172.21.15.82:0/3110673942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5015dab0 0x7fae500cf6c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fae48009f20 tx=0x7fae48009840 comp rx=0 tx=0).stop 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae54cbf700 1 -- 172.21.15.82:0/3110673942 shutdown_connections 2023-10-06T03:16:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae54cbf700 1 --2- 172.21.15.82:0/3110673942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5015dab0 0x7fae500cf6c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae54cbf700 1 --2- 172.21.15.82:0/3110673942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae50159500 0x7fae501598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae54cbf700 1 -- 172.21.15.82:0/3110673942 >> 172.21.15.82:0/3110673942 conn(0x7fae50067630 msgr2=0x7fae50069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae54cbf700 1 -- 172.21.15.82:0/3110673942 shutdown_connections 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.211+0000 7fae54cbf700 1 -- 172.21.15.82:0/3110673942 wait complete. 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae54cbf700 1 Processor -- start 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae54cbf700 1 -- start start 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae54cbf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae500b3fd0 0x7fae5014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae54cbf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae50159500 0x7fae50137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae54cbf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae5015dab0 0x7fae50149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae54cbf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5014bdf0 con 0x7fae50159500 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae54cbf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5014b1e0 con 0x7fae500b3fd0 2023-10-06T03:16:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae54cbf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5014b4c0 con 0x7fae5015dab0 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae45d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae50159500 0x7fae50137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae45d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae50159500 0x7fae50137f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37150/0 (socket says 172.21.15.82:37150) 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.213+0000 7fae45d9b700 1 -- 172.21.15.82:0/4078859254 learned_addr learned my addr 172.21.15.82:0/4078859254 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae4e59c700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae500b3fd0 0x7fae5014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae4ed9d700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae5015dab0 0x7fae50149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae45d9b700 1 -- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae5015dab0 msgr2=0x7fae50149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae45d9b700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae5015dab0 0x7fae50149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae45d9b700 1 -- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae500b3fd0 msgr2=0x7fae5014c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae45d9b700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae500b3fd0 0x7fae5014c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae45d9b700 1 -- 172.21.15.82:0/4078859254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009ae0 con 0x7fae50159500 2023-10-06T03:16:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae45d9b700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae50159500 0x7fae50137f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fae3800b5e0 tx=0x7fae38009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae46ffd700 1 -- 172.21.15.82:0/4078859254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800f510 con 0x7fae50159500 2023-10-06T03:16:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae46ffd700 1 -- 172.21.15.82:0/4078859254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3800f690 con 0x7fae50159500 2023-10-06T03:16:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5014b7a0 con 0x7fae50159500 2023-10-06T03:16:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae46ffd700 1 -- 172.21.15.82:0/4078859254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800fa50 con 0x7fae50159500 2023-10-06T03:16:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.214+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5014c7c0 con 0x7fae50159500 2023-10-06T03:16:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.215+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae50064050 con 0x7fae50159500 2023-10-06T03:16:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.215+0000 7fae46ffd700 1 -- 172.21.15.82:0/4078859254 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae3801a400 con 0x7fae50159500 2023-10-06T03:16:51.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.216+0000 7fae46ffd700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae30066f30 0x7fae300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:51.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.216+0000 7fae46ffd700 1 -- 172.21.15.82:0/4078859254 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fae38084250 con 0x7fae50159500 2023-10-06T03:16:51.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.216+0000 7fae4e59c700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae30066f30 0x7fae300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:51.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.216+0000 7fae4e59c700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae30066f30 0x7fae300693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fae4000ac00 tx=0x7fae40006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:51.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.220+0000 7fae46ffd700 1 -- 172.21.15.82:0/4078859254 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae38051390 con 0x7fae50159500 2023-10-06T03:16:51.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:51.444+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fae5014bf30 con 0x7fae50159500 2023-10-06T03:16:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.083+0000 7fae46ffd700 1 -- 172.21.15.82:0/4078859254 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fae380549b0 con 0x7fae50159500 2023-10-06T03:16:52.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae30066f30 msgr2=0x7fae300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae30066f30 0x7fae300693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fae4000ac00 tx=0x7fae40006f90 comp rx=0 tx=0).stop 2023-10-06T03:16:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae50159500 msgr2=0x7fae50137f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae50159500 0x7fae50137f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fae3800b5e0 tx=0x7fae38009120 comp rx=0 tx=0).stop 2023-10-06T03:16:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 shutdown_connections 2023-10-06T03:16:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae30066f30 0x7fae300693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae5015dab0 0x7fae50149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae500b3fd0 0x7fae5014c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 --2- 172.21.15.82:0/4078859254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae50159500 0x7fae50137f20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 >> 172.21.15.82:0/4078859254 conn(0x7fae50067630 msgr2=0x7fae500b5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 shutdown_connections 2023-10-06T03:16:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.085+0000 7fae54cbf700 1 -- 172.21.15.82:0/4078859254 wait complete. 2023-10-06T03:16:52.103 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:16:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.221+0000 7fa7248d5700 1 Processor -- start 2023-10-06T03:16:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.221+0000 7fa7248d5700 1 -- start start 2023-10-06T03:16:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.222+0000 7fa7248d5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7200b3940 0x7fa7200b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.222+0000 7fa7248d5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa720159100 0x7fa720159570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.222+0000 7fa7248d5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa720069a10 con 0x7fa72015d450 2023-10-06T03:16:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.222+0000 7fa7248d5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72006a590 con 0x7fa720159100 2023-10-06T03:16:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.222+0000 7fa7248d5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa720069cf0 con 0x7fa7200b3940 2023-10-06T03:16:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.222+0000 7fa71ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa720159100 0x7fa720159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.222+0000 7fa715d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa72015d450 0x7fa7200691e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56402/0 (socket says 172.21.15.82:56402) 2023-10-06T03:16:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.222+0000 7fa715d9b700 1 -- 172.21.15.82:0/1107729211 learned_addr learned my addr 172.21.15.82:0/1107729211 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71e59c700 1 --2- 172.21.15.82:0/1107729211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7200b3940 0x7fa7200b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71ed9d700 1 -- 172.21.15.82:0/1107729211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7200b3940 msgr2=0x7fa7200b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71ed9d700 1 --2- 172.21.15.82:0/1107729211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7200b3940 0x7fa7200b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71ed9d700 1 -- 172.21.15.82:0/1107729211 >> v1:172.21.15.82:6789/0 conn(0x7fa72015d450 legacy=0x7fa7200691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71ed9d700 1 -- 172.21.15.82:0/1107729211 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa720069fd0 con 0x7fa720159100 2023-10-06T03:16:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71e59c700 1 --2- 172.21.15.82:0/1107729211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7200b3940 0x7fa7200b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71dd9b700 1 -- 172.21.15.82:0/1107729211 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542480864 0 0) 0x7fa720069a10 con 0x7fa72015d450 2023-10-06T03:16:52.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71ed9d700 1 --2- 172.21.15.82:0/1107729211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720159100 0x7fa720159570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa718009e60 tx=0x7fa718009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74f980f37d5b2cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:52.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71dd9b700 1 -- 172.21.15.82:0/1107729211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71800e070 con 0x7fa720159100 2023-10-06T03:16:52.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71dd9b700 1 -- 172.21.15.82:0/1107729211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71800bc30 con 0x7fa720159100 2023-10-06T03:16:52.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa71dd9b700 1 -- 172.21.15.82:0/1107729211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718012430 con 0x7fa720159100 2023-10-06T03:16:52.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa7248d5700 1 -- 172.21.15.82:0/1107729211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720159100 msgr2=0x7fa720159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:52.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1107729211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720159100 0x7fa720159570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa718009e60 tx=0x7fa718009780 comp rx=0 tx=0).stop 2023-10-06T03:16:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa7248d5700 1 -- 172.21.15.82:0/1107729211 shutdown_connections 2023-10-06T03:16:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1107729211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720159100 0x7fa720159570 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1107729211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7200b3940 0x7fa7200b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa7248d5700 1 -- 172.21.15.82:0/1107729211 >> 172.21.15.82:0/1107729211 conn(0x7fa7200ce4c0 msgr2=0x7fa7200ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa7248d5700 1 -- 172.21.15.82:0/1107729211 shutdown_connections 2023-10-06T03:16:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.223+0000 7fa7248d5700 1 -- 172.21.15.82:0/1107729211 wait complete. 2023-10-06T03:16:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa7248d5700 1 Processor -- start 2023-10-06T03:16:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa7248d5700 1 -- start start 2023-10-06T03:16:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa7248d5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7200b3940 0x7fa72015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa7248d5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa720159100 0x7fa7200c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa7248d5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72015d450 0x7fa72006bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa7248d5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa720159bc0 con 0x7fa7200b3940 2023-10-06T03:16:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa7248d5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72015a670 con 0x7fa72015d450 2023-10-06T03:16:52.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa7248d5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72015a950 con 0x7fa720159100 2023-10-06T03:16:52.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa71e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7200b3940 0x7fa72015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:52.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa71e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7200b3940 0x7fa72015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37172/0 (socket says 172.21.15.82:37172) 2023-10-06T03:16:52.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.225+0000 7fa71e59c700 1 -- 172.21.15.82:0/1346256697 learned_addr learned my addr 172.21.15.82:0/1346256697 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:52.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa715d9b700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa720159100 0x7fa7200c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:52.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa71ed9d700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72015d450 0x7fa72006bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:52.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa71e59c700 1 -- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa720159100 msgr2=0x7fa7200c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:52.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa71e59c700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa720159100 0x7fa7200c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa71e59c700 1 -- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72015d450 msgr2=0x7fa72006bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:52.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa71e59c700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72015d450 0x7fa72006bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:52.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa71e59c700 1 -- 172.21.15.82:0/1346256697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718009a20 con 0x7fa7200b3940 2023-10-06T03:16:52.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa71e59c700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7200b3940 0x7fa72015a050 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa71000c830 tx=0x7fa710008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:52.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa716ffd700 1 -- 172.21.15.82:0/1346256697 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa710011600 con 0x7fa7200b3940 2023-10-06T03:16:52.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa716ffd700 1 -- 172.21.15.82:0/1346256697 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa710011760 con 0x7fa7200b3940 2023-10-06T03:16:52.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa720159570 con 0x7fa7200b3940 2023-10-06T03:16:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa716ffd700 1 -- 172.21.15.82:0/1346256697 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa710011b20 con 0x7fa7200b3940 2023-10-06T03:16:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.226+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72015ac30 con 0x7fa7200b3940 2023-10-06T03:16:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.227+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7200717c0 con 0x7fa7200b3940 2023-10-06T03:16:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.227+0000 7fa716ffd700 1 -- 172.21.15.82:0/1346256697 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa71000a3e0 con 0x7fa7200b3940 2023-10-06T03:16:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.228+0000 7fa716ffd700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa700066f30 0x7fa7000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.228+0000 7fa716ffd700 1 -- 172.21.15.82:0/1346256697 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa710084ba0 con 0x7fa7200b3940 2023-10-06T03:16:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.228+0000 7fa715d9b700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa700066f30 0x7fa7000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.228+0000 7fa715d9b700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa700066f30 0x7fa7000693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa72016a510 tx=0x7fa708009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:52.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.232+0000 7fa716ffd700 1 -- 172.21.15.82:0/1346256697 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa710051c60 con 0x7fa7200b3940 2023-10-06T03:16:52.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:52.414+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa72006a2b0 con 0x7fa7200b3940 2023-10-06T03:16:53.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.086+0000 7fa716ffd700 1 -- 172.21.15.82:0/1346256697 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa7100150d0 con 0x7fa7200b3940 2023-10-06T03:16:53.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa700066f30 msgr2=0x7fa7000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:53.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa700066f30 0x7fa7000693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa72016a510 tx=0x7fa708009040 comp rx=0 tx=0).stop 2023-10-06T03:16:53.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7200b3940 msgr2=0x7fa72015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7200b3940 0x7fa72015a050 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa71000c830 tx=0x7fa710008040 comp rx=0 tx=0).stop 2023-10-06T03:16:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 shutdown_connections 2023-10-06T03:16:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72015d450 0x7fa72006bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7200b3940 0x7fa72015a050 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa700066f30 0x7fa7000693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 --2- 172.21.15.82:0/1346256697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa720159100 0x7fa7200c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 >> 172.21.15.82:0/1346256697 conn(0x7fa7200ce4c0 msgr2=0x7fa7200ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 shutdown_connections 2023-10-06T03:16:53.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.089+0000 7fa7248d5700 1 -- 172.21.15.82:0/1346256697 wait complete. 2023-10-06T03:16:53.093 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:16:53.104 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:16:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.223+0000 7f9ab4a36700 1 Processor -- start 2023-10-06T03:16:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.224+0000 7f9ab4a36700 1 -- start start 2023-10-06T03:16:53.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.224+0000 7f9ab4a36700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab00d0f00 0x7f9ab00ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:53.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.224+0000 7f9ab4a36700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00cbed0 con 0x7f9ab00b55b0 2023-10-06T03:16:53.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.224+0000 7f9ab4a36700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00cc750 con 0x7f9ab00ccbe0 2023-10-06T03:16:53.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.224+0000 7f9ab4a36700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0159d40 con 0x7f9ab00d0f00 2023-10-06T03:16:53.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aae59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9ab00b55b0 0x7f9ab00cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56408/0 (socket says 172.21.15.82:56408) 2023-10-06T03:16:53.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aae59c700 1 -- 172.21.15.82:0/271831066 learned_addr learned my addr 172.21.15.82:0/271831066 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518053889 0 0) 0x7f9ab00cbed0 con 0x7f9ab00b55b0 2023-10-06T03:16:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aaed9d700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab00d0f00 0x7f9ab00ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a9c003570 con 0x7f9ab00b55b0 2023-10-06T03:16:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3414051426 0 0) 0x7f9a9c003570 con 0x7f9ab00b55b0 2023-10-06T03:16:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab00d0f00 msgr2=0x7f9ab00ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab00d0f00 0x7f9ab00ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 >> v1:172.21.15.134:6789/0 conn(0x7f9ab00ccbe0 legacy=0x7f9ab00b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00cd050 con 0x7f9ab00b55b0 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f9aa00015f0 con 0x7f9ab00b55b0 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 >> v1:172.21.15.82:6789/0 conn(0x7f9ab00b55b0 legacy=0x7f9ab00cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a9c003a90 0x7f9a9c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab00d0f00 0x7f9a9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c004d50 0x7f9a9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c00bc20 con 0x7f9a9c004d50 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c00bd90 con 0x7f9a9c003a90 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c00bf50 con 0x7f9ab00d0f00 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aaed9d700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c004d50 0x7f9a9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aae59c700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a9c003a90 0x7f9a9c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.225+0000 7f9aa7fff700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab00d0f00 0x7f9a9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aaed9d700 1 -- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab00d0f00 msgr2=0x7f9a9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aaed9d700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab00d0f00 0x7f9a9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aaed9d700 1 -- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a9c003a90 msgr2=0x7f9a9c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aaed9d700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a9c003a90 0x7f9a9c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aaed9d700 1 -- 172.21.15.82:0/271831066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c003570 con 0x7f9a9c004d50 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aaed9d700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c004d50 0x7f9a9c0051c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80094d0 tx=0x7f9aa800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9467a44b6f0a8418 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800ea90 con 0x7f9a9c004d50 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa800f040 con 0x7f9a9c004d50 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aadd9b700 1 -- 172.21.15.82:0/271831066 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800ee20 con 0x7f9a9c004d50 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9ab4a36700 1 -- 172.21.15.82:0/271831066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c004d50 msgr2=0x7f9a9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:53.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9ab4a36700 1 --2- 172.21.15.82:0/271831066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c004d50 0x7f9a9c0051c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80094d0 tx=0x7f9aa800b040 comp rx=0 tx=0).stop 2023-10-06T03:16:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9aaed9d700 1 -- 172.21.15.82:0/271831066 reap_dead start 2023-10-06T03:16:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9ab4a36700 1 -- 172.21.15.82:0/271831066 shutdown_connections 2023-10-06T03:16:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9ab4a36700 1 -- 172.21.15.82:0/271831066 >> 172.21.15.82:0/271831066 conn(0x7f9ab008a050 msgr2=0x7f9ab0099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9ab4a36700 1 -- 172.21.15.82:0/271831066 shutdown_connections 2023-10-06T03:16:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.226+0000 7f9ab4a36700 1 -- 172.21.15.82:0/271831066 wait complete. 2023-10-06T03:16:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.227+0000 7f9ab4a36700 1 Processor -- start 2023-10-06T03:16:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9ab4a36700 1 -- start start 2023-10-06T03:16:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9ab4a36700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ab015cc10 0x7f9ab015e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9ab4a36700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab015ed50 0x7f9ab00c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9ab4a36700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab00c6950 0x7f9ab00b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9ab4a36700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00c6dd0 con 0x7f9ab015cc10 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9ab4a36700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00b0100 con 0x7f9ab00c6950 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9ab4a36700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00b03e0 con 0x7f9ab015ed50 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9aae59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ab015cc10 0x7f9ab015e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9aae59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ab015cc10 0x7f9ab015e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37180/0 (socket says 172.21.15.82:37180) 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.228+0000 7f9aae59c700 1 -- 172.21.15.82:0/3642859620 learned_addr learned my addr 172.21.15.82:0/3642859620 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aae59c700 1 -- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab015ed50 msgr2=0x7f9ab00c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aae59c700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab015ed50 0x7f9ab00c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aaed9d700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab00c6950 0x7f9ab00b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aae59c700 1 -- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab00c6950 msgr2=0x7f9ab00b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aae59c700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab00c6950 0x7f9ab00b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aae59c700 1 -- 172.21.15.82:0/3642859620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00b06c0 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aae59c700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ab015cc10 0x7f9ab015e810 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000fc00 tx=0x7f9aa0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aa67fc700 1 -- 172.21.15.82:0/3642859620 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00072e0 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aa67fc700 1 -- 172.21.15.82:0/3642859620 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0007460 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9aa67fc700 1 -- 172.21.15.82:0/3642859620 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00057f0 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab00b09a0 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.229+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab00afdb0 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.230+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab00717c0 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.230+0000 7f9aa67fc700 1 -- 172.21.15.82:0/3642859620 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9aa0005be0 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.231+0000 7f9aa67fc700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.231+0000 7f9aa67fc700 1 -- 172.21.15.82:0/3642859620 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f9aa0084850 con 0x7f9ab015cc10 2023-10-06T03:16:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.231+0000 7f9aa7fff700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.231+0000 7f9aa7fff700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a98007e40 tx=0x7f9a98007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.235+0000 7f9aa67fc700 1 -- 172.21.15.82:0/3642859620 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9aa0051a20 con 0x7f9ab015cc10 2023-10-06T03:16:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:53.420+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ab00cffe0 con 0x7f9ab015cc10 2023-10-06T03:16:54.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.321+0000 7f9aa67fc700 1 -- 172.21.15.82:0/3642859620 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9aa0055040 con 0x7f9ab015cc10 2023-10-06T03:16:54.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.325+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9a90066f30 msgr2=0x7f9a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.325+0000 7f9ab4a36700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a98007e40 tx=0x7f9a98007d30 comp rx=0 tx=0).stop 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.325+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ab015cc10 msgr2=0x7f9ab015e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.325+0000 7f9ab4a36700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ab015cc10 0x7f9ab015e810 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000fc00 tx=0x7f9aa0009040 comp rx=0 tx=0).stop 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.326+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 shutdown_connections 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.326+0000 7f9ab4a36700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ab00c6950 0x7f9ab00b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.326+0000 7f9ab4a36700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ab015cc10 0x7f9ab015e810 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.326+0000 7f9ab4a36700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.326+0000 7f9ab4a36700 1 --2- 172.21.15.82:0/3642859620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ab015ed50 0x7f9ab00c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.326+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 >> 172.21.15.82:0/3642859620 conn(0x7f9ab008a050 msgr2=0x7f9ab00ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.326+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 shutdown_connections 2023-10-06T03:16:54.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.326+0000 7f9ab4a36700 1 -- 172.21.15.82:0/3642859620 wait complete. 2023-10-06T03:16:54.329 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-10-06T03:16:54.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:16:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.466+0000 7f0d24fc1700 1 Processor -- start 2023-10-06T03:16:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.466+0000 7f0d24fc1700 1 -- start start 2023-10-06T03:16:54.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.466+0000 7f0d24fc1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d2013fb10 0x7f0d2006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.466+0000 7f0d24fc1700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d200c87a0 con 0x7f0d200c80d0 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.466+0000 7f0d24fc1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2006aaf0 con 0x7f0d2013fee0 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.466+0000 7f0d24fc1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2006adb0 con 0x7f0d2013fb10 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1ed9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0d200c80d0 0x7f0d200cb2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56410/0 (socket says 172.21.15.82:56410) 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/2276736939 learned_addr learned my addr 172.21.15.82:0/2276736939 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518709407 0 0) 0x7f0d200c87a0 con 0x7f0d200c80d0 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d0c003570 con 0x7f0d200c80d0 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1e59c700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d2013fb10 0x7f0d2006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946284224 0 0) 0x7f0d0c003570 con 0x7f0d200c80d0 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d2013fb10 msgr2=0x7f0d2006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d2013fb10 0x7f0d2006a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 >> v1:172.21.15.134:6789/0 conn(0x7f0d2013fee0 legacy=0x7f0d200c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2006b090 con 0x7f0d200c80d0 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f0d180017f0 con 0x7f0d200c80d0 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 >> v1:172.21.15.82:6789/0 conn(0x7f0d200c80d0 legacy=0x7f0d200cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d0c003a90 0x7f0d0c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d0c005210 0x7f0d0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2006adb0 con 0x7f0d0c005210 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00c190 con 0x7f0d0c003a90 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00c350 con 0x7f0d0c004810 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1e59c700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d2013fb10 0x7f0d2006a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1ed9d700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d0c005210 0x7f0d0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d15d9b700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.467+0000 7f0d1e59c700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d0c003a90 0x7f0d0c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d0c004810 msgr2=0x7f0d0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1ed9d700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d0c003a90 msgr2=0x7f0d0c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1ed9d700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d0c003a90 0x7f0d0c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/2276736939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c003570 con 0x7f0d0c005210 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1ed9d700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d0c005210 0x7f0d0c00ba60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0d200c84d0 tx=0x7f0d180021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9282fe8562790d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d180070d0 con 0x7f0d0c005210 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18007230 con 0x7f0d0c005210 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1dd9b700 1 -- 172.21.15.82:0/2276736939 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d180075f0 con 0x7f0d0c005210 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d24fc1700 1 -- 172.21.15.82:0/2276736939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d0c005210 msgr2=0x7f0d0c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d24fc1700 1 --2- 172.21.15.82:0/2276736939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d0c005210 0x7f0d0c00ba60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0d200c84d0 tx=0x7f0d180021d0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/2276736939 reap_dead start 2023-10-06T03:16:54.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d24fc1700 1 -- 172.21.15.82:0/2276736939 shutdown_connections 2023-10-06T03:16:54.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d24fc1700 1 -- 172.21.15.82:0/2276736939 >> 172.21.15.82:0/2276736939 conn(0x7f0d2006e760 msgr2=0x7f0d2006eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:54.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d24fc1700 1 -- 172.21.15.82:0/2276736939 shutdown_connections 2023-10-06T03:16:54.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.468+0000 7f0d24fc1700 1 -- 172.21.15.82:0/2276736939 wait complete. 2023-10-06T03:16:54.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d24fc1700 1 Processor -- start 2023-10-06T03:16:54.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d24fc1700 1 -- start start 2023-10-06T03:16:54.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d24fc1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d200c6ef0 0x7f0d20159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d24fc1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d200c72c0 0x7f0d2015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d24fc1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015b400 0x7f0d200c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d24fc1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20158fb0 con 0x7f0d2015b400 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d24fc1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2016b510 con 0x7f0d200c6ef0 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d24fc1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20168480 con 0x7f0d200c72c0 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d1ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015b400 0x7f0d200c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d1ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015b400 0x7f0d200c2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37204/0 (socket says 172.21.15.82:37204) 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/1745467794 learned_addr learned my addr 172.21.15.82:0/1745467794 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.470+0000 7f0d15d9b700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d200c72c0 0x7f0d2015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d1e59c700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d200c6ef0 0x7f0d20159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d200c72c0 msgr2=0x7f0d2015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d1ed9d700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d200c72c0 0x7f0d2015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d200c6ef0 msgr2=0x7f0d20159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d1ed9d700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d200c6ef0 0x7f0d20159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d1ed9d700 1 -- 172.21.15.82:0/1745467794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20168760 con 0x7f0d2015b400 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d1e59c700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d200c6ef0 0x7f0d20159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d1ed9d700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015b400 0x7f0d200c2120 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0d18012000 tx=0x7f0d18015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d16ffd700 1 -- 172.21.15.82:0/1745467794 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d180070d0 con 0x7f0d2015b400 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d16ffd700 1 -- 172.21.15.82:0/1745467794 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18001a90 con 0x7f0d2015b400 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d20168a40 con 0x7f0d2015b400 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d16ffd700 1 -- 172.21.15.82:0/1745467794 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18007960 con 0x7f0d2015b400 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.471+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d20167f10 con 0x7f0d2015b400 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.472+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2015a520 con 0x7f0d2015b400 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.472+0000 7f0d16ffd700 1 -- 172.21.15.82:0/1745467794 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d18029460 con 0x7f0d2015b400 2023-10-06T03:16:54.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.473+0000 7f0d16ffd700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0d00066f30 0x7f0d000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.473+0000 7f0d16ffd700 1 -- 172.21.15.82:0/1745467794 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0d180868d0 con 0x7f0d2015b400 2023-10-06T03:16:54.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.473+0000 7f0d1e59c700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0d00066f30 0x7f0d000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.473+0000 7f0d1e59c700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0d00066f30 0x7f0d000693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0d10006b90 tx=0x7f0d10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:54.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.477+0000 7f0d16ffd700 1 -- 172.21.15.82:0/1745467794 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d18053ce0 con 0x7f0d2015b400 2023-10-06T03:16:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.659+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0d2006cf00 con 0x7f0d2015b400 2023-10-06T03:16:54.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.662+0000 7f0d16ffd700 1 -- 172.21.15.82:0/1745467794 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0d180075b0 con 0x7f0d2015b400 2023-10-06T03:16:54.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0d00066f30 msgr2=0x7f0d000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0d00066f30 0x7f0d000693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0d10006b90 tx=0x7f0d10008040 comp rx=0 tx=0).stop 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015b400 msgr2=0x7f0d200c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015b400 0x7f0d200c2120 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0d18012000 tx=0x7f0d18015000 comp rx=0 tx=0).stop 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 shutdown_connections 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015b400 0x7f0d200c2120 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d200c6ef0 0x7f0d20159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0d00066f30 0x7f0d000693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 --2- 172.21.15.82:0/1745467794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d200c72c0 0x7f0d2015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.664+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 >> 172.21.15.82:0/1745467794 conn(0x7f0d2006e760 msgr2=0x7f0d200c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.665+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 shutdown_connections 2023-10-06T03:16:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.665+0000 7f0d24fc1700 1 -- 172.21.15.82:0/1745467794 wait complete. 2023-10-06T03:16:54.678 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df' 2023-10-06T03:16:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.790+0000 7fac32f29700 1 Processor -- start 2023-10-06T03:16:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.790+0000 7fac32f29700 1 -- start start 2023-10-06T03:16:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.791+0000 7fac32f29700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c155120 0x7fac2c0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.791+0000 7fac32f29700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac2c15b570 0x7fac2c0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.791+0000 7fac32f29700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0cc980 con 0x7fac2c15b1a0 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.791+0000 7fac32f29700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c0b0150 con 0x7fac2c15b570 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.791+0000 7fac32f29700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c15be40 con 0x7fac2c155120 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.791+0000 7fac32728700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac2c15b570 0x7fac2c0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.791+0000 7fac31f27700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fac2c15b1a0 0x7fac2c154a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56426/0 (socket says 172.21.15.82:56426) 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.791+0000 7fac31f27700 1 -- 172.21.15.82:0/3328887600 learned_addr learned my addr 172.21.15.82:0/3328887600 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac31726700 1 --2- 172.21.15.82:0/3328887600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c155120 0x7fac2c0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32728700 1 -- 172.21.15.82:0/3328887600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c155120 msgr2=0x7fac2c0af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32728700 1 --2- 172.21.15.82:0/3328887600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c155120 0x7fac2c0af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32728700 1 -- 172.21.15.82:0/3328887600 >> v1:172.21.15.82:6789/0 conn(0x7fac2c15b1a0 legacy=0x7fac2c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32728700 1 -- 172.21.15.82:0/3328887600 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0b0330 con 0x7fac2c15b570 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32728700 1 --2- 172.21.15.82:0/3328887600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c0afc10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fac24009e90 tx=0x7fac24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882d1fddf45c2766 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac30f25700 1 -- 172.21.15.82:0/3328887600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400e070 con 0x7fac2c15b570 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac30f25700 1 -- 172.21.15.82:0/3328887600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400bbf0 con 0x7fac2c15b570 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac30f25700 1 -- 172.21.15.82:0/3328887600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24012430 con 0x7fac2c15b570 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32f29700 1 -- 172.21.15.82:0/3328887600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 msgr2=0x7fac2c0afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32f29700 1 --2- 172.21.15.82:0/3328887600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c0afc10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fac24009e90 tx=0x7fac24009780 comp rx=0 tx=0).stop 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32f29700 1 -- 172.21.15.82:0/3328887600 shutdown_connections 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32f29700 1 --2- 172.21.15.82:0/3328887600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c0afc10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32f29700 1 --2- 172.21.15.82:0/3328887600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c155120 0x7fac2c0af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.792+0000 7fac32f29700 1 -- 172.21.15.82:0/3328887600 >> 172.21.15.82:0/3328887600 conn(0x7fac2c0ce320 msgr2=0x7fac2c0ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.793+0000 7fac32f29700 1 -- 172.21.15.82:0/3328887600 shutdown_connections 2023-10-06T03:16:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.793+0000 7fac32f29700 1 -- 172.21.15.82:0/3328887600 wait complete. 2023-10-06T03:16:54.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32f29700 1 Processor -- start 2023-10-06T03:16:54.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32f29700 1 -- start start 2023-10-06T03:16:54.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32f29700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac2c155120 0x7fac2c158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32f29700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c15b1a0 0x7fac2c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32f29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c1667b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32f29700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c150270 con 0x7fac2c15b570 2023-10-06T03:16:54.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32f29700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14f400 con 0x7fac2c155120 2023-10-06T03:16:54.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32f29700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14f5f0 con 0x7fac2c15b1a0 2023-10-06T03:16:54.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.794+0000 7fac32728700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c1667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32728700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c1667b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37222/0 (socket says 172.21.15.82:37222) 2023-10-06T03:16:54.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32728700 1 -- 172.21.15.82:0/2132446268 learned_addr learned my addr 172.21.15.82:0/2132446268 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:54.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac31726700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c15b1a0 0x7fac2c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac31f27700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac2c155120 0x7fac2c158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32728700 1 -- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c15b1a0 msgr2=0x7fac2c14eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32728700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c15b1a0 0x7fac2c14eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32728700 1 -- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac2c155120 msgr2=0x7fac2c158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32728700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac2c155120 0x7fac2c158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32728700 1 -- 172.21.15.82:0/2132446268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009a20 con 0x7fac2c15b570 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32728700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c1667b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fac2c06f270 tx=0x7fac24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac21ffb700 1 -- 172.21.15.82:0/2132446268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24027470 con 0x7fac2c15b570 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac21ffb700 1 -- 172.21.15.82:0/2132446268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac240275f0 con 0x7fac2c15b570 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c14f8d0 con 0x7fac2c15b570 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac21ffb700 1 -- 172.21.15.82:0/2132446268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240279b0 con 0x7fac2c15b570 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.795+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c14fe90 con 0x7fac2c15b570 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.796+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c1503b0 con 0x7fac2c15b570 2023-10-06T03:16:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.797+0000 7fac21ffb700 1 -- 172.21.15.82:0/2132446268 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac24024070 con 0x7fac2c15b570 2023-10-06T03:16:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.797+0000 7fac21ffb700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac10066f30 0x7fac100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.797+0000 7fac21ffb700 1 -- 172.21.15.82:0/2132446268 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fac24086b60 con 0x7fac2c15b570 2023-10-06T03:16:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.797+0000 7fac31f27700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac10066f30 0x7fac100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.798+0000 7fac31f27700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac10066f30 0x7fac100693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac28007130 tx=0x7fac28007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:54.801+0000 7fac21ffb700 1 -- 172.21.15.82:0/2132446268 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac2c1503b0 con 0x7fac2c15b570 2023-10-06T03:16:55.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.056+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]} v 0) v1 -- 0x7fac2c1503b0 con 0x7fac2c15b570 2023-10-06T03:16:55.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.322+0000 7fac21ffb700 1 -- 172.21.15.82:0/2132446268 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]}]=0 v80) v1 ==== 134+0+0 (secure 0 0 0) 0x7fac2c1503b0 con 0x7fac2c15b570 2023-10-06T03:16:55.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.324+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac10066f30 msgr2=0x7fac100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:55.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.324+0000 7fac32f29700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac10066f30 0x7fac100693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac28007130 tx=0x7fac28007eb0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.324+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 msgr2=0x7fac2c1667b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:55.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.324+0000 7fac32f29700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c1667b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fac2c06f270 tx=0x7fac24019000 comp rx=0 tx=0).stop 2023-10-06T03:16:55.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.325+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 shutdown_connections 2023-10-06T03:16:55.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.325+0000 7fac32f29700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c15b570 0x7fac2c1667b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.325+0000 7fac32f29700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac2c155120 0x7fac2c158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.325+0000 7fac32f29700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac10066f30 0x7fac100693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.325+0000 7fac32f29700 1 --2- 172.21.15.82:0/2132446268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac2c15b1a0 0x7fac2c14eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.325+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 >> 172.21.15.82:0/2132446268 conn(0x7fac2c0ce320 msgr2=0x7fac2c151310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:55.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.325+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 shutdown_connections 2023-10-06T03:16:55.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.325+0000 7fac32f29700 1 -- 172.21.15.82:0/2132446268 wait complete. 2023-10-06T03:16:55.338 INFO:tasks.cephfs_test_runner:That when a client modifies the quota on a directory used ... ok 2023-10-06T03:16:55.338 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_getfattr (tasks.cephfs.test_quota.TestQuota) That quota changes made from one client are visible to another 2023-10-06T03:16:55.338 INFO:tasks.cephfs_test_runner:test_remote_update_getfattr (tasks.cephfs.test_quota.TestQuota) 2023-10-06T03:16:55.339 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr' 2023-10-06T03:16:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.453+0000 7f41aa906700 1 Processor -- start 2023-10-06T03:16:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.453+0000 7f41aa906700 1 -- start start 2023-10-06T03:16:55.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41aa906700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a415d560 0x7f41a40d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:55.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41aa906700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41a415d930 0x7f41a40b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41aa906700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41a41591b0 0x7f41a4159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41aa906700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a40b2ad0 con 0x7f41a41591b0 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41aa906700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a40b4160 con 0x7f41a415d930 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41aa906700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40b1f80 con 0x7f41a415d560 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a8ea3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41a41591b0 0x7f41a4159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a8ea3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41a41591b0 0x7f41a4159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37236/0 (socket says 172.21.15.82:37236) 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a8ea3700 1 -- 172.21.15.82:0/3793692325 learned_addr learned my addr 172.21.15.82:0/3793692325 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a37fe700 1 --2- 172.21.15.82:0/3793692325 >> v2:172.21.15.134:3300/0 conn(0x7f41a415d930 0x7f41a40b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:55.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a3fff700 1 --2- 172.21.15.82:0/3793692325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a415d560 0x7f41a40d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a8ea3700 1 -- 172.21.15.82:0/3793692325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a415d560 msgr2=0x7f41a40d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a8ea3700 1 --2- 172.21.15.82:0/3793692325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a415d560 0x7f41a40d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a8ea3700 1 -- 172.21.15.82:0/3793692325 >> v2:172.21.15.134:3300/0 conn(0x7f41a415d930 msgr2=0x7f41a40b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a8ea3700 1 --2- 172.21.15.82:0/3793692325 >> v2:172.21.15.134:3300/0 conn(0x7f41a415d930 0x7f41a40b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.454+0000 7f41a8ea3700 1 -- 172.21.15.82:0/3793692325 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4159b70 con 0x7f41a41591b0 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41a8ea3700 1 --2- 172.21.15.82:0/3793692325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a41591b0 0x7f41a4159630 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f419c009f20 tx=0x7f419c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25911eb09ea7da5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41a2ffd700 1 -- 172.21.15.82:0/3793692325 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00e070 con 0x7f41a41591b0 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41a2ffd700 1 -- 172.21.15.82:0/3793692325 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00ba40 con 0x7f41a41591b0 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41a2ffd700 1 -- 172.21.15.82:0/3793692325 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0092e0 con 0x7f41a41591b0 2023-10-06T03:16:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 -- 172.21.15.82:0/3793692325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a41591b0 msgr2=0x7f41a4159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 --2- 172.21.15.82:0/3793692325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a41591b0 0x7f41a4159630 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f419c009f20 tx=0x7f419c009840 comp rx=0 tx=0).stop 2023-10-06T03:16:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 -- 172.21.15.82:0/3793692325 shutdown_connections 2023-10-06T03:16:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 --2- 172.21.15.82:0/3793692325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a41591b0 0x7f41a4159630 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 --2- 172.21.15.82:0/3793692325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a415d560 0x7f41a40d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 --2- 172.21.15.82:0/3793692325 >> v2:172.21.15.134:3300/0 conn(0x7f41a415d930 0x7f41a40b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 -- 172.21.15.82:0/3793692325 >> 172.21.15.82:0/3793692325 conn(0x7f41a40d1180 msgr2=0x7f41a4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 -- 172.21.15.82:0/3793692325 shutdown_connections 2023-10-06T03:16:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.455+0000 7f41aa906700 1 -- 172.21.15.82:0/3793692325 wait complete. 2023-10-06T03:16:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.456+0000 7f41aa906700 1 Processor -- start 2023-10-06T03:16:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41aa906700 1 -- start start 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41aa906700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a41591b0 0x7f41a414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41aa906700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a415d560 0x7f41a414ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41aa906700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a415d930 0x7f41a414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41aa906700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a415b270 con 0x7f41a415d930 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41aa906700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4152800 con 0x7f41a415d560 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41aa906700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4151f60 con 0x7f41a41591b0 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41a8ea3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a415d930 0x7f41a414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41a8ea3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a415d930 0x7f41a414fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37246/0 (socket says 172.21.15.82:37246) 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.457+0000 7f41a8ea3700 1 -- 172.21.15.82:0/587623984 learned_addr learned my addr 172.21.15.82:0/587623984 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41a37fe700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a415d560 0x7f41a414ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41a3fff700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a41591b0 0x7f41a414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41a8ea3700 1 -- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a41591b0 msgr2=0x7f41a414b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41a8ea3700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a41591b0 0x7f41a414b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41a8ea3700 1 -- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a415d560 msgr2=0x7f41a414ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41a8ea3700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a415d560 0x7f41a414ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41a8ea3700 1 -- 172.21.15.82:0/587623984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c009ae0 con 0x7f41a415d930 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41a8ea3700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a415d930 0x7f41a414fc60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f41a4064a20 tx=0x7f419c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f418bfff700 1 -- 172.21.15.82:0/587623984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0032f0 con 0x7f41a415d930 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f418bfff700 1 -- 172.21.15.82:0/587623984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c008e40 con 0x7f41a415d930 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a4152240 con 0x7f41a415d930 2023-10-06T03:16:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f418bfff700 1 -- 172.21.15.82:0/587623984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0266b0 con 0x7f41a415d930 2023-10-06T03:16:55.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.458+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a414bb00 con 0x7f41a415d930 2023-10-06T03:16:55.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.459+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a415b040 con 0x7f41a415d930 2023-10-06T03:16:55.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.459+0000 7f418bfff700 1 -- 172.21.15.82:0/587623984 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f419c003040 con 0x7f41a415d930 2023-10-06T03:16:55.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.460+0000 7f418bfff700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4190066fb0 0x7f4190069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:55.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.460+0000 7f418bfff700 1 -- 172.21.15.82:0/587623984 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f419c086420 con 0x7f41a415d930 2023-10-06T03:16:55.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.460+0000 7f41a3fff700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4190066fb0 0x7f4190069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:55.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.461+0000 7f41a3fff700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4190066fb0 0x7f4190069460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4194006fd0 tx=0x7f4194008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:55.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.464+0000 7f418bfff700 1 -- 172.21.15.82:0/587623984 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41a415b040 con 0x7f41a415d930 2023-10-06T03:16:55.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:55.722+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]} v 0) v1 -- 0x7f41a415b040 con 0x7f41a415d930 2023-10-06T03:16:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.324+0000 7f418bfff700 1 -- 172.21.15.82:0/587623984 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]}]=0 v81) v1 ==== 143+0+0 (secure 0 0 0) 0x7f41a415b040 con 0x7f41a415d930 2023-10-06T03:16:56.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4190066fb0 msgr2=0x7f4190069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4190066fb0 0x7f4190069460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4194006fd0 tx=0x7f4194008040 comp rx=0 tx=0).stop 2023-10-06T03:16:56.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a415d930 msgr2=0x7f41a414fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a415d930 0x7f41a414fc60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f41a4064a20 tx=0x7f419c018000 comp rx=0 tx=0).stop 2023-10-06T03:16:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 shutdown_connections 2023-10-06T03:16:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a415d930 0x7f41a414fc60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4190066fb0 0x7f4190069460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a41591b0 0x7f41a414b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 --2- 172.21.15.82:0/587623984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a415d560 0x7f41a414ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.327+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 >> 172.21.15.82:0/587623984 conn(0x7f41a40d1180 msgr2=0x7f41a4067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.328+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 shutdown_connections 2023-10-06T03:16:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.328+0000 7f41aa906700 1 -- 172.21.15.82:0/587623984 wait complete. 2023-10-06T03:16:56.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:16:56.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.461+0000 7fd43a50c700 1 Processor -- start 2023-10-06T03:16:56.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.461+0000 7fd43a50c700 1 -- start start 2023-10-06T03:16:56.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd43a50c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd43415dab0 0x7fd4340cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd43a50c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4340b1110 con 0x7fd434159500 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd43a50c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4340b13b0 con 0x7fd4341598d0 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd43a50c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b1690 con 0x7fd43415dab0 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd433fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd434159500 0x7fd4340b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56440/0 (socket says 172.21.15.82:56440) 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd433fff700 1 -- 172.21.15.82:0/525825288 learned_addr learned my addr 172.21.15.82:0/525825288 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886790594 0 0) 0x7fd4340b1110 con 0x7fd434159500 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd438aa9700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd43415dab0 0x7fd4340cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.462+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd41c003570 con 0x7fd434159500 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2753281757 0 0) 0x7fd41c003570 con 0x7fd434159500 2023-10-06T03:16:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd43415dab0 msgr2=0x7fd4340cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd43415dab0 0x7fd4340cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 >> v1:172.21.15.134:6789/0 conn(0x7fd4341598d0 legacy=0x7fd43415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340b1970 con 0x7fd434159500 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fd424001470 con 0x7fd434159500 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 >> v1:172.21.15.82:6789/0 conn(0x7fd434159500 legacy=0x7fd4340b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd41c003a90 0x7fd41c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd43415dab0 0x7fd41c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd41c004d50 0x7fd41c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b1690 con 0x7fd41c003a90 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c00bb70 con 0x7fd41c004d50 2023-10-06T03:16:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c00bd30 con 0x7fd43415dab0 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd433fff700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd41c003a90 0x7fd41c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd4337fe700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd43415dab0 0x7fd41c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd433fff700 1 -- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd43415dab0 msgr2=0x7fd41c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd433fff700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd43415dab0 0x7fd41c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd433fff700 1 -- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd41c004d50 msgr2=0x7fd41c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd433fff700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd41c004d50 0x7fd41c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd433fff700 1 -- 172.21.15.82:0/525825288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c003570 con 0x7fd41c003a90 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd433fff700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd41c003a90 0x7fd41c003ea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd42400c390 tx=0x7fd43415e380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a581fd0f5c148a4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400cc60 con 0x7fd41c003a90 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400cdc0 con 0x7fd41c003a90 2023-10-06T03:16:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.463+0000 7fd432ffd700 1 -- 172.21.15.82:0/525825288 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424005b70 con 0x7fd41c003a90 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.464+0000 7fd43a50c700 1 -- 172.21.15.82:0/525825288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd41c003a90 msgr2=0x7fd41c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.464+0000 7fd43a50c700 1 --2- 172.21.15.82:0/525825288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd41c003a90 0x7fd41c003ea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd42400c390 tx=0x7fd43415e380 comp rx=0 tx=0).stop 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.464+0000 7fd438aa9700 1 -- 172.21.15.82:0/525825288 reap_dead start 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.464+0000 7fd43a50c700 1 -- 172.21.15.82:0/525825288 shutdown_connections 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.464+0000 7fd43a50c700 1 -- 172.21.15.82:0/525825288 >> 172.21.15.82:0/525825288 conn(0x7fd434067630 msgr2=0x7fd434069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.464+0000 7fd43a50c700 1 -- 172.21.15.82:0/525825288 shutdown_connections 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.464+0000 7fd43a50c700 1 -- 172.21.15.82:0/525825288 wait complete. 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.465+0000 7fd43a50c700 1 Processor -- start 2023-10-06T03:16:56.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.465+0000 7fd43a50c700 1 -- start start 2023-10-06T03:16:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd43a50c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd41c003a90 0x7fd4341421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd43a50c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43415d5b0 0x7fd434151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd43a50c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4340b1d50 0x7fd4340b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd43a50c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b2730 con 0x7fd43415d5b0 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd43a50c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43415ae40 con 0x7fd41c003a90 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd43a50c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43415b120 con 0x7fd4340b1d50 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43415d5b0 0x7fd434151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43415d5b0 0x7fd434151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37270/0 (socket says 172.21.15.82:37270) 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 -- 172.21.15.82:0/1339824084 learned_addr learned my addr 172.21.15.82:0/1339824084 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd438aa9700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4340b1d50 0x7fd4340b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd433fff700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd41c003a90 0x7fd4341421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 -- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4340b1d50 msgr2=0x7fd4340b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4340b1d50 0x7fd4340b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 -- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd41c003a90 msgr2=0x7fd4341421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd41c003a90 0x7fd4341421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 -- 172.21.15.82:0/1339824084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43415b400 con 0x7fd43415d5b0 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd4337fe700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43415d5b0 0x7fd434151d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd42800e7c0 tx=0x7fd428009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd41bfff700 1 -- 172.21.15.82:0/1339824084 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428012590 con 0x7fd43415d5b0 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.466+0000 7fd41bfff700 1 -- 172.21.15.82:0/1339824084 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4280126f0 con 0x7fd43415d5b0 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.467+0000 7fd41bfff700 1 -- 172.21.15.82:0/1339824084 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428012ab0 con 0x7fd43415d5b0 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.467+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43415b6e0 con 0x7fd43415d5b0 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.467+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd434142730 con 0x7fd43415d5b0 2023-10-06T03:16:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.467+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd434064050 con 0x7fd43415d5b0 2023-10-06T03:16:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.468+0000 7fd41bfff700 1 -- 172.21.15.82:0/1339824084 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd42801d460 con 0x7fd43415d5b0 2023-10-06T03:16:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.468+0000 7fd41bfff700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd420066f30 0x7fd4200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.468+0000 7fd41bfff700 1 -- 172.21.15.82:0/1339824084 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd4280844e0 con 0x7fd43415d5b0 2023-10-06T03:16:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.468+0000 7fd433fff700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd420066f30 0x7fd4200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.469+0000 7fd433fff700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd420066f30 0x7fd4200693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd42400d010 tx=0x7fd424015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.473+0000 7fd41bfff700 1 -- 172.21.15.82:0/1339824084 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4280518f0 con 0x7fd43415d5b0 2023-10-06T03:16:56.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.653+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd4340d0420 con 0x7fd43415d5b0 2023-10-06T03:16:56.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.657+0000 7fd41bfff700 1 -- 172.21.15.82:0/1339824084 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd428054f10 con 0x7fd43415d5b0 2023-10-06T03:16:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd420066f30 msgr2=0x7fd4200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd420066f30 0x7fd4200693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd42400d010 tx=0x7fd424015000 comp rx=0 tx=0).stop 2023-10-06T03:16:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43415d5b0 msgr2=0x7fd434151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43415d5b0 0x7fd434151d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd42800e7c0 tx=0x7fd428009040 comp rx=0 tx=0).stop 2023-10-06T03:16:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 shutdown_connections 2023-10-06T03:16:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd420066f30 0x7fd4200693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4340b1d50 0x7fd4340b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd41c003a90 0x7fd4341421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 --2- 172.21.15.82:0/1339824084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43415d5b0 0x7fd434151d20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 >> 172.21.15.82:0/1339824084 conn(0x7fd434067630 msgr2=0x7fd43414f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 shutdown_connections 2023-10-06T03:16:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.659+0000 7fd43a50c700 1 -- 172.21.15.82:0/1339824084 wait complete. 2023-10-06T03:16:56.673 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:16:56.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:16:56.710 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:16:56.755 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:16:56.755 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:16:56.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:16:56.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.868+0000 7f25c5a5d700 1 Processor -- start 2023-10-06T03:16:56.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.868+0000 7f25c5a5d700 1 -- start start 2023-10-06T03:16:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25c5a5d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25c00cdc00 0x7f25c00cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25c5a5d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f25c00d1030 0x7f25c00c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25c5a5d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c00ae140 con 0x7f25c00c6bf0 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25c5a5d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00cc390 con 0x7f25c00cdc00 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25c5a5d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00c7020 con 0x7f25c00d1030 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25beffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25c00cdc00 0x7f25c00cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25bf7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f25c00c6bf0 0x7f25c00ae5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56444/0 (socket says 172.21.15.82:56444) 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25bf7fe700 1 -- 172.21.15.82:0/2568745718 learned_addr learned my addr 172.21.15.82:0/2568745718 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25b67fc700 1 --2- 172.21.15.82:0/2568745718 >> v2:172.21.15.134:3300/0 conn(0x7f25c00d1030 0x7f25c00c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25beffd700 1 -- 172.21.15.82:0/2568745718 >> v2:172.21.15.134:3300/0 conn(0x7f25c00d1030 msgr2=0x7f25c00c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25beffd700 1 --2- 172.21.15.82:0/2568745718 >> v2:172.21.15.134:3300/0 conn(0x7f25c00d1030 0x7f25c00c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25beffd700 1 -- 172.21.15.82:0/2568745718 >> v1:172.21.15.82:6789/0 conn(0x7f25c00c6bf0 legacy=0x7f25c00ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25be7fc700 1 -- 172.21.15.82:0/2568745718 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524236274 0 0) 0x7f25c00ae140 con 0x7f25c00c6bf0 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.869+0000 7f25beffd700 1 -- 172.21.15.82:0/2568745718 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00ad530 con 0x7f25c00cdc00 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25beffd700 1 --2- 172.21.15.82:0/2568745718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00cdc00 0x7f25c00cbe50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f25c0071430 tx=0x7f25b0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240a729343a6ffc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25be7fc700 1 -- 172.21.15.82:0/2568745718 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0005c10 con 0x7f25c00cdc00 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25be7fc700 1 -- 172.21.15.82:0/2568745718 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0005d70 con 0x7f25c00cdc00 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25be7fc700 1 -- 172.21.15.82:0/2568745718 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0006260 con 0x7f25c00cdc00 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25c5a5d700 1 -- 172.21.15.82:0/2568745718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00cdc00 msgr2=0x7f25c00cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/2568745718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00cdc00 0x7f25c00cbe50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f25c0071430 tx=0x7f25b0009120 comp rx=0 tx=0).stop 2023-10-06T03:16:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25c5a5d700 1 -- 172.21.15.82:0/2568745718 shutdown_connections 2023-10-06T03:16:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/2568745718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00cdc00 0x7f25c00cbe50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/2568745718 >> v2:172.21.15.134:3300/0 conn(0x7f25c00d1030 0x7f25c00c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25c5a5d700 1 -- 172.21.15.82:0/2568745718 >> 172.21.15.82:0/2568745718 conn(0x7f25c0099990 msgr2=0x7f25c00b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25c5a5d700 1 -- 172.21.15.82:0/2568745718 shutdown_connections 2023-10-06T03:16:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.870+0000 7f25c5a5d700 1 -- 172.21.15.82:0/2568745718 wait complete. 2023-10-06T03:16:56.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25c5a5d700 1 Processor -- start 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25c5a5d700 1 -- start start 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25c5a5d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25c00c6bf0 0x7f25c009dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25c5a5d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25c00cdc00 0x7f25c009ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25c5a5d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00d1030 0x7f25c0069780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25c5a5d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00ca440 con 0x7f25c00d1030 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25c5a5d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c009a950 con 0x7f25c00cdc00 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25c5a5d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c016a460 con 0x7f25c00c6bf0 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25bf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00d1030 0x7f25c0069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25bf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00d1030 0x7f25c0069780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37290/0 (socket says 172.21.15.82:37290) 2023-10-06T03:16:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.872+0000 7f25bf7fe700 1 -- 172.21.15.82:0/3381950495 learned_addr learned my addr 172.21.15.82:0/3381950495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25beffd700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25c00c6bf0 0x7f25c009dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25b67fc700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25c00cdc00 0x7f25c009ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25bf7fe700 1 -- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25c00c6bf0 msgr2=0x7f25c009dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25bf7fe700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25c00c6bf0 0x7f25c009dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25bf7fe700 1 -- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25c00cdc00 msgr2=0x7f25c009ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25bf7fe700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25c00cdc00 0x7f25c009ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25bf7fe700 1 -- 172.21.15.82:0/3381950495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00093c0 con 0x7f25c00d1030 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25bf7fe700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00d1030 0x7f25c0069780 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f25b800cc90 tx=0x7f25b8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25b77fe700 1 -- 172.21.15.82:0/3381950495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800cea0 con 0x7f25c00d1030 2023-10-06T03:16:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25b77fe700 1 -- 172.21.15.82:0/3381950495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b800ab70 con 0x7f25c00d1030 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c016a740 con 0x7f25c00d1030 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25b77fe700 1 -- 172.21.15.82:0/3381950495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80070f0 con 0x7f25c00d1030 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.873+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c009dff0 con 0x7f25c00d1030 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.874+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c00c71f0 con 0x7f25c00d1030 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.874+0000 7f25b77fe700 1 -- 172.21.15.82:0/3381950495 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25b80074a0 con 0x7f25c00d1030 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.875+0000 7f25b77fe700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f25a0066f30 0x7f25a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.875+0000 7f25b77fe700 1 -- 172.21.15.82:0/3381950495 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f25b8084810 con 0x7f25c00d1030 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.875+0000 7f25beffd700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f25a0066f30 0x7f25a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.875+0000 7f25beffd700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f25a0066f30 0x7f25a00693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009160 tx=0x7f25b0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:56.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:56.879+0000 7f25b77fe700 1 -- 172.21.15.82:0/3381950495 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25b8051ca0 con 0x7f25c00d1030 2023-10-06T03:16:57.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.102+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25c00d0520 con 0x7f25c00d1030 2023-10-06T03:16:57.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.102+0000 7f25b77fe700 1 -- 172.21.15.82:0/3381950495 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f25b80552c0 con 0x7f25c00d1030 2023-10-06T03:16:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:57.104 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/968017372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":968017372},{"type":"v1","addr":"172.21.15.134:6836","nonce":968017372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4847,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2689907510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2689907510},{"type":"v1","addr":"172.21.15.134:6837","nonce":2689907510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1664218192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1664218192},{"type":"v1","addr":"172.21.15.82:6834","nonce":1664218192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2857365191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":2857365191},{"type":"v1","addr":"172.21.15.82:6835","nonce":2857365191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-10-06T03:16:57.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f25a0066f30 msgr2=0x7f25a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:57.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f25a0066f30 0x7f25a00693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009160 tx=0x7f25b0016000 comp rx=0 tx=0).stop 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00d1030 msgr2=0x7f25c0069780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00d1030 0x7f25c0069780 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f25b800cc90 tx=0x7f25b8001a80 comp rx=0 tx=0).stop 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 shutdown_connections 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25c00d1030 0x7f25c0069780 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f25a0066f30 0x7f25a00693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25c00c6bf0 0x7f25c009dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 --2- 172.21.15.82:0/3381950495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25c00cdc00 0x7f25c009ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 >> 172.21.15.82:0/3381950495 conn(0x7f25c0099990 msgr2=0x7f25c00c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.104+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 shutdown_connections 2023-10-06T03:16:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.105+0000 7f25c5a5d700 1 -- 172.21.15.82:0/3381950495 wait complete. 2023-10-06T03:16:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2023-10-06T03:16:57.118 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:16:57.119 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:16:57.119 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:16:57.119 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:16:57.119 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:16:57.119 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:16:57.120 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:16:57.120 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:16:57.120 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:16:57.120 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:16:57.120 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:16:57.120 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:16:57.120 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:16:57.121 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:16:57.121 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:16:57.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:16:57.127 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:16:57.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:16:57.130 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:16:57.130 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:16:57.132 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:16:57.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:16:57.133 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:16:57.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:16:57.171 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:16:57.172 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:57.173 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:16:57.173 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:57.176 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:16:57.176 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:57.178 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:16:57.178 DEBUG:teuthology.parallel:result is None 2023-10-06T03:16:57.179 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:16:57.244 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-10-06T03:16:57.245 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-10-06T03:16:57.258 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-10-06T03:16:57.259 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-10-06T03:16:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.299+0000 7f8c0acb5700 1 Processor -- start 2023-10-06T03:16:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.299+0000 7f8c0acb5700 1 -- start start 2023-10-06T03:16:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c0acb5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c0acb5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c040b61d0 0x7f8c0415d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c0acb5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c04069380 con 0x7f8c04142e90 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c0acb5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c04069f20 con 0x7f8c040b61d0 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c0acb5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04068770 con 0x7f8c0415de80 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c09cb3700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8c04142e90 0x7f8c04069810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:36520/0 (socket says 172.21.15.82:36520) 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c09cb3700 1 -- 172.21.15.82:0/649049495 learned_addr learned my addr 172.21.15.82:0/649049495 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c0a4b4700 1 --2- 172.21.15.82:0/649049495 >> v2:172.21.15.134:3300/0 conn(0x7f8c040b61d0 0x7f8c0415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c094b2700 1 --2- 172.21.15.82:0/649049495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c08cb1700 1 -- 172.21.15.82:0/649049495 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121857636 0 0) 0x7f8c04069380 con 0x7f8c04142e90 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.300+0000 7f8c08cb1700 1 -- 172.21.15.82:0/649049495 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf0003570 con 0x7f8c04142e90 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c094b2700 1 -- 172.21.15.82:0/649049495 >> v2:172.21.15.134:3300/0 conn(0x7f8c040b61d0 msgr2=0x7f8c0415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c094b2700 1 --2- 172.21.15.82:0/649049495 >> v2:172.21.15.134:3300/0 conn(0x7f8c040b61d0 0x7f8c0415d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c094b2700 1 -- 172.21.15.82:0/649049495 >> v1:172.21.15.134:6789/0 conn(0x7f8c04142e90 legacy=0x7f8c04069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c094b2700 1 -- 172.21.15.82:0/649049495 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04068a50 con 0x7f8c0415de80 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0a4b4700 1 --2- 172.21.15.82:0/649049495 >> v2:172.21.15.134:3300/0 conn(0x7f8c040b61d0 0x7f8c0415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c094b2700 1 --2- 172.21.15.82:0/649049495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040b5c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80098e0 tx=0x7f8bf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7613082f5eb26d97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c08cb1700 1 -- 172.21.15.82:0/649049495 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011630 con 0x7f8c0415de80 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c08cb1700 1 -- 172.21.15.82:0/649049495 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8011790 con 0x7f8c0415de80 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c08cb1700 1 -- 172.21.15.82:0/649049495 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011b30 con 0x7f8c0415de80 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0acb5700 1 -- 172.21.15.82:0/649049495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 msgr2=0x7f8c040b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/649049495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040b5c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80098e0 tx=0x7f8bf80091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0acb5700 1 -- 172.21.15.82:0/649049495 shutdown_connections 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/649049495 >> v2:172.21.15.134:3300/0 conn(0x7f8c040b61d0 0x7f8c0415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/649049495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040b5c90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0acb5700 1 -- 172.21.15.82:0/649049495 >> 172.21.15.82:0/649049495 conn(0x7f8c040ccfe0 msgr2=0x7f8c040cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:57.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0acb5700 1 -- 172.21.15.82:0/649049495 shutdown_connections 2023-10-06T03:16:57.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.301+0000 7f8c0acb5700 1 -- 172.21.15.82:0/649049495 wait complete. 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.302+0000 7f8c0acb5700 1 Processor -- start 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c0acb5700 1 -- start start 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c0acb5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c040b61d0 0x7f8c040c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c0acb5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04142e90 0x7f8c0416a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c0acb5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c0acb5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040cb840 con 0x7f8c04142e90 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c0acb5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c9120 con 0x7f8c040b61d0 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c0acb5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0416ac30 con 0x7f8c0415de80 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c094b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04142e90 0x7f8c0416a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:57.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c094b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04142e90 0x7f8c0416a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37322/0 (socket says 172.21.15.82:37322) 2023-10-06T03:16:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c094b2700 1 -- 172.21.15.82:0/2649877548 learned_addr learned my addr 172.21.15.82:0/2649877548 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.303+0000 7f8c09cb3700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c040b61d0 0x7f8c040c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c0a4b4700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c094b2700 1 -- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 msgr2=0x7f8c040ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c094b2700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c094b2700 1 -- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c040b61d0 msgr2=0x7f8c040c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c094b2700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c040b61d0 0x7f8c040c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c094b2700 1 -- 172.21.15.82:0/2649877548 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc009a20 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c094b2700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04142e90 0x7f8c0416a6f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8c040688b0 tx=0x7f8bf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8bf5ffb700 1 -- 172.21.15.82:0/2649877548 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011900 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8bf5ffb700 1 -- 172.21.15.82:0/2649877548 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8011a60 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf8009420 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8bf5ffb700 1 -- 172.21.15.82:0/2649877548 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8023600 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.304+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0416b6d0 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.305+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0404c3c0 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.305+0000 7f8bf5ffb700 1 -- 172.21.15.82:0/2649877548 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bf80239f0 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.306+0000 7f8bf5ffb700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8be8066f30 0x7f8be80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.306+0000 7f8bf5ffb700 1 -- 172.21.15.82:0/2649877548 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8bf8085540 con 0x7f8c04142e90 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.306+0000 7f8c09cb3700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8be8066f30 0x7f8be80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.306+0000 7f8c09cb3700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8be8066f30 0x7f8be80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c00007fd0 tx=0x7f8c00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:57.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.310+0000 7f8bf5ffb700 1 -- 172.21.15.82:0/2649877548 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bf8052b40 con 0x7f8c04142e90 2023-10-06T03:16:57.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:57.512+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8c04068d30 con 0x7f8c04142e90 2023-10-06T03:16:57.804 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:16:57.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:16:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.346+0000 7f8bf5ffb700 1 -- 172.21.15.82:0/2649877548 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8bf8056160 con 0x7f8c04142e90 2023-10-06T03:16:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8be8066f30 msgr2=0x7f8be80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8be8066f30 0x7f8be80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c00007fd0 tx=0x7f8c00009040 comp rx=0 tx=0).stop 2023-10-06T03:16:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04142e90 msgr2=0x7f8c0416a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04142e90 0x7f8c0416a6f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8c040688b0 tx=0x7f8bf8017000 comp rx=0 tx=0).stop 2023-10-06T03:16:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 shutdown_connections 2023-10-06T03:16:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8be8066f30 0x7f8be80693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c0415de80 0x7f8c040ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c040b61d0 0x7f8c040c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 --2- 172.21.15.82:0/2649877548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04142e90 0x7f8c0416a6f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.348+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 >> 172.21.15.82:0/2649877548 conn(0x7f8c040ccfe0 msgr2=0x7f8c0413faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.349+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 shutdown_connections 2023-10-06T03:16:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.349+0000 7f8c0acb5700 1 -- 172.21.15.82:0/2649877548 wait complete. 2023-10-06T03:16:58.352 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-10-06T03:16:58.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:16:58.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.478+0000 7febeedda700 1 Processor -- start 2023-10-06T03:16:58.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.478+0000 7febeedda700 1 -- start start 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.479+0000 7febeedda700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7febe815d560 0x7febe80d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.479+0000 7febeedda700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7febe815d930 0x7febe80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.479+0000 7febeedda700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe80b2ad0 con 0x7febe81591b0 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.479+0000 7febeedda700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80b4160 con 0x7febe815d930 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.479+0000 7febeedda700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80b1f80 con 0x7febe815d560 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.479+0000 7febe7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7febe815d930 0x7febe80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.479+0000 7febed377700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7febe81591b0 0x7febe8159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56852/0 (socket says 172.21.15.82:56852) 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.479+0000 7febed377700 1 -- 172.21.15.82:0/3493061180 learned_addr learned my addr 172.21.15.82:0/3493061180 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febecb76700 1 --2- 172.21.15.82:0/3493061180 >> v2:172.21.15.134:3300/0 conn(0x7febe815d560 0x7febe80d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe7fff700 1 -- 172.21.15.82:0/3493061180 >> v2:172.21.15.134:3300/0 conn(0x7febe815d560 msgr2=0x7febe80d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe7fff700 1 --2- 172.21.15.82:0/3493061180 >> v2:172.21.15.134:3300/0 conn(0x7febe815d560 0x7febe80d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe7fff700 1 -- 172.21.15.82:0/3493061180 >> v1:172.21.15.82:6789/0 conn(0x7febe81591b0 legacy=0x7febe8159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe7fff700 1 -- 172.21.15.82:0/3493061180 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80b2230 con 0x7febe815d930 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe77fe700 1 -- 172.21.15.82:0/3493061180 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078731509 0 0) 0x7febe80b2ad0 con 0x7febe81591b0 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febecb76700 1 --2- 172.21.15.82:0/3493061180 >> v2:172.21.15.134:3300/0 conn(0x7febe815d560 0x7febe80d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe7fff700 1 --2- 172.21.15.82:0/3493061180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d930 0x7febe80b1a40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7febe8071410 tx=0x7febd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38d46b0b205c788 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe77fe700 1 -- 172.21.15.82:0/3493061180 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400b6b0 con 0x7febe815d930 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe77fe700 1 -- 172.21.15.82:0/3493061180 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd400b810 con 0x7febe815d930 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febe77fe700 1 -- 172.21.15.82:0/3493061180 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400bbb0 con 0x7febe815d930 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.480+0000 7febeedda700 1 -- 172.21.15.82:0/3493061180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d930 msgr2=0x7febe80b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.481+0000 7febeedda700 1 --2- 172.21.15.82:0/3493061180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d930 0x7febe80b1a40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7febe8071410 tx=0x7febd40091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.481+0000 7febeedda700 1 -- 172.21.15.82:0/3493061180 shutdown_connections 2023-10-06T03:16:58.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.481+0000 7febeedda700 1 --2- 172.21.15.82:0/3493061180 >> v2:172.21.15.134:3300/0 conn(0x7febe815d560 0x7febe80d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.481+0000 7febeedda700 1 --2- 172.21.15.82:0/3493061180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d930 0x7febe80b1a40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.481+0000 7febeedda700 1 -- 172.21.15.82:0/3493061180 >> 172.21.15.82:0/3493061180 conn(0x7febe80d1180 msgr2=0x7febe8069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:58.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.481+0000 7febeedda700 1 -- 172.21.15.82:0/3493061180 shutdown_connections 2023-10-06T03:16:58.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.481+0000 7febeedda700 1 -- 172.21.15.82:0/3493061180 wait complete. 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.482+0000 7febeedda700 1 Processor -- start 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.482+0000 7febeedda700 1 -- start start 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febeedda700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febe81591b0 0x7febe81420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febeedda700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d560 0x7febe815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febeedda700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe815d930 0x7febe815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febeedda700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe81507f0 con 0x7febe815d560 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febeedda700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe814fbe0 con 0x7febe815d930 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febeedda700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe814fec0 con 0x7febe81591b0 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d560 0x7febe815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d560 0x7febe815c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38892/0 (socket says 172.21.15.82:38892) 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 -- 172.21.15.82:0/3875799395 learned_addr learned my addr 172.21.15.82:0/3875799395 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febed377700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe815d930 0x7febe815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febecb76700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febe81591b0 0x7febe81420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 -- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febe81591b0 msgr2=0x7febe81420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febe81591b0 0x7febe81420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 -- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe815d930 msgr2=0x7febe815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe815d930 0x7febe815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 -- 172.21.15.82:0/3875799395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009420 con 0x7febe815d560 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe7fff700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d560 0x7febe815c380 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7febe8064a20 tx=0x7febd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe4ff9700 1 -- 172.21.15.82:0/3875799395 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400ba80 con 0x7febe815d560 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe4ff9700 1 -- 172.21.15.82:0/3875799395 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4025420 con 0x7febe815d560 2023-10-06T03:16:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febe4ff9700 1 -- 172.21.15.82:0/3875799395 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40257e0 con 0x7febe815d560 2023-10-06T03:16:58.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe81501a0 con 0x7febe815d560 2023-10-06T03:16:58.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.483+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe8142630 con 0x7febe815d560 2023-10-06T03:16:58.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.484+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe8064050 con 0x7febe815d560 2023-10-06T03:16:58.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.485+0000 7febe4ff9700 1 -- 172.21.15.82:0/3875799395 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febd4023070 con 0x7febe815d560 2023-10-06T03:16:58.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.485+0000 7febe4ff9700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.485+0000 7febe4ff9700 1 -- 172.21.15.82:0/3875799395 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7febd4085aa0 con 0x7febe815d560 2023-10-06T03:16:58.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.485+0000 7febecb76700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.486+0000 7febecb76700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7febcc066f30 0x7febcc0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7febdc00ac00 tx=0x7febdc006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:58.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.490+0000 7febe4ff9700 1 -- 172.21.15.82:0/3875799395 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febd4087e60 con 0x7febe815d560 2023-10-06T03:16:58.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.745+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7febe80b2510 con 0x7febe815d560 2023-10-06T03:16:58.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.745+0000 7febe4ff9700 1 -- 172.21.15.82:0/3875799395 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7febd4052f00 con 0x7febe815d560 2023-10-06T03:16:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:58.747 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:16:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-10-06T03:16:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-10-06T03:16:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l724PDBAAKY5FzGqpcmJ9nM/VzdTluA==", 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-10-06T03:16:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l2iFnFxAAnxKQmAHZarx6LfCeKkON3A==", 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-10-06T03:16:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lTOzVEhAACwLXU1KFGLhLFDFKzj6g3Q==", 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9le7I7HhAArFktlgVJrQpOrrUTVk22Xw==", 2023-10-06T03:16:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC3ex9lSwhPNRAAEuYJnr5peNQ+adzmaiVfuA==", 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC6ex9lZ7t5MhAAm8vw3nhRW4ZVUaf1Ta7ytg==", 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC9ex9lZyKZMhAAmnaJ8C9oe6oQYNe9flPP/w==", 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-10-06T03:16:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDAex9lXgMXMRAABl0OhmR0JLg6lg2t0i34sg==", 2023-10-06T03:16:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDGex9lsr9wLxAAQ41BKVQ/dy5Z9EOm/16qDw==", 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDJex9l7He2LRAA8Xan1h5Sm60wJtAQP/FLzA==", 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDMex9ldA63KxAAenPCZN/PLtQdV14ELvSBWg==", 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-10-06T03:16:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDPex9lyQ7RLRAAzKpuBd2pcmtTiku1klhAew==", 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lylUIIhAA6GrLOJ3Kp6n7xUJ3VoBUiQ==", 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l8UthKhAALxBTh0SRcmfHtgEIOjSuLA==", 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:16:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l5shkJxAA+IYYf2SQk8x/hSeuLH3NRQ==", 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9ljArALxAA7shG1AhpdCbRGUzZR4HHng==", 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-10-06T03:16:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQCzex9lU7IULBAABmDwAP9lztKEz35R80eZRA==", 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lsmYMCRAA1BY9VAWL0YXlNJAmkjau9w==", 2023-10-06T03:16:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l8Dr/BBAA/cTmol+xUbQ2HOUtowC/Zw==", 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:16:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:16:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-10-06T03:16:58.764 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:16:58.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7febcc066f30 msgr2=0x7febcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7febcc066f30 0x7febcc0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7febdc00ac00 tx=0x7febdc006f90 comp rx=0 tx=0).stop 2023-10-06T03:16:58.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d560 msgr2=0x7febe815c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d560 0x7febe815c380 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7febe8064a20 tx=0x7febd4017000 comp rx=0 tx=0).stop 2023-10-06T03:16:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 shutdown_connections 2023-10-06T03:16:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febe815d930 0x7febe815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febe81591b0 0x7febe81420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 --2- 172.21.15.82:0/3875799395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe815d560 0x7febe815c380 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 >> 172.21.15.82:0/3875799395 conn(0x7febe80d1180 msgr2=0x7febe8069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 shutdown_connections 2023-10-06T03:16:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.748+0000 7febeedda700 1 -- 172.21.15.82:0/3875799395 wait complete. 2023-10-06T03:16:58.767 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:16:58.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.879+0000 7fad6a18f700 1 Processor -- start 2023-10-06T03:16:58.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.879+0000 7fad6a18f700 1 -- start start 2023-10-06T03:16:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad6a18f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad6415d560 0x7fad640d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad6a18f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640b2ad0 con 0x7fad6415d930 2023-10-06T03:16:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad6a18f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640b4160 con 0x7fad641591b0 2023-10-06T03:16:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad6a18f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640b2230 con 0x7fad6415d560 2023-10-06T03:16:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad637fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad6415d560 0x7fad640d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad62ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fad6415d930 0x7fad640b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56856/0 (socket says 172.21.15.82:56856) 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad637fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad6415d560 0x7fad640d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38900/0 (socket says 172.21.15.82:38900) 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad62ffd700 1 -- 172.21.15.82:0/1355874743 learned_addr learned my addr 172.21.15.82:0/1355874743 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad637fe700 1 -- 172.21.15.82:0/1355874743 >> v1:172.21.15.134:6789/0 conn(0x7fad641591b0 legacy=0x7fad64159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad637fe700 1 -- 172.21.15.82:0/1355874743 >> v1:172.21.15.82:6789/0 conn(0x7fad6415d930 legacy=0x7fad640b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad627fc700 1 -- 172.21.15.82:0/1355874743 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551283016 0 0) 0x7fad640b2ad0 con 0x7fad6415d930 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.880+0000 7fad637fe700 1 -- 172.21.15.82:0/1355874743 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640b2510 con 0x7fad6415d560 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad637fe700 1 --2- 172.21.15.82:0/1355874743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d560 0x7fad640d0030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad540098e0 tx=0x7fad540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20fb20400a54b96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad627fc700 1 -- 172.21.15.82:0/1355874743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54009e80 con 0x7fad6415d560 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad627fc700 1 -- 172.21.15.82:0/1355874743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400b860 con 0x7fad6415d560 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad627fc700 1 -- 172.21.15.82:0/1355874743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400bbe0 con 0x7fad6415d560 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad6a18f700 1 -- 172.21.15.82:0/1355874743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d560 msgr2=0x7fad640d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad6a18f700 1 --2- 172.21.15.82:0/1355874743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d560 0x7fad640d0030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad540098e0 tx=0x7fad540091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad6a18f700 1 -- 172.21.15.82:0/1355874743 shutdown_connections 2023-10-06T03:16:58.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad6a18f700 1 --2- 172.21.15.82:0/1355874743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d560 0x7fad640d0030 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad6a18f700 1 -- 172.21.15.82:0/1355874743 >> 172.21.15.82:0/1355874743 conn(0x7fad640d1180 msgr2=0x7fad64069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:58.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad6a18f700 1 -- 172.21.15.82:0/1355874743 shutdown_connections 2023-10-06T03:16:58.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.881+0000 7fad6a18f700 1 -- 172.21.15.82:0/1355874743 wait complete. 2023-10-06T03:16:58.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.882+0000 7fad6a18f700 1 Processor -- start 2023-10-06T03:16:58.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.882+0000 7fad6a18f700 1 -- start start 2023-10-06T03:16:58.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad6a18f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fad641591b0 0x7fad6415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad6a18f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad6415d560 0x7fad64152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad6a18f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d930 0x7fad6414f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad6a18f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6415c520 con 0x7fad6415d930 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad6a18f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64153f50 con 0x7fad6415d560 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad6a18f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad64152eb0 con 0x7fad641591b0 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad63fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d930 0x7fad6414f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad63fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d930 0x7fad6414f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38916/0 (socket says 172.21.15.82:38916) 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.883+0000 7fad63fff700 1 -- 172.21.15.82:0/3236238406 learned_addr learned my addr 172.21.15.82:0/3236238406 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad63fff700 1 -- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fad641591b0 msgr2=0x7fad6415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad63fff700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fad641591b0 0x7fad6415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad62ffd700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad6415d560 0x7fad64152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad63fff700 1 -- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad6415d560 msgr2=0x7fad64152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad63fff700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad6415d560 0x7fad64152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad63fff700 1 -- 172.21.15.82:0/3236238406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54009420 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad63fff700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d930 0x7fad6414f490 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c8e0 tx=0x7fad5c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad4b7fe700 1 -- 172.21.15.82:0/3236238406 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00ce80 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad4b7fe700 1 -- 172.21.15.82:0/3236238406 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c00a7e0 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad64153190 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad4b7fe700 1 -- 172.21.15.82:0/3236238406 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00ab80 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.884+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad64153520 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.885+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad64064050 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.885+0000 7fad4b7fe700 1 -- 172.21.15.82:0/3236238406 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad5c012420 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.886+0000 7fad4b7fe700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fad50066f60 0x7fad50069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.886+0000 7fad4b7fe700 1 -- 172.21.15.82:0/3236238406 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fad5c084650 con 0x7fad6415d930 2023-10-06T03:16:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.886+0000 7fad637fe700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fad50066f60 0x7fad50069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:58.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.886+0000 7fad637fe700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fad50066f60 0x7fad50069410 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fad6415d2c0 tx=0x7fad54017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:58.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:58.890+0000 7fad4b7fe700 1 -- 172.21.15.82:0/3236238406 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad5c051ab0 con 0x7fad6415d930 2023-10-06T03:16:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.071+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad640b3b50 con 0x7fad6415d930 2023-10-06T03:16:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.071+0000 7fad4b7fe700 1 -- 172.21.15.82:0/3236238406 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13650 (secure 0 0 0) 0x7fad5c0550d0 con 0x7fad6415d930 2023-10-06T03:16:59.073 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:16:59.073 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":39,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:16:58.344133+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:16:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fad50066f60 msgr2=0x7fad50069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fad50066f60 0x7fad50069410 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fad6415d2c0 tx=0x7fad54017000 comp rx=0 tx=0).stop 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d930 msgr2=0x7fad6414f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d930 0x7fad6414f490 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c8e0 tx=0x7fad5c001710 comp rx=0 tx=0).stop 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 shutdown_connections 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad6415d930 0x7fad6414f490 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fad50066f60 0x7fad50069410 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fad641591b0 0x7fad6415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 --2- 172.21.15.82:0/3236238406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad6415d560 0x7fad64152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.073+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 >> 172.21.15.82:0/3236238406 conn(0x7fad640d1180 msgr2=0x7fad641503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.074+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 shutdown_connections 2023-10-06T03:16:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.074+0000 7fad6a18f700 1 -- 172.21.15.82:0/3236238406 wait complete. 2023-10-06T03:16:59.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:16:59.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:16:59.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.203+0000 7f4dce57c700 1 Processor -- start 2023-10-06T03:16:59.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.203+0000 7f4dce57c700 1 -- start start 2023-10-06T03:16:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dce57c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4dc8159500 0x7f4dc81598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dce57c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc80b3fd0 0x7f4dc815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dce57c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc815dd20 con 0x7f4dc815d8e0 2023-10-06T03:16:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dce57c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc80b1110 con 0x7f4dc8159500 2023-10-06T03:16:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dce57c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80b13b0 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dc77fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc80b3fd0 0x7f4dc815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dc7fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4dc8159500 0x7f4dc81598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dc77fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc80b3fd0 0x7f4dc815d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:54590/0 (socket says 172.21.15.82:54590) 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.204+0000 7f4dccb19700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4dc815d8e0 0x7f4dc80cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:38364/0 (socket says 172.21.15.82:38364) 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc7fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4dc8159500 0x7f4dc81598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54554/0 (socket says 172.21.15.82:54554) 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc77fe700 1 -- 172.21.15.82:0/2447595251 learned_addr learned my addr 172.21.15.82:0/2447595251 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc6ffd700 1 -- 172.21.15.82:0/2447595251 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131252454 0 0) 0x7f4dc815dd20 con 0x7f4dc815d8e0 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc6ffd700 1 -- 172.21.15.82:0/2447595251 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db0003570 con 0x7f4dc815d8e0 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc77fe700 1 -- 172.21.15.82:0/2447595251 >> v2:172.21.15.134:3300/0 conn(0x7f4dc8159500 msgr2=0x7f4dc81598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc77fe700 1 --2- 172.21.15.82:0/2447595251 >> v2:172.21.15.134:3300/0 conn(0x7f4dc8159500 0x7f4dc81598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc77fe700 1 -- 172.21.15.82:0/2447595251 >> v1:172.21.15.134:6789/0 conn(0x7f4dc815d8e0 legacy=0x7f4dc80cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc77fe700 1 -- 172.21.15.82:0/2447595251 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80b1690 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc7fff700 1 --2- 172.21.15.82:0/2447595251 >> v2:172.21.15.134:3300/0 conn(0x7f4dc8159500 0x7f4dc81598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:59.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc77fe700 1 --2- 172.21.15.82:0/2447595251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc80b3fd0 0x7f4dc815d3a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0099b0 tx=0x7f4dbc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dffd6cd76df8fea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc6ffd700 1 -- 172.21.15.82:0/2447595251 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00b680 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc6ffd700 1 -- 172.21.15.82:0/2447595251 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00b7e0 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.205+0000 7f4dc6ffd700 1 -- 172.21.15.82:0/2447595251 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00bb60 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.206+0000 7f4dce57c700 1 -- 172.21.15.82:0/2447595251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc80b3fd0 msgr2=0x7f4dc815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.206+0000 7f4dce57c700 1 --2- 172.21.15.82:0/2447595251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc80b3fd0 0x7f4dc815d3a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0099b0 tx=0x7f4dbc009250 comp rx=0 tx=0).stop 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.206+0000 7f4dce57c700 1 -- 172.21.15.82:0/2447595251 shutdown_connections 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.206+0000 7f4dce57c700 1 --2- 172.21.15.82:0/2447595251 >> v2:172.21.15.134:3300/0 conn(0x7f4dc8159500 0x7f4dc81598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.206+0000 7f4dce57c700 1 --2- 172.21.15.82:0/2447595251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc80b3fd0 0x7f4dc815d3a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.206+0000 7f4dce57c700 1 -- 172.21.15.82:0/2447595251 >> 172.21.15.82:0/2447595251 conn(0x7f4dc8067630 msgr2=0x7f4dc8069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.206+0000 7f4dce57c700 1 -- 172.21.15.82:0/2447595251 shutdown_connections 2023-10-06T03:16:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.206+0000 7f4dce57c700 1 -- 172.21.15.82:0/2447595251 wait complete. 2023-10-06T03:16:59.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.207+0000 7f4dce57c700 1 Processor -- start 2023-10-06T03:16:59.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.207+0000 7f4dce57c700 1 -- start start 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dce57c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dc80b3fd0 0x7f4dc815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dce57c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dc8159500 0x7f4dc8150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dce57c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc815d8e0 0x7f4dc80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dce57c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc814dbb0 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dce57c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc814cf30 con 0x7f4dc8159500 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dce57c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc814d210 con 0x7f4dc815d8e0 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dc80b3fd0 0x7f4dc815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dc80b3fd0 0x7f4dc815ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38932/0 (socket says 172.21.15.82:38932) 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 -- 172.21.15.82:0/4115173559 learned_addr learned my addr 172.21.15.82:0/4115173559 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc77fe700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dc8159500 0x7f4dc8150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dccb19700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc815d8e0 0x7f4dc80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 -- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc815d8e0 msgr2=0x7f4dc80689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc815d8e0 0x7f4dc80689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 -- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dc8159500 msgr2=0x7f4dc8150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dc8159500 0x7f4dc8150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 -- 172.21.15.82:0/4115173559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009420 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc77fe700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dc8159500 0x7f4dc8150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dc7fff700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dc80b3fd0 0x7f4dc815ccf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4db800ec80 tx=0x7f4db80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4daffff700 1 -- 172.21.15.82:0/4115173559 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800c9d0 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4daffff700 1 -- 172.21.15.82:0/4115173559 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800cb30 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc0094f0 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4daffff700 1 -- 172.21.15.82:0/4115173559 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800ceb0 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.209+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc814d7d0 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.210+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc8064050 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.210+0000 7f4daffff700 1 -- 172.21.15.82:0/4115173559 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4db8013680 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.210+0000 7f4daffff700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4db4066f30 0x7f4db40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.210+0000 7f4daffff700 1 -- 172.21.15.82:0/4115173559 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4db8084790 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.210+0000 7f4dc77fe700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4db4066f30 0x7f4db40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.211+0000 7f4dc77fe700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4db4066f30 0x7f4db40693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0099b0 tx=0x7f4dbc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.215+0000 7f4daffff700 1 -- 172.21.15.82:0/4115173559 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4db8051bf0 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.400+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4dc80b1970 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.402+0000 7f4daffff700 1 -- 172.21.15.82:0/4115173559 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4db8055210 con 0x7f4dc80b3fd0 2023-10-06T03:16:59.403 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:16:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4db4066f30 msgr2=0x7f4db40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4db4066f30 0x7f4db40693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0099b0 tx=0x7f4dbc017000 comp rx=0 tx=0).stop 2023-10-06T03:16:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dc80b3fd0 msgr2=0x7f4dc815ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dc80b3fd0 0x7f4dc815ccf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4db800ec80 tx=0x7f4db80091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 shutdown_connections 2023-10-06T03:16:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4db4066f30 0x7f4db40693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4dc815d8e0 0x7f4dc80689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dc80b3fd0 0x7f4dc815ccf0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 --2- 172.21.15.82:0/4115173559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dc8159500 0x7f4dc8150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 >> 172.21.15.82:0/4115173559 conn(0x7f4dc8067630 msgr2=0x7f4dc80cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 shutdown_connections 2023-10-06T03:16:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.403+0000 7f4dce57c700 1 -- 172.21.15.82:0/4115173559 wait complete. 2023-10-06T03:16:59.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:16:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.534+0000 7fe8d1ee2700 1 Processor -- start 2023-10-06T03:16:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.534+0000 7fe8d1ee2700 1 -- start start 2023-10-06T03:16:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc157b50 0x7fe8cc0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8cc0cdb30 0x7fe8cc157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8cc158460 0x7fe8cc159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8cc159a60 con 0x7fe8cc158460 2023-10-06T03:16:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8cc0cdfa0 con 0x7fe8cc0cdb30 2023-10-06T03:16:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc158e50 con 0x7fe8cc157b50 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8cc158460 0x7fe8cc159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8cc158460 0x7fe8cc159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38936/0 (socket says 172.21.15.82:38936) 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 -- 172.21.15.82:0/1866406753 learned_addr learned my addr 172.21.15.82:0/1866406753 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cb7fe700 1 --2- 172.21.15.82:0/1866406753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc157b50 0x7fe8cc0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8caffd700 1 --2- 172.21.15.82:0/1866406753 >> v2:172.21.15.134:3300/0 conn(0x7fe8cc0cdb30 0x7fe8cc157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 -- 172.21.15.82:0/1866406753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc157b50 msgr2=0x7fe8cc0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 --2- 172.21.15.82:0/1866406753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc157b50 0x7fe8cc0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 -- 172.21.15.82:0/1866406753 >> v2:172.21.15.134:3300/0 conn(0x7fe8cc0cdb30 msgr2=0x7fe8cc157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 --2- 172.21.15.82:0/1866406753 >> v2:172.21.15.134:3300/0 conn(0x7fe8cc0cdb30 0x7fe8cc157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 -- 172.21.15.82:0/1866406753 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc159130 con 0x7fe8cc158460 2023-10-06T03:16:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8caffd700 1 --2- 172.21.15.82:0/1866406753 >> v2:172.21.15.134:3300/0 conn(0x7fe8cc0cdb30 0x7fe8cc157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8cbfff700 1 --2- 172.21.15.82:0/1866406753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc159ef0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc071180 tx=0x7fe8c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc4ffce95dcb33a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8ca7fc700 1 -- 172.21.15.82:0/1866406753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c400e070 con 0x7fe8cc158460 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8ca7fc700 1 -- 172.21.15.82:0/1866406753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c400ba50 con 0x7fe8cc158460 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8ca7fc700 1 -- 172.21.15.82:0/1866406753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c40092e0 con 0x7fe8cc158460 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1866406753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 msgr2=0x7fe8cc159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1866406753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc159ef0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc071180 tx=0x7fe8c4009840 comp rx=0 tx=0).stop 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1866406753 shutdown_connections 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1866406753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc159ef0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1866406753 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc157b50 0x7fe8cc0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1866406753 >> v2:172.21.15.134:3300/0 conn(0x7fe8cc0cdb30 0x7fe8cc157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1866406753 >> 172.21.15.82:0/1866406753 conn(0x7fe8cc06d890 msgr2=0x7fe8cc06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1866406753 shutdown_connections 2023-10-06T03:16:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.535+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1866406753 wait complete. 2023-10-06T03:16:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.536+0000 7fe8d1ee2700 1 Processor -- start 2023-10-06T03:16:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.536+0000 7fe8d1ee2700 1 -- start start 2023-10-06T03:16:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8d1ee2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc0cdb30 0x7fe8cc168170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8d1ee2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8cc157b50 0x7fe8cc1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8d1ee2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8d1ee2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc156da0 con 0x7fe8cc158460 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8d1ee2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc157080 con 0x7fe8cc157b50 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8d1ee2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc157360 con 0x7fe8cc0cdb30 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc1537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38952/0 (socket says 172.21.15.82:38952) 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cbfff700 1 -- 172.21.15.82:0/1461866929 learned_addr learned my addr 172.21.15.82:0/1461866929 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cb7fe700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc0cdb30 0x7fe8cc168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8caffd700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8cc157b50 0x7fe8cc1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cbfff700 1 -- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc0cdb30 msgr2=0x7fe8cc168170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cbfff700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc0cdb30 0x7fe8cc168170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cbfff700 1 -- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8cc157b50 msgr2=0x7fe8cc1564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cbfff700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8cc157b50 0x7fe8cc1564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cbfff700 1 -- 172.21.15.82:0/1461866929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c4009ae0 con 0x7fe8cc158460 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8cb7fe700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc0cdb30 0x7fe8cc168170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.537+0000 7fe8caffd700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8cc157b50 0x7fe8cc1564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.538+0000 7fe8cbfff700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc1537c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0afb20 tx=0x7fe8c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.538+0000 7fe8b37fe700 1 -- 172.21.15.82:0/1461866929 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c40032f0 con 0x7fe8cc158460 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.538+0000 7fe8b37fe700 1 -- 172.21.15.82:0/1461866929 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c4008e80 con 0x7fe8cc158460 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.538+0000 7fe8b37fe700 1 -- 172.21.15.82:0/1461866929 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c40266b0 con 0x7fe8cc158460 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.538+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8cc157640 con 0x7fe8cc158460 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.538+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8cc153d00 con 0x7fe8cc158460 2023-10-06T03:16:59.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.539+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8cc149a30 con 0x7fe8cc158460 2023-10-06T03:16:59.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.539+0000 7fe8b37fe700 1 -- 172.21.15.82:0/1461866929 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8c4003040 con 0x7fe8cc158460 2023-10-06T03:16:59.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.540+0000 7fe8b37fe700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8b8066f30 0x7fe8b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.540+0000 7fe8b37fe700 1 -- 172.21.15.82:0/1461866929 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe8c4085dd0 con 0x7fe8cc158460 2023-10-06T03:16:59.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.540+0000 7fe8cb7fe700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8b8066f30 0x7fe8b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.540+0000 7fe8cb7fe700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8b8066f30 0x7fe8b80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc006fd0 tx=0x7fe8bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.545+0000 7fe8b37fe700 1 -- 172.21.15.82:0/1461866929 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8c40532e0 con 0x7fe8cc158460 2023-10-06T03:16:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.724+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8cc064050 con 0x7fe8cc158460 2023-10-06T03:16:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.725+0000 7fe8b37fe700 1 -- 172.21.15.82:0/1461866929 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8c4009940 con 0x7fe8cc158460 2023-10-06T03:16:59.726 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:16:59.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8b8066f30 msgr2=0x7fe8b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8b8066f30 0x7fe8b80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc006fd0 tx=0x7fe8bc008040 comp rx=0 tx=0).stop 2023-10-06T03:16:59.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 msgr2=0x7fe8cc1537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc1537c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0afb20 tx=0x7fe8c4018000 comp rx=0 tx=0).stop 2023-10-06T03:16:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 shutdown_connections 2023-10-06T03:16:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8cc158460 0x7fe8cc1537c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe8b8066f30 0x7fe8b80693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8cc0cdb30 0x7fe8cc168170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 --2- 172.21.15.82:0/1461866929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8cc157b50 0x7fe8cc1564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 >> 172.21.15.82:0/1461866929 conn(0x7fe8cc06d890 msgr2=0x7fe8cc1513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 shutdown_connections 2023-10-06T03:16:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.727+0000 7fe8d1ee2700 1 -- 172.21.15.82:0/1461866929 wait complete. 2023-10-06T03:16:59.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:16:59.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.853+0000 7fde28e8e700 1 Processor -- start 2023-10-06T03:16:59.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.853+0000 7fde28e8e700 1 -- start start 2023-10-06T03:16:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.854+0000 7fde28e8e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde24157570 0x7fde240b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.854+0000 7fde28e8e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde2415b210 0x7fde24158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.854+0000 7fde28e8e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde241580d0 con 0x7fde240add70 2023-10-06T03:16:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.854+0000 7fde28e8e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde2415ba40 con 0x7fde24157570 2023-10-06T03:16:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.854+0000 7fde28e8e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2415bd20 con 0x7fde2415b210 2023-10-06T03:16:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.854+0000 7fde19d9b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde2415b210 0x7fde24158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde2259c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde24157570 0x7fde240b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde2259c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde24157570 0x7fde240b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54576/0 (socket says 172.21.15.82:54576) 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde19d9b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde2415b210 0x7fde24158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:54640/0 (socket says 172.21.15.82:54640) 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde22d9d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fde240add70 0x7fde240ae190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:38374/0 (socket says 172.21.15.82:38374) 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde2259c700 1 -- 172.21.15.82:0/815906987 learned_addr learned my addr 172.21.15.82:0/815906987 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde19d9b700 1 -- 172.21.15.82:0/815906987 >> v2:172.21.15.134:3300/0 conn(0x7fde24157570 msgr2=0x7fde240b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde19d9b700 1 --2- 172.21.15.82:0/815906987 >> v2:172.21.15.134:3300/0 conn(0x7fde24157570 0x7fde240b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde19d9b700 1 -- 172.21.15.82:0/815906987 >> v1:172.21.15.134:6789/0 conn(0x7fde240add70 legacy=0x7fde240ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde19d9b700 1 -- 172.21.15.82:0/815906987 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde24157d60 con 0x7fde2415b210 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde2259c700 1 --2- 172.21.15.82:0/815906987 >> v2:172.21.15.134:3300/0 conn(0x7fde24157570 0x7fde240b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde19d9b700 1 --2- 172.21.15.82:0/815906987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde2415b210 0x7fde24158560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0098e0 tx=0x7fde0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a87a6f6f5c32a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde21d9b700 1 -- 172.21.15.82:0/815906987 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c00b640 con 0x7fde2415b210 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde21d9b700 1 -- 172.21.15.82:0/815906987 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0c00b7a0 con 0x7fde2415b210 2023-10-06T03:16:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.855+0000 7fde21d9b700 1 -- 172.21.15.82:0/815906987 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c00bb40 con 0x7fde2415b210 2023-10-06T03:16:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.856+0000 7fde28e8e700 1 -- 172.21.15.82:0/815906987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde2415b210 msgr2=0x7fde24158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.856+0000 7fde28e8e700 1 --2- 172.21.15.82:0/815906987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde2415b210 0x7fde24158560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0098e0 tx=0x7fde0c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.856+0000 7fde28e8e700 1 -- 172.21.15.82:0/815906987 shutdown_connections 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.856+0000 7fde28e8e700 1 --2- 172.21.15.82:0/815906987 >> v2:172.21.15.134:3300/0 conn(0x7fde24157570 0x7fde240b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.856+0000 7fde28e8e700 1 --2- 172.21.15.82:0/815906987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde2415b210 0x7fde24158560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.856+0000 7fde28e8e700 1 -- 172.21.15.82:0/815906987 >> 172.21.15.82:0/815906987 conn(0x7fde24067630 msgr2=0x7fde24067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.856+0000 7fde28e8e700 1 -- 172.21.15.82:0/815906987 shutdown_connections 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.856+0000 7fde28e8e700 1 -- 172.21.15.82:0/815906987 wait complete. 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.857+0000 7fde28e8e700 1 Processor -- start 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.857+0000 7fde28e8e700 1 -- start start 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde28e8e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde240add70 0x7fde2416bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde28e8e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde24157570 0x7fde24152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde28e8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2415b210 0x7fde240c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde28e8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2416ba10 con 0x7fde2415b210 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde28e8e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde240c4e70 con 0x7fde24157570 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde28e8e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde240c5150 con 0x7fde240add70 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2415b210 0x7fde240c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2415b210 0x7fde240c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38960/0 (socket says 172.21.15.82:38960) 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 -- 172.21.15.82:0/3181830408 learned_addr learned my addr 172.21.15.82:0/3181830408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde19d9b700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde24157570 0x7fde24152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde2259c700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde240add70 0x7fde2416bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 -- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde240add70 msgr2=0x7fde2416bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde240add70 0x7fde2416bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 -- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde24157570 msgr2=0x7fde24152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde24157570 0x7fde24152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 -- 172.21.15.82:0/3181830408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde140094f0 con 0x7fde2415b210 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde19d9b700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde24157570 0x7fde24152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.858+0000 7fde22d9d700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2415b210 0x7fde240c5e50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00cd00 tx=0x7fde1c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.859+0000 7fde1affd700 1 -- 172.21.15.82:0/3181830408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00ce60 con 0x7fde2415b210 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.859+0000 7fde1affd700 1 -- 172.21.15.82:0/3181830408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c005df0 con 0x7fde2415b210 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.859+0000 7fde1affd700 1 -- 172.21.15.82:0/3181830408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00ab00 con 0x7fde2415b210 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.859+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c009420 con 0x7fde2415b210 2023-10-06T03:16:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.859+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2416b6a0 con 0x7fde2415b210 2023-10-06T03:16:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.860+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde24064050 con 0x7fde2415b210 2023-10-06T03:16:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.860+0000 7fde1affd700 1 -- 172.21.15.82:0/3181830408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde1c0070f0 con 0x7fde2415b210 2023-10-06T03:16:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.860+0000 7fde1affd700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fde04066f30 0x7fde040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:16:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.861+0000 7fde1affd700 1 -- 172.21.15.82:0/3181830408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fde1c084380 con 0x7fde2415b210 2023-10-06T03:16:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.861+0000 7fde2259c700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fde04066f30 0x7fde040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:16:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.861+0000 7fde2259c700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fde04066f30 0x7fde040693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fde240c9b30 tx=0x7fde14009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:16:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:16:59.865+0000 7fde1affd700 1 -- 172.21.15.82:0/3181830408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde1c0517e0 con 0x7fde2415b210 2023-10-06T03:17:00.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.049+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fde240cdf50 con 0x7fde2415b210 2023-10-06T03:17:00.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.050+0000 7fde1affd700 1 -- 172.21.15.82:0/3181830408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+126 (secure 0 0 0) 0x7fde1c054e00 con 0x7fde2415b210 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-10-06T03:17:00.051 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:00.052 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-10-06T03:17:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fde04066f30 msgr2=0x7fde040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fde04066f30 0x7fde040693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fde240c9b30 tx=0x7fde14009250 comp rx=0 tx=0).stop 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2415b210 msgr2=0x7fde240c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2415b210 0x7fde240c5e50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00cd00 tx=0x7fde1c001b10 comp rx=0 tx=0).stop 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 shutdown_connections 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2415b210 0x7fde240c5e50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fde04066f30 0x7fde040693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde240add70 0x7fde2416bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 --2- 172.21.15.82:0/3181830408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde24157570 0x7fde24152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 >> 172.21.15.82:0/3181830408 conn(0x7fde24067630 msgr2=0x7fde24070480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 shutdown_connections 2023-10-06T03:17:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.052+0000 7fde28e8e700 1 -- 172.21.15.82:0/3181830408 wait complete. 2023-10-06T03:17:00.064 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:17:00.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:17:00.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.181+0000 7f9d0427e700 1 Processor -- start 2023-10-06T03:17:00.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.181+0000 7f9d0427e700 1 -- start start 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.182+0000 7f9d0427e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9cfc0b55b0 0x7f9cfc0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.182+0000 7f9d0427e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc0d0f00 0x7f9cfc0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.182+0000 7f9d0427e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cbed0 con 0x7f9cfc0cf800 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.182+0000 7f9d0427e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc159d40 con 0x7f9cfc0b55b0 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.182+0000 7f9d0427e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0cc750 con 0x7f9cfc0d0f00 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.182+0000 7f9d01819700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9cfc0cf800 0x7f9cfc0b5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56864/0 (socket says 172.21.15.82:56864) 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.182+0000 7f9d01819700 1 -- 172.21.15.82:0/53872505 learned_addr learned my addr 172.21.15.82:0/53872505 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d0281b700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc0d0f00 0x7f9cfc0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d0201a700 1 --2- 172.21.15.82:0/53872505 >> v2:172.21.15.134:3300/0 conn(0x7f9cfc0b55b0 0x7f9cfc0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694696602 0 0) 0x7f9cfc0cbed0 con 0x7f9cfc0cf800 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce8003570 con 0x7f9cfc0cf800 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3801885890 0 0) 0x7f9ce8003570 con 0x7f9cfc0cf800 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc0d0f00 msgr2=0x7f9cfc0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc0d0f00 0x7f9cfc0ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 >> v2:172.21.15.134:3300/0 conn(0x7f9cfc0b55b0 msgr2=0x7f9cfc0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 --2- 172.21.15.82:0/53872505 >> v2:172.21.15.134:3300/0 conn(0x7f9cfc0b55b0 0x7f9cfc0ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0cffe0 con 0x7f9cfc0cf800 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f9cec001470 con 0x7f9cfc0cf800 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 >> v1:172.21.15.82:6789/0 conn(0x7f9cfc0cf800 legacy=0x7f9cfc0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc0d0f00 0x7f9ce8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9ce8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce8004d50 0x7f9ce80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0cc750 con 0x7f9ce8003fe0 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce800bac0 con 0x7f9ce8004d50 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce800bc80 con 0x7f9cfc0d0f00 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01819700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9ce8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d0201a700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc0d0f00 0x7f9ce8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d0281b700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce8004d50 0x7f9ce80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01819700 1 -- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc0d0f00 msgr2=0x7f9ce8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01819700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc0d0f00 0x7f9ce8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01819700 1 -- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce8004d50 msgr2=0x7f9ce80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01819700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ce8004d50 0x7f9ce80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01819700 1 -- 172.21.15.82:0/53872505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce8003570 con 0x7f9ce8003fe0 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.183+0000 7f9d01819700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9ce8004810 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00c390 tx=0x7f9cec001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2234d4eeec73e49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00cc60 con 0x7f9ce8003fe0 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec00cde0 con 0x7f9ce8003fe0 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d01018700 1 -- 172.21.15.82:0/53872505 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec005b70 con 0x7f9ce8003fe0 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d0427e700 1 -- 172.21.15.82:0/53872505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 msgr2=0x7f9ce8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d0427e700 1 --2- 172.21.15.82:0/53872505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9ce8004810 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00c390 tx=0x7f9cec001e90 comp rx=0 tx=0).stop 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d0281b700 1 -- 172.21.15.82:0/53872505 reap_dead start 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d0427e700 1 -- 172.21.15.82:0/53872505 shutdown_connections 2023-10-06T03:17:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d0427e700 1 -- 172.21.15.82:0/53872505 >> 172.21.15.82:0/53872505 conn(0x7f9cfc08a050 msgr2=0x7f9cfc099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:00.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d0427e700 1 -- 172.21.15.82:0/53872505 shutdown_connections 2023-10-06T03:17:00.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.184+0000 7f9d0427e700 1 -- 172.21.15.82:0/53872505 wait complete. 2023-10-06T03:17:00.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.185+0000 7f9d0427e700 1 Processor -- start 2023-10-06T03:17:00.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.185+0000 7f9d0427e700 1 -- start start 2023-10-06T03:17:00.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0427e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9cfc16d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0427e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cfc0c7750 0x7f9cfc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0427e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc149010 0x7f9cfc15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0427e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c73a0 con 0x7f9ce8003fe0 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0427e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c7d10 con 0x7f9cfc0c7750 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0427e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c9570 con 0x7f9cfc149010 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9cfc16d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9cfc16d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38980/0 (socket says 172.21.15.82:38980) 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 -- 172.21.15.82:0/2119067927 learned_addr learned my addr 172.21.15.82:0/2119067927 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0281b700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc149010 0x7f9cfc15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 -- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc149010 msgr2=0x7f9cfc15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d01819700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cfc0c7750 0x7f9cfc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc149010 0x7f9cfc15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 -- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cfc0c7750 msgr2=0x7f9cfc067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cfc0c7750 0x7f9cfc067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 -- 172.21.15.82:0/2119067927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc16de60 con 0x7f9ce8003fe0 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d01819700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cfc0c7750 0x7f9cfc067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.186+0000 7f9d0201a700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9cfc16d920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80115b0 tx=0x7f9cf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.187+0000 7f9cf27fc700 1 -- 172.21.15.82:0/2119067927 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800e030 con 0x7f9ce8003fe0 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.187+0000 7f9cf27fc700 1 -- 172.21.15.82:0/2119067927 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8016470 con 0x7f9ce8003fe0 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.187+0000 7f9cf27fc700 1 -- 172.21.15.82:0/2119067927 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8016830 con 0x7f9ce8003fe0 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.187+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc0c9240 con 0x7f9ce8003fe0 2023-10-06T03:17:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.187+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc0c70c0 con 0x7f9ce8003fe0 2023-10-06T03:17:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.187+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc0717c0 con 0x7f9ce8003fe0 2023-10-06T03:17:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.188+0000 7f9cf27fc700 1 -- 172.21.15.82:0/2119067927 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cf8016c20 con 0x7f9ce8003fe0 2023-10-06T03:17:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.188+0000 7f9cf27fc700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.188+0000 7f9cf27fc700 1 -- 172.21.15.82:0/2119067927 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9cf800f070 con 0x7f9ce8003fe0 2023-10-06T03:17:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.189+0000 7f9d01819700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.189+0000 7f9d01819700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9ce0066f30 0x7f9ce00693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00c390 tx=0x7f9cec015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.193+0000 7f9cf27fc700 1 -- 172.21.15.82:0/2119067927 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cf80528d0 con 0x7f9ce8003fe0 2023-10-06T03:17:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:00.377+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9cfc0cc100 con 0x7f9ce8003fe0 2023-10-06T03:17:01.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.359+0000 7f9cf27fc700 1 -- 172.21.15.82:0/2119067927 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9cf8055ef0 con 0x7f9ce8003fe0 2023-10-06T03:17:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9ce0066f30 msgr2=0x7f9ce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9ce0066f30 0x7f9ce00693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00c390 tx=0x7f9cec015000 comp rx=0 tx=0).stop 2023-10-06T03:17:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 msgr2=0x7f9cfc16d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9cfc16d920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80115b0 tx=0x7f9cf800b040 comp rx=0 tx=0).stop 2023-10-06T03:17:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 shutdown_connections 2023-10-06T03:17:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9cfc149010 0x7f9cfc15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce8003fe0 0x7f9cfc16d920 secure :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80115b0 tx=0x7f9cf800b040 comp rx=0 tx=0).stop 2023-10-06T03:17:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 --2- 172.21.15.82:0/2119067927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cfc0c7750 0x7f9cfc067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 >> 172.21.15.82:0/2119067927 conn(0x7f9cfc08a050 msgr2=0x7f9cfc159290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.363+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 shutdown_connections 2023-10-06T03:17:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.364+0000 7f9d0427e700 1 -- 172.21.15.82:0/2119067927 wait complete. 2023-10-06T03:17:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-10-06T03:17:01.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:17:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.506+0000 7ff3326f0700 1 Processor -- start 2023-10-06T03:17:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.506+0000 7ff3326f0700 1 -- start start 2023-10-06T03:17:01.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.507+0000 7ff3326f0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c0b1be0 0x7ff32c0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:01.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.507+0000 7ff3326f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0cd860 con 0x7ff32c159890 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.507+0000 7ff3326f0700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0ce130 con 0x7ff32c0cdcf0 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.507+0000 7ff3326f0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0ccc50 con 0x7ff32c0b1be0 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.507+0000 7ff32bfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff32c159890 0x7ff32c0b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56870/0 (socket says 172.21.15.82:56870) 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.507+0000 7ff32bfff700 1 -- 172.21.15.82:0/1201195595 learned_addr learned my addr 172.21.15.82:0/1201195595 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.507+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144237523 0 0) 0x7ff32c0cd860 con 0x7ff32c159890 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.507+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff314003570 con 0x7ff32c159890 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32b7fe700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c0b1be0 0x7ff32c0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219162474 0 0) 0x7ff314003570 con 0x7ff32c159890 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c0b1be0 msgr2=0x7ff32c0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c0b1be0 0x7ff32c0b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 >> v1:172.21.15.134:6789/0 conn(0x7ff32c0cdcf0 legacy=0x7ff32c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0ccf30 con 0x7ff32c159890 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7ff31c0015f0 con 0x7ff32c159890 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 >> v1:172.21.15.82:6789/0 conn(0x7ff32c159890 legacy=0x7ff32c0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff314003a90 0x7ff314003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c0b1be0 0x7ff314004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff314004d50 0x7ff3140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0ccc50 con 0x7ff314004d50 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31400bba0 con 0x7ff314003a90 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31400bd60 con 0x7ff32c0b1be0 2023-10-06T03:17:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff330c8d700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff314004d50 0x7ff3140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32bfff700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff314003a90 0x7ff314003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32b7fe700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c0b1be0 0x7ff314004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff330c8d700 1 -- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c0b1be0 msgr2=0x7ff314004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff330c8d700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c0b1be0 0x7ff314004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff330c8d700 1 -- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff314003a90 msgr2=0x7ff314003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff330c8d700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff314003a90 0x7ff314003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff330c8d700 1 -- 172.21.15.82:0/1201195595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314003570 con 0x7ff314004d50 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff330c8d700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff314004d50 0x7ff3140051c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff324001fc0 tx=0x7ff324001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814106ed235997a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.508+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324001950 con 0x7ff314004d50 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32400c8b0 con 0x7ff314004d50 2023-10-06T03:17:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff32affd700 1 -- 172.21.15.82:0/1201195595 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32400cc50 con 0x7ff314004d50 2023-10-06T03:17:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff3326f0700 1 -- 172.21.15.82:0/1201195595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff314004d50 msgr2=0x7ff3140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff3326f0700 1 --2- 172.21.15.82:0/1201195595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff314004d50 0x7ff3140051c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff324001fc0 tx=0x7ff324001640 comp rx=0 tx=0).stop 2023-10-06T03:17:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff330c8d700 1 -- 172.21.15.82:0/1201195595 reap_dead start 2023-10-06T03:17:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff3326f0700 1 -- 172.21.15.82:0/1201195595 shutdown_connections 2023-10-06T03:17:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff3326f0700 1 -- 172.21.15.82:0/1201195595 >> 172.21.15.82:0/1201195595 conn(0x7ff32c099990 msgr2=0x7ff32c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff3326f0700 1 -- 172.21.15.82:0/1201195595 shutdown_connections 2023-10-06T03:17:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.509+0000 7ff3326f0700 1 -- 172.21.15.82:0/1201195595 wait complete. 2023-10-06T03:17:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.510+0000 7ff3326f0700 1 Processor -- start 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.510+0000 7ff3326f0700 1 -- start start 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff3326f0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0af250 0x7ff32c1583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff3326f0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c169980 0x7ff32c16aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff3326f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff32c16af90 0x7ff32c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff3326f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c155700 con 0x7ff32c16af90 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff3326f0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c16cfb0 con 0x7ff32c0af250 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff3326f0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c169ed0 con 0x7ff32c169980 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff330c8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff32c16af90 0x7ff32c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff330c8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff32c16af90 0x7ff32c0cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38998/0 (socket says 172.21.15.82:38998) 2023-10-06T03:17:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff330c8d700 1 -- 172.21.15.82:0/1621637 learned_addr learned my addr 172.21.15.82:0/1621637 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff330c8d700 1 -- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c169980 msgr2=0x7ff32c16aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff32bfff700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0af250 0x7ff32c1583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff32b7fe700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c169980 0x7ff32c16aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff330c8d700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c169980 0x7ff32c16aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff330c8d700 1 -- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0af250 msgr2=0x7ff32c1583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.511+0000 7ff330c8d700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0af250 0x7ff32c1583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.512+0000 7ff330c8d700 1 -- 172.21.15.82:0/1621637 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c16a1b0 con 0x7ff32c16af90 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.512+0000 7ff330c8d700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff32c16af90 0x7ff32c0cfca0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c6a0 tx=0x7ff324015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.512+0000 7ff313fff700 1 -- 172.21.15.82:0/1621637 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32400c6d0 con 0x7ff32c16af90 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.512+0000 7ff313fff700 1 -- 172.21.15.82:0/1621637 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32400cc30 con 0x7ff32c16af90 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.512+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c16a490 con 0x7ff32c16af90 2023-10-06T03:17:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.512+0000 7ff313fff700 1 -- 172.21.15.82:0/1621637 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324006df0 con 0x7ff32c16af90 2023-10-06T03:17:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.512+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c1559b0 con 0x7ff32c16af90 2023-10-06T03:17:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.513+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c16d160 con 0x7ff32c16af90 2023-10-06T03:17:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.513+0000 7ff313fff700 1 -- 172.21.15.82:0/1621637 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff324019070 con 0x7ff32c16af90 2023-10-06T03:17:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.514+0000 7ff313fff700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.514+0000 7ff313fff700 1 -- 172.21.15.82:0/1621637 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5576+0+0 (secure 0 0 0) 0x7ff324085dd0 con 0x7ff32c16af90 2023-10-06T03:17:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.514+0000 7ff32bfff700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.514+0000 7ff32bfff700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff318066f30 0x7ff3180693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff31c001360 tx=0x7ff31c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.518+0000 7ff313fff700 1 -- 172.21.15.82:0/1621637 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff32c16d160 con 0x7ff32c16af90 2023-10-06T03:17:01.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:01.704+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff32c16d160 con 0x7ff32c16af90 2023-10-06T03:17:02.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.368+0000 7ff313fff700 1 -- 172.21.15.82:0/1621637 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff32c16d160 con 0x7ff32c16af90 2023-10-06T03:17:02.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.372+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff318066f30 msgr2=0x7ff3180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:02.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.372+0000 7ff3326f0700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff318066f30 0x7ff3180693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff31c001360 tx=0x7ff31c009040 comp rx=0 tx=0).stop 2023-10-06T03:17:02.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.372+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff32c16af90 msgr2=0x7ff32c0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:02.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.372+0000 7ff3326f0700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff32c16af90 0x7ff32c0cfca0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c6a0 tx=0x7ff324015000 comp rx=0 tx=0).stop 2023-10-06T03:17:02.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.374+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 shutdown_connections 2023-10-06T03:17:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.374+0000 7ff3326f0700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff32c16af90 0x7ff32c0cfca0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.374+0000 7ff3326f0700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c0af250 0x7ff32c1583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.374+0000 7ff3326f0700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.374+0000 7ff3326f0700 1 --2- 172.21.15.82:0/1621637 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff32c169980 0x7ff32c16aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.374+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 >> 172.21.15.82:0/1621637 conn(0x7ff32c099990 msgr2=0x7ff32c069a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.374+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 shutdown_connections 2023-10-06T03:17:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.375+0000 7ff3326f0700 1 -- 172.21.15.82:0/1621637 wait complete. 2023-10-06T03:17:02.384 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-10-06T03:17:02.398 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:17:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.515+0000 7f04626a8700 1 Processor -- start 2023-10-06T03:17:02.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.515+0000 7f04626a8700 1 -- start start 2023-10-06T03:17:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f04626a8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c159500 0x7f045c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f04626a8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f045c0b3fd0 0x7f045c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f04626a8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c15dd20 con 0x7f045c15d8e0 2023-10-06T03:17:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f04626a8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c0b1110 con 0x7f045c0b3fd0 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f04626a8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0b13b0 con 0x7f045c159500 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c159500 0x7f045c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045b7fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f045c0b3fd0 0x7f045c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f0460c45700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f045c15d8e0 0x7f045c0cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:38394/0 (socket says 172.21.15.82:38394) 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f0460c45700 1 -- 172.21.15.82:0/2255810968 learned_addr learned my addr 172.21.15.82:0/2255810968 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045bfff700 1 -- 172.21.15.82:0/2255810968 >> v2:172.21.15.134:3300/0 conn(0x7f045c0b3fd0 msgr2=0x7f045c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045bfff700 1 --2- 172.21.15.82:0/2255810968 >> v2:172.21.15.134:3300/0 conn(0x7f045c0b3fd0 0x7f045c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045bfff700 1 -- 172.21.15.82:0/2255810968 >> v1:172.21.15.134:6789/0 conn(0x7f045c15d8e0 legacy=0x7f045c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045bfff700 1 -- 172.21.15.82:0/2255810968 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0b1690 con 0x7f045c159500 2023-10-06T03:17:02.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045affd700 1 -- 172.21.15.82:0/2255810968 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401036945 0 0) 0x7f045c15dd20 con 0x7f045c15d8e0 2023-10-06T03:17:02.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045b7fe700 1 --2- 172.21.15.82:0/2255810968 >> v2:172.21.15.134:3300/0 conn(0x7f045c0b3fd0 0x7f045c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:02.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.516+0000 7f045bfff700 1 --2- 172.21.15.82:0/2255810968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c159500 0x7f045c1598d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04500098e0 tx=0x7f04500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ccc07e55b1cc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:02.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f045affd700 1 -- 172.21.15.82:0/2255810968 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000b640 con 0x7f045c159500 2023-10-06T03:17:02.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f045affd700 1 -- 172.21.15.82:0/2255810968 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045000b7a0 con 0x7f045c159500 2023-10-06T03:17:02.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f045affd700 1 -- 172.21.15.82:0/2255810968 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000bb40 con 0x7f045c159500 2023-10-06T03:17:02.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f04626a8700 1 -- 172.21.15.82:0/2255810968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c159500 msgr2=0x7f045c1598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:02.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f04626a8700 1 --2- 172.21.15.82:0/2255810968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c159500 0x7f045c1598d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04500098e0 tx=0x7f04500091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f04626a8700 1 -- 172.21.15.82:0/2255810968 shutdown_connections 2023-10-06T03:17:02.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f04626a8700 1 --2- 172.21.15.82:0/2255810968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c159500 0x7f045c1598d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f04626a8700 1 --2- 172.21.15.82:0/2255810968 >> v2:172.21.15.134:3300/0 conn(0x7f045c0b3fd0 0x7f045c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f04626a8700 1 -- 172.21.15.82:0/2255810968 >> 172.21.15.82:0/2255810968 conn(0x7f045c067630 msgr2=0x7f045c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:02.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f04626a8700 1 -- 172.21.15.82:0/2255810968 shutdown_connections 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.517+0000 7f04626a8700 1 -- 172.21.15.82:0/2255810968 wait complete. 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.518+0000 7f04626a8700 1 Processor -- start 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.518+0000 7f04626a8700 1 -- start start 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f04626a8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c0b3fd0 0x7f045c169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f04626a8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c159500 0x7f045c16cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f04626a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c15d8e0 0x7f045c14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f04626a8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0688f0 con 0x7f045c159500 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f04626a8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c067a40 con 0x7f045c15d8e0 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f04626a8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c067ce0 con 0x7f045c0b3fd0 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f045b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c159500 0x7f045c16cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:02.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f045b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c159500 0x7f045c16cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39014/0 (socket says 172.21.15.82:39014) 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f045b7fe700 1 -- 172.21.15.82:0/3812898331 learned_addr learned my addr 172.21.15.82:0/3812898331 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.519+0000 7f045bfff700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c0b3fd0 0x7f045c169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f0460c45700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c15d8e0 0x7f045c14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f045b7fe700 1 -- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c0b3fd0 msgr2=0x7f045c169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f045b7fe700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c0b3fd0 0x7f045c169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f045b7fe700 1 -- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c15d8e0 msgr2=0x7f045c14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f045b7fe700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c15d8e0 0x7f045c14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f045b7fe700 1 -- 172.21.15.82:0/3812898331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c009420 con 0x7f045c159500 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f0460c45700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c15d8e0 0x7f045c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f045b7fe700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c159500 0x7f045c16cc00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f044c00ec80 tx=0x7f044c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f0443fff700 1 -- 172.21.15.82:0/3812898331 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00c8f0 con 0x7f045c159500 2023-10-06T03:17:02.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f0443fff700 1 -- 172.21.15.82:0/3812898331 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c00ca50 con 0x7f045c159500 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0450009420 con 0x7f045c159500 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f0443fff700 1 -- 172.21.15.82:0/3812898331 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00cdd0 con 0x7f045c159500 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.520+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c0682a0 con 0x7f045c159500 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.521+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c068aa0 con 0x7f045c159500 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.521+0000 7f0443fff700 1 -- 172.21.15.82:0/3812898331 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f044c013680 con 0x7f045c159500 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.522+0000 7f0443fff700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0448066f30 0x7f04480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.522+0000 7f0443fff700 1 -- 172.21.15.82:0/3812898331 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f044c084970 con 0x7f045c159500 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.522+0000 7f045bfff700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0448066f30 0x7f04480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:02.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.522+0000 7f045bfff700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0448066f30 0x7f04480693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04500091e0 tx=0x7f0450017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:02.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.526+0000 7f0443fff700 1 -- 172.21.15.82:0/3812898331 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f045c068aa0 con 0x7f045c159500 2023-10-06T03:17:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:02.752+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f045c064050 con 0x7f045c159500 2023-10-06T03:17:03.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.372+0000 7f0443fff700 1 -- 172.21.15.82:0/3812898331 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7f044c055570 con 0x7f045c159500 2023-10-06T03:17:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.375+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0448066f30 msgr2=0x7f04480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.375+0000 7f04626a8700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0448066f30 0x7f04480693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04500091e0 tx=0x7f0450017000 comp rx=0 tx=0).stop 2023-10-06T03:17:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.375+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c159500 msgr2=0x7f045c16cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.375+0000 7f04626a8700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c159500 0x7f045c16cc00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f044c00ec80 tx=0x7f044c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.376+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 shutdown_connections 2023-10-06T03:17:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.376+0000 7f04626a8700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045c15d8e0 0x7f045c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.376+0000 7f04626a8700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0448066f30 0x7f04480693e0 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04500091e0 tx=0x7f0450017000 comp rx=0 tx=0).stop 2023-10-06T03:17:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.376+0000 7f04626a8700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f045c0b3fd0 0x7f045c169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.376+0000 7f04626a8700 1 --2- 172.21.15.82:0/3812898331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c159500 0x7f045c16cc00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.376+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 >> 172.21.15.82:0/3812898331 conn(0x7f045c067630 msgr2=0x7f045c0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:03.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.378+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 shutdown_connections 2023-10-06T03:17:03.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.378+0000 7f04626a8700 1 -- 172.21.15.82:0/3812898331 wait complete. 2023-10-06T03:17:03.380 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 7 and data pool 8 2023-10-06T03:17:03.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:03.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.510+0000 7fc9a8d93700 1 Processor -- start 2023-10-06T03:17:03.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.510+0000 7fc9a8d93700 1 -- start start 2023-10-06T03:17:03.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a8d93700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9a415d560 0x7fc9a40d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a8d93700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a415d930 0x7fc9a40b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a8d93700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40b2ad0 con 0x7fc9a41591b0 2023-10-06T03:17:03.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a8d93700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a40b4160 con 0x7fc9a415d560 2023-10-06T03:17:03.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a8d93700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40b1f80 con 0x7fc9a415d930 2023-10-06T03:17:03.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9a415d560 0x7fc9a40d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9a415d560 0x7fc9a40d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39028/0 (socket says 172.21.15.82:39028) 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a259c700 1 -- 172.21.15.82:0/803289809 learned_addr learned my addr 172.21.15.82:0/803289809 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a1d9b700 1 --2- 172.21.15.82:0/803289809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a415d930 0x7fc9a40b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a259c700 1 -- 172.21.15.82:0/803289809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a415d930 msgr2=0x7fc9a40b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a259c700 1 --2- 172.21.15.82:0/803289809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a415d930 0x7fc9a40b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a259c700 1 -- 172.21.15.82:0/803289809 >> v1:172.21.15.134:6789/0 conn(0x7fc9a41591b0 legacy=0x7fc9a4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a259c700 1 -- 172.21.15.82:0/803289809 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40b2230 con 0x7fc9a415d560 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.511+0000 7fc9a259c700 1 --2- 172.21.15.82:0/803289809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a40d0030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009f20 tx=0x7fc99c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa64d521fa3a168 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a159a700 1 -- 172.21.15.82:0/803289809 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00e070 con 0x7fc9a415d560 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a159a700 1 -- 172.21.15.82:0/803289809 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00ba40 con 0x7fc9a415d560 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a159a700 1 -- 172.21.15.82:0/803289809 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0092e0 con 0x7fc9a415d560 2023-10-06T03:17:03.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a8d93700 1 -- 172.21.15.82:0/803289809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 msgr2=0x7fc9a40d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/803289809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a40d0030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009f20 tx=0x7fc99c009840 comp rx=0 tx=0).stop 2023-10-06T03:17:03.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a8d93700 1 -- 172.21.15.82:0/803289809 shutdown_connections 2023-10-06T03:17:03.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/803289809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a40d0030 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/803289809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a415d930 0x7fc9a40b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a8d93700 1 -- 172.21.15.82:0/803289809 >> 172.21.15.82:0/803289809 conn(0x7fc9a40d1180 msgr2=0x7fc9a4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:03.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a8d93700 1 -- 172.21.15.82:0/803289809 shutdown_connections 2023-10-06T03:17:03.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.512+0000 7fc9a8d93700 1 -- 172.21.15.82:0/803289809 wait complete. 2023-10-06T03:17:03.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.513+0000 7fc9a8d93700 1 Processor -- start 2023-10-06T03:17:03.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.513+0000 7fc9a8d93700 1 -- start start 2023-10-06T03:17:03.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a8d93700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a41591b0 0x7fc9a416a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a8d93700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a416a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a8d93700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9a415d930 0x7fc9a4153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a8d93700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a416db50 con 0x7fc9a415d560 2023-10-06T03:17:03.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a8d93700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a416dfe0 con 0x7fc9a415d930 2023-10-06T03:17:03.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a8d93700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4153d70 con 0x7fc9a41591b0 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a416a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a416a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39038/0 (socket says 172.21.15.82:39038) 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 -- 172.21.15.82:0/2827687482 learned_addr learned my addr 172.21.15.82:0/2827687482 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a259c700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a41591b0 0x7fc9a416a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 -- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a41591b0 msgr2=0x7fc9a416a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a41591b0 0x7fc9a416a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 -- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9a415d930 msgr2=0x7fc9a4153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a2d9d700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9a415d930 0x7fc9a4153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9a415d930 0x7fc9a4153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 -- 172.21.15.82:0/2827687482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c009ae0 con 0x7fc9a415d560 2023-10-06T03:17:03.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.514+0000 7fc9a1d9b700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a416a700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc99800d890 tx=0x7fc998008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.515+0000 7fc9927fc700 1 -- 172.21.15.82:0/2827687482 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800b600 con 0x7fc9a415d560 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.515+0000 7fc9927fc700 1 -- 172.21.15.82:0/2827687482 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99800b760 con 0x7fc9a415d560 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.515+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a416d220 con 0x7fc9a415d560 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.515+0000 7fc9927fc700 1 -- 172.21.15.82:0/2827687482 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800bae0 con 0x7fc9a415d560 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.515+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a416d7e0 con 0x7fc9a415d560 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.516+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a40cffa0 con 0x7fc9a415d560 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.516+0000 7fc9927fc700 1 -- 172.21.15.82:0/2827687482 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc99801e460 con 0x7fc9a415d560 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.516+0000 7fc9927fc700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc984066f30 0x7fc9840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.516+0000 7fc9927fc700 1 -- 172.21.15.82:0/2827687482 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc998084d70 con 0x7fc9a415d560 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.517+0000 7fc9a259c700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc984066f30 0x7fc9840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.517+0000 7fc9a259c700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc984066f30 0x7fc9840693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009880 tx=0x7fc99c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:03.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.521+0000 7fc9927fc700 1 -- 172.21.15.82:0/2827687482 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc998051e80 con 0x7fc9a415d560 2023-10-06T03:17:03.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.706+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a4064050 con 0x7fc9a415d560 2023-10-06T03:17:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.707+0000 7fc9927fc700 1 -- 172.21.15.82:0/2827687482 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fc9980554a0 con 0x7fc9a415d560 2023-10-06T03:17:03.708 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:03.708 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":42,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:02.753101+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:00.394566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:01.721357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:03.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.709+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc984066f30 msgr2=0x7fc9840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.709+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc984066f30 0x7fc9840693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009880 tx=0x7fc99c017000 comp rx=0 tx=0).stop 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.709+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 msgr2=0x7fc9a416a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.709+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a416a700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc99800d890 tx=0x7fc998008040 comp rx=0 tx=0).stop 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.710+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 shutdown_connections 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.710+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9a415d930 0x7fc9a4153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.710+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc984066f30 0x7fc9840693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.710+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9a41591b0 0x7fc9a416a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.710+0000 7fc9a8d93700 1 --2- 172.21.15.82:0/2827687482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a415d560 0x7fc9a416a700 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.710+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 >> 172.21.15.82:0/2827687482 conn(0x7fc9a40d1180 msgr2=0x7fc9a40b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.710+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 shutdown_connections 2023-10-06T03:17:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.710+0000 7fc9a8d93700 1 -- 172.21.15.82:0/2827687482 wait complete. 2023-10-06T03:17:03.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.838+0000 7f63a4774700 1 Processor -- start 2023-10-06T03:17:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.838+0000 7f63a4774700 1 -- start start 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a4774700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f639c15d560 0x7f639c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a4774700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 0x7f639c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a4774700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639c0b2ad0 con 0x7f639c1591b0 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a4774700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639c0b4160 con 0x7f639c15d560 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a4774700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c0b1f80 con 0x7f639c15d930 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a2510700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f639c15d560 0x7f639c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a2d11700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f639c1591b0 0x7f639c159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56884/0 (socket says 172.21.15.82:56884) 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a2d11700 1 -- 172.21.15.82:0/1469754364 learned_addr learned my addr 172.21.15.82:0/1469754364 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a1d0f700 1 --2- 172.21.15.82:0/1469754364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 0x7f639c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a2510700 1 -- 172.21.15.82:0/1469754364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 msgr2=0x7f639c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a2510700 1 --2- 172.21.15.82:0/1469754364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 0x7f639c0b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a2510700 1 -- 172.21.15.82:0/1469754364 >> v1:172.21.15.82:6789/0 conn(0x7f639c1591b0 legacy=0x7f639c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a2510700 1 -- 172.21.15.82:0/1469754364 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c0b2230 con 0x7f639c15d560 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.839+0000 7f63a2510700 1 --2- 172.21.15.82:0/1469754364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c15d560 0x7f639c0d0030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f63980098e0 tx=0x7f63980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e7a4619615b97a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a150e700 1 -- 172.21.15.82:0/1469754364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398009e80 con 0x7f639c15d560 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a150e700 1 -- 172.21.15.82:0/1469754364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639800b860 con 0x7f639c15d560 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a150e700 1 -- 172.21.15.82:0/1469754364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800bbe0 con 0x7f639c15d560 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a4774700 1 -- 172.21.15.82:0/1469754364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c15d560 msgr2=0x7f639c0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a4774700 1 --2- 172.21.15.82:0/1469754364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c15d560 0x7f639c0d0030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f63980098e0 tx=0x7f63980091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a4774700 1 -- 172.21.15.82:0/1469754364 shutdown_connections 2023-10-06T03:17:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a4774700 1 --2- 172.21.15.82:0/1469754364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c15d560 0x7f639c0d0030 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a4774700 1 --2- 172.21.15.82:0/1469754364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 0x7f639c0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a4774700 1 -- 172.21.15.82:0/1469754364 >> 172.21.15.82:0/1469754364 conn(0x7f639c0d1180 msgr2=0x7f639c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a4774700 1 -- 172.21.15.82:0/1469754364 shutdown_connections 2023-10-06T03:17:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.840+0000 7f63a4774700 1 -- 172.21.15.82:0/1469754364 wait complete. 2023-10-06T03:17:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.841+0000 7f63a4774700 1 Processor -- start 2023-10-06T03:17:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.841+0000 7f63a4774700 1 -- start start 2023-10-06T03:17:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a4774700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c1591b0 0x7f639c13f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a4774700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f639c15d560 0x7f639c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a4774700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 0x7f639c169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a4774700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c13f8a0 con 0x7f639c1591b0 2023-10-06T03:17:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a4774700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c13cb70 con 0x7f639c15d560 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a4774700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c13ce50 con 0x7f639c15d930 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c1591b0 0x7f639c13f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c1591b0 0x7f639c13f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39060/0 (socket says 172.21.15.82:39060) 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 -- 172.21.15.82:0/251739436 learned_addr learned my addr 172.21.15.82:0/251739436 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 -- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 msgr2=0x7f639c169d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 0x7f639c169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 -- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f639c15d560 msgr2=0x7f639c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f639c15d560 0x7f639c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 -- 172.21.15.82:0/251739436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398009420 con 0x7f639c1591b0 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.842+0000 7f63a2510700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c1591b0 0x7f639c13f360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f639c064a20 tx=0x7f6398017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.843+0000 7f63927fc700 1 -- 172.21.15.82:0/251739436 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800bbe0 con 0x7f639c1591b0 2023-10-06T03:17:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.843+0000 7f63927fc700 1 -- 172.21.15.82:0/251739436 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398011420 con 0x7f639c1591b0 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.843+0000 7f63927fc700 1 -- 172.21.15.82:0/251739436 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63980117c0 con 0x7f639c1591b0 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.843+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639c13d130 con 0x7f639c1591b0 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.843+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639c13d6f0 con 0x7f639c1591b0 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.844+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639c13d8b0 con 0x7f639c1591b0 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.844+0000 7f63927fc700 1 -- 172.21.15.82:0/251739436 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6398011bb0 con 0x7f639c1591b0 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.844+0000 7f63927fc700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6380066f60 0x7f6380069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.844+0000 7f63927fc700 1 -- 172.21.15.82:0/251739436 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6398086000 con 0x7f639c1591b0 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.844+0000 7f63a1d0f700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6380066f60 0x7f6380069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.845+0000 7f63a1d0f700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6380066f60 0x7f6380069410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f639c14d650 tx=0x7f638c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:03.848+0000 7f63927fc700 1 -- 172.21.15.82:0/251739436 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6398053110 con 0x7f639c1591b0 2023-10-06T03:17:04.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.035+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f639c064050 con 0x7f639c1591b0 2023-10-06T03:17:04.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.036+0000 7f63927fc700 1 -- 172.21.15.82:0/251739436 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f6398011e60 con 0x7f639c1591b0 2023-10-06T03:17:04.037 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:04.037 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":42,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:02.753101+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:00.394566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:01.721357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:04.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6380066f60 msgr2=0x7f6380069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:04.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6380066f60 0x7f6380069410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f639c14d650 tx=0x7f638c008040 comp rx=0 tx=0).stop 2023-10-06T03:17:04.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c1591b0 msgr2=0x7f639c13f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c1591b0 0x7f639c13f360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f639c064a20 tx=0x7f6398017000 comp rx=0 tx=0).stop 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 shutdown_connections 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6380066f60 0x7f6380069410 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f639c15d930 0x7f639c169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f639c1591b0 0x7f639c13f360 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 --2- 172.21.15.82:0/251739436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f639c15d560 0x7f639c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 >> 172.21.15.82:0/251739436 conn(0x7f639c0d1180 msgr2=0x7f639c0b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 shutdown_connections 2023-10-06T03:17:04.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.038+0000 7f63a4774700 1 -- 172.21.15.82:0/251739436 wait complete. 2023-10-06T03:17:04.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:17:04.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.166+0000 7f63c7988700 1 Processor -- start 2023-10-06T03:17:04.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.167+0000 7f63c7988700 1 -- start start 2023-10-06T03:17:04.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.167+0000 7f63c7988700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63c0159500 0x7f63c01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.167+0000 7f63c7988700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c015dab0 0x7f63c00cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.167+0000 7f63c7988700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00b1110 con 0x7f63c00b3fd0 2023-10-06T03:17:04.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.167+0000 7f63c7988700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c00b13b0 con 0x7f63c0159500 2023-10-06T03:17:04.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.167+0000 7f63c7988700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00b1690 con 0x7f63c015dab0 2023-10-06T03:17:04.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63c4f23700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f63c00b3fd0 0x7f63c015d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56900/0 (socket says 172.21.15.82:56900) 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63c4f23700 1 -- 172.21.15.82:0/3900564592 learned_addr learned my addr 172.21.15.82:0/3900564592 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63c5724700 1 --2- 172.21.15.82:0/3900564592 >> v2:172.21.15.134:3300/0 conn(0x7f63c0159500 0x7f63c01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63c5f25700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c015dab0 0x7f63c00cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108307284 0 0) 0x7f63c00b1110 con 0x7f63c00b3fd0 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63ac003570 con 0x7f63c00b3fd0 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657324056 0 0) 0x7f63ac003570 con 0x7f63c00b3fd0 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c015dab0 msgr2=0x7f63c00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c015dab0 0x7f63c00cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 >> v2:172.21.15.134:3300/0 conn(0x7f63c0159500 msgr2=0x7f63c01598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 --2- 172.21.15.82:0/3900564592 >> v2:172.21.15.134:3300/0 conn(0x7f63c0159500 0x7f63c01598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c00b1970 con 0x7f63c00b3fd0 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f63b0001470 con 0x7f63c00b3fd0 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 >> v1:172.21.15.82:6789/0 conn(0x7f63c00b3fd0 legacy=0x7f63c015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac003a60 0x7f63ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63ac004810 0x7f63ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c015dab0 0x7f63ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00b13b0 con 0x7f63ac004810 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00b1690 con 0x7f63ac003a60 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac00ba60 con 0x7f63c015dab0 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63c4f23700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63ac004810 0x7f63ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63c5724700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac003a60 0x7f63ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.168+0000 7f63c5f25700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c015dab0 0x7f63ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c4f23700 1 -- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c015dab0 msgr2=0x7f63ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c4f23700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c015dab0 0x7f63ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c4f23700 1 -- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac003a60 msgr2=0x7f63ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c4f23700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac003a60 0x7f63ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c4f23700 1 -- 172.21.15.82:0/3900564592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac003570 con 0x7f63ac004810 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c4f23700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63ac004810 0x7f63ac004c80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f63b000c3f0 tx=0x7f63b0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614d4c43ae604210 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b000cc80 con 0x7f63ac004810 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b000ce00 con 0x7f63ac004810 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63b7fff700 1 -- 172.21.15.82:0/3900564592 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0005b70 con 0x7f63ac004810 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c7988700 1 -- 172.21.15.82:0/3900564592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63ac004810 msgr2=0x7f63ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c7988700 1 --2- 172.21.15.82:0/3900564592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63ac004810 0x7f63ac004c80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f63b000c3f0 tx=0x7f63b0001e90 comp rx=0 tx=0).stop 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c5f25700 1 -- 172.21.15.82:0/3900564592 reap_dead start 2023-10-06T03:17:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c7988700 1 -- 172.21.15.82:0/3900564592 shutdown_connections 2023-10-06T03:17:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.169+0000 7f63c7988700 1 -- 172.21.15.82:0/3900564592 >> 172.21.15.82:0/3900564592 conn(0x7f63c0067630 msgr2=0x7f63c0069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.170+0000 7f63c7988700 1 -- 172.21.15.82:0/3900564592 shutdown_connections 2023-10-06T03:17:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.170+0000 7f63c7988700 1 -- 172.21.15.82:0/3900564592 wait complete. 2023-10-06T03:17:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.171+0000 7f63c7988700 1 Processor -- start 2023-10-06T03:17:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.171+0000 7f63c7988700 1 -- start start 2023-10-06T03:17:04.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.171+0000 7f63c7988700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac004810 0x7f63c0150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.171+0000 7f63c7988700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c016e2f0 0x7f63c00b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.171+0000 7f63c7988700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63c013ec30 0x7f63c013f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.171+0000 7f63c7988700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c015a980 con 0x7f63c013ec30 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.171+0000 7f63c7988700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0150cb0 con 0x7f63ac004810 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.171+0000 7f63c7988700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c013f5d0 con 0x7f63c016e2f0 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63c013ec30 0x7f63c013f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63c013ec30 0x7f63c013f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39080/0 (socket says 172.21.15.82:39080) 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 -- 172.21.15.82:0/2065944763 learned_addr learned my addr 172.21.15.82:0/2065944763 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c4f23700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c016e2f0 0x7f63c00b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5724700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac004810 0x7f63c0150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 -- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c016e2f0 msgr2=0x7f63c00b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c016e2f0 0x7f63c00b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 -- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac004810 msgr2=0x7f63c0150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac004810 0x7f63c0150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 -- 172.21.15.82:0/2065944763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c01509d0 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c5f25700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63c013ec30 0x7f63c013f090 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f63c015deb0 tx=0x7f63b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63b57fa700 1 -- 172.21.15.82:0/2065944763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800e040 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63b57fa700 1 -- 172.21.15.82:0/2065944763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b800f040 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c014dd90 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63b57fa700 1 -- 172.21.15.82:0/2065944763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800fda0 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.172+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c014e350 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.173+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c014dbf0 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.173+0000 7f63b57fa700 1 -- 172.21.15.82:0/2065944763 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63b8015640 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.174+0000 7f63b57fa700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f63a4066f30 0x7f63a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.174+0000 7f63b57fa700 1 -- 172.21.15.82:0/2065944763 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f63b8084eb0 con 0x7f63c013ec30 2023-10-06T03:17:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.174+0000 7f63c5724700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f63a4066f30 0x7f63a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:04.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.175+0000 7f63c5724700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f63a4066f30 0x7f63a40693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63bc006f00 tx=0x7f63bc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:04.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.178+0000 7f63b57fa700 1 -- 172.21.15.82:0/2065944763 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63c014dbf0 con 0x7f63c013ec30 2023-10-06T03:17:04.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:04.404+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f63c014dbf0 con 0x7f63c013ec30 2023-10-06T03:17:05.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.381+0000 7f63b57fa700 1 -- 172.21.15.82:0/2065944763 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f63c014dbf0 con 0x7f63c013ec30 2023-10-06T03:17:05.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f63a4066f30 msgr2=0x7f63a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:05.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f63a4066f30 0x7f63a40693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63bc006f00 tx=0x7f63bc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63c013ec30 msgr2=0x7f63c013f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:05.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63c013ec30 0x7f63c013f090 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f63c015deb0 tx=0x7f63b800b040 comp rx=0 tx=0).stop 2023-10-06T03:17:05.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 shutdown_connections 2023-10-06T03:17:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63c013ec30 0x7f63c013f090 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63ac004810 0x7f63c0150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f63a4066f30 0x7f63a40693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 --2- 172.21.15.82:0/2065944763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63c016e2f0 0x7f63c00b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 >> 172.21.15.82:0/2065944763 conn(0x7f63c0067630 msgr2=0x7f63c015d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 shutdown_connections 2023-10-06T03:17:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.384+0000 7f63c7988700 1 -- 172.21.15.82:0/2065944763 wait complete. 2023-10-06T03:17:05.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:17:05.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.523+0000 7f14b8a05700 1 Processor -- start 2023-10-06T03:17:05.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.523+0000 7f14b8a05700 1 -- start start 2023-10-06T03:17:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.523+0000 7f14b8a05700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14b41598d0 0x7f14b415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14b8a05700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f14b415d8e0 0x7f14b40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14b8a05700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b415dd20 con 0x7f14b4159500 2023-10-06T03:17:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14b8a05700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40b1110 con 0x7f14b41598d0 2023-10-06T03:17:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14b8a05700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40b13b0 con 0x7f14b415d8e0 2023-10-06T03:17:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14a9d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14b41598d0 0x7f14b415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14a9d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14b41598d0 0x7f14b415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39086/0 (socket says 172.21.15.82:39086) 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14a9d9b700 1 -- 172.21.15.82:0/857623996 learned_addr learned my addr 172.21.15.82:0/857623996 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14b2d9d700 1 --2- 172.21.15.82:0/857623996 >> v2:172.21.15.134:3300/0 conn(0x7f14b415d8e0 0x7f14b40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14a9d9b700 1 -- 172.21.15.82:0/857623996 >> v2:172.21.15.134:3300/0 conn(0x7f14b415d8e0 msgr2=0x7f14b40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14a9d9b700 1 --2- 172.21.15.82:0/857623996 >> v2:172.21.15.134:3300/0 conn(0x7f14b415d8e0 0x7f14b40cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14a9d9b700 1 -- 172.21.15.82:0/857623996 >> v1:172.21.15.134:6789/0 conn(0x7f14b4159500 legacy=0x7f14b40b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14a9d9b700 1 -- 172.21.15.82:0/857623996 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b40b1690 con 0x7f14b41598d0 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14a9d9b700 1 --2- 172.21.15.82:0/857623996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b415d3a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f14b406a270 tx=0x7f149c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51646f646c09faa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14b1d9b700 1 -- 172.21.15.82:0/857623996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c009e70 con 0x7f14b41598d0 2023-10-06T03:17:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14b1d9b700 1 -- 172.21.15.82:0/857623996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c00b860 con 0x7f14b41598d0 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.524+0000 7f14b1d9b700 1 -- 172.21.15.82:0/857623996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c00bc00 con 0x7f14b41598d0 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.525+0000 7f14b8a05700 1 -- 172.21.15.82:0/857623996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 msgr2=0x7f14b415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.525+0000 7f14b8a05700 1 --2- 172.21.15.82:0/857623996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b415d3a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f14b406a270 tx=0x7f149c009250 comp rx=0 tx=0).stop 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.525+0000 7f14b8a05700 1 -- 172.21.15.82:0/857623996 shutdown_connections 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.525+0000 7f14b8a05700 1 --2- 172.21.15.82:0/857623996 >> v2:172.21.15.134:3300/0 conn(0x7f14b415d8e0 0x7f14b40cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.525+0000 7f14b8a05700 1 --2- 172.21.15.82:0/857623996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b415d3a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.525+0000 7f14b8a05700 1 -- 172.21.15.82:0/857623996 >> 172.21.15.82:0/857623996 conn(0x7f14b4067630 msgr2=0x7f14b4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.525+0000 7f14b8a05700 1 -- 172.21.15.82:0/857623996 shutdown_connections 2023-10-06T03:17:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.525+0000 7f14b8a05700 1 -- 172.21.15.82:0/857623996 wait complete. 2023-10-06T03:17:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.526+0000 7f14b8a05700 1 Processor -- start 2023-10-06T03:17:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.526+0000 7f14b8a05700 1 -- start start 2023-10-06T03:17:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b8a05700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b4159500 0x7f14b4159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b8a05700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b4149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b8a05700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b415d8e0 0x7f14b4141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b8a05700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415b0e0 con 0x7f14b41598d0 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b8a05700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b414a1e0 con 0x7f14b4159500 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b8a05700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4141660 con 0x7f14b415d8e0 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b4149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b4149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39098/0 (socket says 172.21.15.82:39098) 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 -- 172.21.15.82:0/566331531 learned_addr learned my addr 172.21.15.82:0/566331531 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b259c700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b4159500 0x7f14b4159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b2d9d700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b415d8e0 0x7f14b4141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 -- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b415d8e0 msgr2=0x7f14b4141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b415d8e0 0x7f14b4141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 -- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b4159500 msgr2=0x7f14b4159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b4159500 0x7f14b4159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 -- 172.21.15.82:0/566331531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c0094f0 con 0x7f14b41598d0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b2d9d700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b415d8e0 0x7f14b4141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14a9d9b700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b4149ca0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f14b415deb0 tx=0x7f149c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14aaffd700 1 -- 172.21.15.82:0/566331531 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c00b9d0 con 0x7f14b41598d0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14aaffd700 1 -- 172.21.15.82:0/566331531 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c00bb30 con 0x7f14b41598d0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b415a4d0 con 0x7f14b41598d0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14aaffd700 1 -- 172.21.15.82:0/566331531 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c025670 con 0x7f14b41598d0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.527+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b415aa90 con 0x7f14b41598d0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.528+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b4064050 con 0x7f14b41598d0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.529+0000 7f14aaffd700 1 -- 172.21.15.82:0/566331531 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f149c023070 con 0x7f14b41598d0 2023-10-06T03:17:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.529+0000 7f14aaffd700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:05.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.529+0000 7f14aaffd700 1 -- 172.21.15.82:0/566331531 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f149c085ae0 con 0x7f14b41598d0 2023-10-06T03:17:05.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.529+0000 7f14b259c700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:05.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.530+0000 7f14b259c700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1494066f30 0x7f14940693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f14a4003a80 tx=0x7f14a4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:05.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.533+0000 7f14aaffd700 1 -- 172.21.15.82:0/566331531 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f149c052bf0 con 0x7f14b41598d0 2023-10-06T03:17:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:05.759+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f14b40b1970 con 0x7f14b41598d0 2023-10-06T03:17:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.384+0000 7f14aaffd700 1 -- 172.21.15.82:0/566331531 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f149c056210 con 0x7f14b41598d0 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1494066f30 msgr2=0x7f14940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1494066f30 0x7f14940693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f14a4003a80 tx=0x7f14a4007ec0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 msgr2=0x7f14b4149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b4149ca0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f14b415deb0 tx=0x7f149c017000 comp rx=0 tx=0).stop 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 shutdown_connections 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14b415d8e0 0x7f14b4141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b4159500 0x7f14b4159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 --2- 172.21.15.82:0/566331531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14b41598d0 0x7f14b4149ca0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 >> 172.21.15.82:0/566331531 conn(0x7f14b4067630 msgr2=0x7f14b4068050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 shutdown_connections 2023-10-06T03:17:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.387+0000 7f14b8a05700 1 -- 172.21.15.82:0/566331531 wait complete. 2023-10-06T03:17:06.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:06.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.514+0000 7fbe2c164700 1 Processor -- start 2023-10-06T03:17:06.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.514+0000 7fbe2c164700 1 -- start start 2023-10-06T03:17:06.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe2c164700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe24157370 0x7fbe24157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe2c164700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe2406ab00 0x7fbe24068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe2c164700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe240cacd0 con 0x7fbe240ca730 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe2c164700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe240cafb0 con 0x7fbe2406ab00 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe2c164700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240cb290 con 0x7fbe24157370 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe2a701700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe2406ab00 0x7fbe24068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe296ff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbe240ca730 0x7fbe240af920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56912/0 (socket says 172.21.15.82:56912) 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe296ff700 1 -- 172.21.15.82:0/1385096076 learned_addr learned my addr 172.21.15.82:0/1385096076 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.515+0000 7fbe29f00700 1 --2- 172.21.15.82:0/1385096076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe24157370 0x7fbe24157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2a701700 1 -- 172.21.15.82:0/1385096076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe24157370 msgr2=0x7fbe24157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2a701700 1 --2- 172.21.15.82:0/1385096076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe24157370 0x7fbe24157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2a701700 1 -- 172.21.15.82:0/1385096076 >> v1:172.21.15.82:6789/0 conn(0x7fbe240ca730 legacy=0x7fbe240af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2a701700 1 -- 172.21.15.82:0/1385096076 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240cb570 con 0x7fbe2406ab00 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe28efe700 1 -- 172.21.15.82:0/1385096076 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923242345 0 0) 0x7fbe240cacd0 con 0x7fbe240ca730 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2a701700 1 --2- 172.21.15.82:0/1385096076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe24068ed0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0098e0 tx=0x7fbe1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5854c01966cdf513 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe28efe700 1 -- 172.21.15.82:0/1385096076 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c009e80 con 0x7fbe2406ab00 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe28efe700 1 -- 172.21.15.82:0/1385096076 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c00b860 con 0x7fbe2406ab00 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe28efe700 1 -- 172.21.15.82:0/1385096076 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00bbe0 con 0x7fbe2406ab00 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2c164700 1 -- 172.21.15.82:0/1385096076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 msgr2=0x7fbe24068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2c164700 1 --2- 172.21.15.82:0/1385096076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe24068ed0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0098e0 tx=0x7fbe1c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2c164700 1 -- 172.21.15.82:0/1385096076 shutdown_connections 2023-10-06T03:17:06.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2c164700 1 --2- 172.21.15.82:0/1385096076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe24068ed0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2c164700 1 --2- 172.21.15.82:0/1385096076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe24157370 0x7fbe24157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2c164700 1 -- 172.21.15.82:0/1385096076 >> 172.21.15.82:0/1385096076 conn(0x7fbe240ca0a0 msgr2=0x7fbe2406de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:06.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2c164700 1 -- 172.21.15.82:0/1385096076 shutdown_connections 2023-10-06T03:17:06.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.516+0000 7fbe2c164700 1 -- 172.21.15.82:0/1385096076 wait complete. 2023-10-06T03:17:06.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe2c164700 1 Processor -- start 2023-10-06T03:17:06.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe2c164700 1 -- start start 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe2c164700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe241699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe2c164700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe240ca730 0x7fbe240ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe2c164700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe24157370 0x7fbe240b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe2c164700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24159450 con 0x7fbe2406ab00 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe2c164700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24169f00 con 0x7fbe24157370 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe2c164700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24158840 con 0x7fbe240ca730 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe29f00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe241699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe29f00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe241699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39112/0 (socket says 172.21.15.82:39112) 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.518+0000 7fbe29f00700 1 -- 172.21.15.82:0/2522169855 learned_addr learned my addr 172.21.15.82:0/2522169855 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe296ff700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe240ca730 0x7fbe240ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe2a701700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe24157370 0x7fbe240b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe29f00700 1 -- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe240ca730 msgr2=0x7fbe240ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe29f00700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe240ca730 0x7fbe240ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe29f00700 1 -- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe24157370 msgr2=0x7fbe240b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe29f00700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe24157370 0x7fbe240b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe29f00700 1 -- 172.21.15.82:0/2522169855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009420 con 0x7fbe2406ab00 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe296ff700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe240ca730 0x7fbe240ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe29f00700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe241699c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000ce10 tx=0x7fbe20007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe19ffb700 1 -- 172.21.15.82:0/2522169855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000ab90 con 0x7fbe2406ab00 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe19ffb700 1 -- 172.21.15.82:0/2522169855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2000acf0 con 0x7fbe2406ab00 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe24158b20 con 0x7fbe2406ab00 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe19ffb700 1 -- 172.21.15.82:0/2522169855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20017660 con 0x7fbe2406ab00 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.519+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe241590e0 con 0x7fbe2406ab00 2023-10-06T03:17:06.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.520+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe24064050 con 0x7fbe2406ab00 2023-10-06T03:17:06.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.520+0000 7fbe19ffb700 1 -- 172.21.15.82:0/2522169855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe20003020 con 0x7fbe2406ab00 2023-10-06T03:17:06.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.521+0000 7fbe19ffb700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe08066f30 0x7fbe080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.521+0000 7fbe19ffb700 1 -- 172.21.15.82:0/2522169855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbe20013070 con 0x7fbe2406ab00 2023-10-06T03:17:06.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.521+0000 7fbe296ff700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe08066f30 0x7fbe080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.521+0000 7fbe296ff700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe08066f30 0x7fbe080693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe140018d0 tx=0x7fbe14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:06.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.525+0000 7fbe19ffb700 1 -- 172.21.15.82:0/2522169855 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe20051d10 con 0x7fbe2406ab00 2023-10-06T03:17:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.749+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe240cb850 con 0x7fbe2406ab00 2023-10-06T03:17:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.749+0000 7fbe19ffb700 1 -- 172.21.15.82:0/2522169855 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fbe2001c070 con 0x7fbe2406ab00 2023-10-06T03:17:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:06.750 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2460851709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2460851709},{"type":"v1","addr":"172.21.15.134:6837","nonce":2460851709}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/771524024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":771524024},{"type":"v1","addr":"172.21.15.134:6836","nonce":771524024}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/3256175471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3256175471},{"type":"v1","addr":"172.21.15.82:6834","nonce":3256175471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:02.753418+0000","modified":"2023-10-06T03:17:06.382667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1910803570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1910803570},{"type":"v1","addr":"172.21.15.82:6835","nonce":1910803570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe08066f30 msgr2=0x7fbe080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe08066f30 0x7fbe080693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe140018d0 tx=0x7fbe14009040 comp rx=0 tx=0).stop 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 msgr2=0x7fbe241699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe241699c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000ce10 tx=0x7fbe20007810 comp rx=0 tx=0).stop 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 shutdown_connections 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe24157370 0x7fbe240b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2406ab00 0x7fbe241699c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbe08066f30 0x7fbe080693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 --2- 172.21.15.82:0/2522169855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe240ca730 0x7fbe240ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 >> 172.21.15.82:0/2522169855 conn(0x7fbe240ca0a0 msgr2=0x7fbe24156560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:06.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.751+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 shutdown_connections 2023-10-06T03:17:06.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.752+0000 7fbe2c164700 1 -- 172.21.15.82:0/2522169855 wait complete. 2023-10-06T03:17:06.754 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2023-10-06T03:17:06.764 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:06.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.879+0000 7f3c5d3b6700 1 Processor -- start 2023-10-06T03:17:06.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.879+0000 7f3c5d3b6700 1 -- start start 2023-10-06T03:17:06.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.879+0000 7f3c5d3b6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 0x7f3c580d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.879+0000 7f3c5d3b6700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3c5815d930 0x7f3c580b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c5d3b6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c580b2ad0 con 0x7f3c581591b0 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c5d3b6700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c580b4160 con 0x7f3c5815d930 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c5d3b6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580b1f80 con 0x7f3c5815d560 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c577fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3c581591b0 0x7f3c58159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56928/0 (socket says 172.21.15.82:56928) 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c577fe700 1 -- 172.21.15.82:0/1702151154 learned_addr learned my addr 172.21.15.82:0/1702151154 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c4ffff700 1 --2- 172.21.15.82:0/1702151154 >> v2:172.21.15.134:3300/0 conn(0x7f3c5815d930 0x7f3c580b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527494161 0 0) 0x7f3c580b2ad0 con 0x7f3c581591b0 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c56ffd700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 0x7f3c580d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c44003570 con 0x7f3c581591b0 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3264684412 0 0) 0x7f3c44003570 con 0x7f3c581591b0 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 msgr2=0x7f3c580d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 0x7f3c580d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 >> v2:172.21.15.134:3300/0 conn(0x7f3c5815d930 msgr2=0x7f3c580b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 --2- 172.21.15.82:0/1702151154 >> v2:172.21.15.134:3300/0 conn(0x7f3c5815d930 0x7f3c580b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580b2230 con 0x7f3c581591b0 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f3c500017f0 con 0x7f3c581591b0 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 >> v1:172.21.15.82:6789/0 conn(0x7f3c581591b0 legacy=0x7f3c58159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c44003a60 0x7f3c44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 0x7f3c44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c44004d50 0x7f3c440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580b4160 con 0x7f3c44004d50 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580b1f80 con 0x7f3c44003a60 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4400ba60 con 0x7f3c5815d560 2023-10-06T03:17:06.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c577fe700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c44004d50 0x7f3c440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c4ffff700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 0x7f3c44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.880+0000 7f3c56ffd700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c44003a60 0x7f3c44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c577fe700 1 -- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 msgr2=0x7f3c44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c577fe700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 0x7f3c44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c577fe700 1 -- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c44003a60 msgr2=0x7f3c44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c577fe700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c44003a60 0x7f3c44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c577fe700 1 -- 172.21.15.82:0/1702151154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44003570 con 0x7f3c44004d50 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c56ffd700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c44003a60 0x7f3c44003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c4ffff700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c5815d560 0x7f3c44004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c577fe700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c44004d50 0x7f3c440051c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000a970 tx=0x7f3c580d0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f477123498bfed92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c500070d0 con 0x7f3c44004d50 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c50007230 con 0x7f3c44004d50 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c567fc700 1 -- 172.21.15.82:0/1702151154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c500075f0 con 0x7f3c44004d50 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1702151154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c44004d50 msgr2=0x7f3c440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c5d3b6700 1 --2- 172.21.15.82:0/1702151154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c44004d50 0x7f3c440051c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000a970 tx=0x7f3c580d0570 comp rx=0 tx=0).stop 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c577fe700 1 -- 172.21.15.82:0/1702151154 reap_dead start 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1702151154 shutdown_connections 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.881+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1702151154 >> 172.21.15.82:0/1702151154 conn(0x7f3c580d1180 msgr2=0x7f3c58069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.882+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1702151154 shutdown_connections 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.882+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1702151154 wait complete. 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c5d3b6700 1 Processor -- start 2023-10-06T03:17:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c5d3b6700 1 -- start start 2023-10-06T03:17:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c5d3b6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c58153290 0x7f3c58169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c5d3b6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c58153660 0x7f3c5815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c5d3b6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5816ae70 0x7f3c58069110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c5d3b6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5815ae80 con 0x7f3c58153290 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c5d3b6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5816a2f0 con 0x7f3c5816ae70 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c5d3b6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5816a5d0 con 0x7f3c58153660 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c56ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c58153290 0x7f3c58169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c56ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c58153290 0x7f3c58169ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39126/0 (socket says 172.21.15.82:39126) 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.883+0000 7f3c56ffd700 1 -- 172.21.15.82:0/1784900532 learned_addr learned my addr 172.21.15.82:0/1784900532 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c577fe700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5816ae70 0x7f3c58069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c4ffff700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c58153660 0x7f3c5815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c56ffd700 1 -- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c58153660 msgr2=0x7f3c5815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c56ffd700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c58153660 0x7f3c5815cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c56ffd700 1 -- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5816ae70 msgr2=0x7f3c58069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c56ffd700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5816ae70 0x7f3c58069110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c56ffd700 1 -- 172.21.15.82:0/1784900532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5816a8b0 con 0x7f3c58153290 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c4ffff700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c58153660 0x7f3c5815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c56ffd700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c58153290 0x7f3c58169ca0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3c48011960 tx=0x7f3c48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c4effd700 1 -- 172.21.15.82:0/1784900532 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48011ea0 con 0x7f3c58153290 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c4effd700 1 -- 172.21.15.82:0/1784900532 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4800f860 con 0x7f3c58153290 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c4effd700 1 -- 172.21.15.82:0/1784900532 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4800fbe0 con 0x7f3c58153290 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5816ab90 con 0x7f3c58153290 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.884+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5816b2b0 con 0x7f3c58153290 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.885+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c58064050 con 0x7f3c58153290 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.885+0000 7f3c4effd700 1 -- 172.21.15.82:0/1784900532 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c48015460 con 0x7f3c58153290 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.886+0000 7f3c4effd700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3c38066f30 0x7f3c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:06.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.886+0000 7f3c4effd700 1 -- 172.21.15.82:0/1784900532 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3c48084ec0 con 0x7f3c58153290 2023-10-06T03:17:06.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.886+0000 7f3c4ffff700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3c38066f30 0x7f3c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:06.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.886+0000 7f3c4ffff700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3c38066f30 0x7f3c380693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006f00 tx=0x7f3c40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:06.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:06.890+0000 7f3c4effd700 1 -- 172.21.15.82:0/1784900532 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c48051fd0 con 0x7f3c58153290 2023-10-06T03:17:07.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.074+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c580b2510 con 0x7f3c58153290 2023-10-06T03:17:07.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.075+0000 7f3c4effd700 1 -- 172.21.15.82:0/1784900532 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f3c480555f0 con 0x7f3c58153290 2023-10-06T03:17:07.076 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:07.076 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":43,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:04.321808+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:00.394566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:01.721357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3c38066f30 msgr2=0x7f3c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3c38066f30 0x7f3c380693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006f00 tx=0x7f3c40008040 comp rx=0 tx=0).stop 2023-10-06T03:17:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c58153290 msgr2=0x7f3c58169ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c58153290 0x7f3c58169ca0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3c48011960 tx=0x7f3c48008040 comp rx=0 tx=0).stop 2023-10-06T03:17:07.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 shutdown_connections 2023-10-06T03:17:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c5816ae70 0x7f3c58069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c58153290 0x7f3c58169ca0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3c38066f30 0x7f3c380693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 --2- 172.21.15.82:0/1784900532 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c58153660 0x7f3c5815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 >> 172.21.15.82:0/1784900532 conn(0x7f3c580d1180 msgr2=0x7f3c58157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 shutdown_connections 2023-10-06T03:17:07.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.077+0000 7f3c5d3b6700 1 -- 172.21.15.82:0/1784900532 wait complete. 2023-10-06T03:17:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:17:07.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:17:07.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.202+0000 7f1af2fd5700 1 Processor -- start 2023-10-06T03:17:07.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.202+0000 7f1af2fd5700 1 -- start start 2023-10-06T03:17:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af2fd5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1aec0b5600 0x7f1aec0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af2fd5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0b2ad0 con 0x7f1aec15d560 2023-10-06T03:17:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af2fd5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0b4160 con 0x7f1aec15d930 2023-10-06T03:17:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af2fd5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0b2230 con 0x7f1aec0b5600 2023-10-06T03:17:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af0d71700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1aec15d560 0x7f1aec0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56938/0 (socket says 172.21.15.82:56938) 2023-10-06T03:17:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af0d71700 1 -- 172.21.15.82:0/4222747310 learned_addr learned my addr 172.21.15.82:0/4222747310 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af1572700 1 --2- 172.21.15.82:0/4222747310 >> v2:172.21.15.82:3300/0 conn(0x7f1aec0b5600 0x7f1aec0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1aeb7fe700 1 -- 172.21.15.82:0/4222747310 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481030456 0 0) 0x7f1aec0b2ad0 con 0x7f1aec15d560 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1aeb7fe700 1 -- 172.21.15.82:0/4222747310 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1adc003570 con 0x7f1aec15d560 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af1572700 1 -- 172.21.15.82:0/4222747310 >> v1:172.21.15.134:6789/0 conn(0x7f1aec15d930 legacy=0x7f1aec1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af1572700 1 -- 172.21.15.82:0/4222747310 >> v1:172.21.15.82:6789/0 conn(0x7f1aec15d560 legacy=0x7f1aec0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af1572700 1 -- 172.21.15.82:0/4222747310 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0b2510 con 0x7f1aec0b5600 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.203+0000 7f1af1572700 1 --2- 172.21.15.82:0/4222747310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec0d0030 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009e60 tx=0x7f1ae4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8164db7e064986 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1aeb7fe700 1 -- 172.21.15.82:0/4222747310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400e070 con 0x7f1aec0b5600 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1aeb7fe700 1 -- 172.21.15.82:0/4222747310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae400bb60 con 0x7f1aec0b5600 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1aeb7fe700 1 -- 172.21.15.82:0/4222747310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4012430 con 0x7f1aec0b5600 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1af2fd5700 1 -- 172.21.15.82:0/4222747310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 msgr2=0x7f1aec0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1af2fd5700 1 --2- 172.21.15.82:0/4222747310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec0d0030 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009e60 tx=0x7f1ae4009780 comp rx=0 tx=0).stop 2023-10-06T03:17:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1af2fd5700 1 -- 172.21.15.82:0/4222747310 shutdown_connections 2023-10-06T03:17:07.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1af2fd5700 1 --2- 172.21.15.82:0/4222747310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec0d0030 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1af2fd5700 1 -- 172.21.15.82:0/4222747310 >> 172.21.15.82:0/4222747310 conn(0x7f1aec0d1180 msgr2=0x7f1aec069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:07.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1af2fd5700 1 -- 172.21.15.82:0/4222747310 shutdown_connections 2023-10-06T03:17:07.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.204+0000 7f1af2fd5700 1 -- 172.21.15.82:0/4222747310 wait complete. 2023-10-06T03:17:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.205+0000 7f1af2fd5700 1 Processor -- start 2023-10-06T03:17:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.205+0000 7f1af2fd5700 1 -- start start 2023-10-06T03:17:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af2fd5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec14c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af2fd5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1aec15d560 0x7f1aec159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af2fd5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aec15d930 0x7f1aec16cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af2fd5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec14eae0 con 0x7f1aec0b5600 2023-10-06T03:17:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af2fd5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec14f660 con 0x7f1aec15d930 2023-10-06T03:17:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af2fd5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec16db50 con 0x7f1aec15d560 2023-10-06T03:17:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af0d71700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec14c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af0d71700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec14c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39158/0 (socket says 172.21.15.82:39158) 2023-10-06T03:17:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.206+0000 7f1af0d71700 1 -- 172.21.15.82:0/2233527364 learned_addr learned my addr 172.21.15.82:0/2233527364 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1af0d71700 1 -- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1aec15d560 msgr2=0x7f1aec159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1af0d71700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1aec15d560 0x7f1aec159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1af0d71700 1 -- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aec15d930 msgr2=0x7f1aec16cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1af0d71700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aec15d930 0x7f1aec16cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1af0d71700 1 -- 172.21.15.82:0/2233527364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae4009a20 con 0x7f1aec0b5600 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1af0d71700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec14c760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c820 tx=0x7f1ae0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1ae8ff9700 1 -- 172.21.15.82:0/2233527364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0005b30 con 0x7f1aec0b5600 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1ae8ff9700 1 -- 172.21.15.82:0/2233527364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae0005c90 con 0x7f1aec0b5600 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec14cca0 con 0x7f1aec0b5600 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1ae8ff9700 1 -- 172.21.15.82:0/2233527364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0007300 con 0x7f1aec0b5600 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.207+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec14f010 con 0x7f1aec0b5600 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.208+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec064050 con 0x7f1aec0b5600 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.208+0000 7f1ae8ff9700 1 -- 172.21.15.82:0/2233527364 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ae001b3b0 con 0x7f1aec0b5600 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.208+0000 7f1ae8ff9700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1ad0066f30 0x7f1ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.209+0000 7f1ae8ff9700 1 -- 172.21.15.82:0/2233527364 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ae0083c30 con 0x7f1aec0b5600 2023-10-06T03:17:07.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.209+0000 7f1aebfff700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1ad0066f30 0x7f1ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.209+0000 7f1aebfff700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1ad0066f30 0x7f1ad00693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1aec16cc60 tx=0x7f1ad8007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.213+0000 7f1ae8ff9700 1 -- 172.21.15.82:0/2233527364 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ae0050d40 con 0x7f1aec0b5600 2023-10-06T03:17:07.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.392+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1aec14f7a0 con 0x7f1ad0066f30 2023-10-06T03:17:07.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.402+0000 7f1ae8ff9700 1 -- 172.21.15.82:0/2233527364 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311539 (secure 0 0 0) 0x7f1ad8014410 con 0x7f1ad0066f30 2023-10-06T03:17:07.406 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1ad0066f30 msgr2=0x7f1ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1ad0066f30 0x7f1ad00693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1aec16cc60 tx=0x7f1ad8007b40 comp rx=0 tx=0).stop 2023-10-06T03:17:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 msgr2=0x7f1aec14c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec14c760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c820 tx=0x7f1ae0007e00 comp rx=0 tx=0).stop 2023-10-06T03:17:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 shutdown_connections 2023-10-06T03:17:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aec15d930 0x7f1aec16cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec0b5600 0x7f1aec14c760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1ad0066f30 0x7f1ad00693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 --2- 172.21.15.82:0/2233527364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1aec15d560 0x7f1aec159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 >> 172.21.15.82:0/2233527364 conn(0x7f1aec0d1180 msgr2=0x7f1aec0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 shutdown_connections 2023-10-06T03:17:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.405+0000 7f1af2fd5700 1 -- 172.21.15.82:0/2233527364 wait complete. 2023-10-06T03:17:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:17:07.417 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-06T03:17:07.166397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383348,"kb_used_data":5044,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591372,"statfs":{"total":773094113280,"available":770653564928,"internally_reserved":0,"allocated":5165056,"data_stored":2835391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.807555"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335254+0000","last_change":"2023-10-06T03:17:03.335254+0000","last_active":"2023-10-06T03:17:03.335254+0000","last_peered":"2023-10-06T03:17:03.335254+0000","last_clean":"2023-10-06T03:17:03.335254+0000","last_became_active":"2023-10-06T03:17:03.334948+0000","last_became_peered":"2023-10-06T03:17:03.334948+0000","last_unstale":"2023-10-06T03:17:03.335254+0000","last_undegraded":"2023-10-06T03:17:03.335254+0000","last_fullsized":"2023-10-06T03:17:03.335254+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:52.500181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.343511+0000","last_change":"2023-10-06T03:17:03.343511+0000","last_active":"2023-10-06T03:17:03.343511+0000","last_peered":"2023-10-06T03:17:03.343511+0000","last_clean":"2023-10-06T03:17:03.343511+0000","last_became_active":"2023-10-06T03:17:03.343227+0000","last_became_peered":"2023-10-06T03:17:03.343227+0000","last_unstale":"2023-10-06T03:17:03.343511+0000","last_undegraded":"2023-10-06T03:17:03.343511+0000","last_fullsized":"2023-10-06T03:17:03.343511+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:58.240171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335578+0000","last_change":"2023-10-06T03:17:03.335578+0000","last_active":"2023-10-06T03:17:03.335578+0000","last_peered":"2023-10-06T03:17:03.335578+0000","last_clean":"2023-10-06T03:17:03.335578+0000","last_became_active":"2023-10-06T03:17:03.335330+0000","last_became_peered":"2023-10-06T03:17:03.335330+0000","last_unstale":"2023-10-06T03:17:03.335578+0000","last_undegraded":"2023-10-06T03:17:03.335578+0000","last_fullsized":"2023-10-06T03:17:03.335578+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:52.183164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.345575+0000","last_change":"2023-10-06T03:17:03.345575+0000","last_active":"2023-10-06T03:17:03.345575+0000","last_peered":"2023-10-06T03:17:03.345575+0000","last_clean":"2023-10-06T03:17:03.345575+0000","last_became_active":"2023-10-06T03:17:03.345308+0000","last_became_peered":"2023-10-06T03:17:03.345308+0000","last_unstale":"2023-10-06T03:17:03.345575+0000","last_undegraded":"2023-10-06T03:17:03.345575+0000","last_fullsized":"2023-10-06T03:17:03.345575+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.336598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342116+0000","last_change":"2023-10-06T03:17:03.340062+0000","last_active":"2023-10-06T03:17:03.342116+0000","last_peered":"2023-10-06T03:17:03.342116+0000","last_clean":"2023-10-06T03:17:03.342116+0000","last_became_active":"2023-10-06T03:17:03.339757+0000","last_became_peered":"2023-10-06T03:17:03.339757+0000","last_unstale":"2023-10-06T03:17:03.342116+0000","last_undegraded":"2023-10-06T03:17:03.342116+0000","last_fullsized":"2023-10-06T03:17:03.342116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:22.002578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340342+0000","last_change":"2023-10-06T03:17:03.340342+0000","last_active":"2023-10-06T03:17:03.340342+0000","last_peered":"2023-10-06T03:17:03.340342+0000","last_clean":"2023-10-06T03:17:03.340342+0000","last_became_active":"2023-10-06T03:17:03.340109+0000","last_became_peered":"2023-10-06T03:17:03.340109+0000","last_unstale":"2023-10-06T03:17:03.340342+0000","last_undegraded":"2023-10-06T03:17:03.340342+0000","last_fullsized":"2023-10-06T03:17:03.340342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:37.781651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342110+0000","last_change":"2023-10-06T03:17:03.342110+0000","last_active":"2023-10-06T03:17:03.342110+0000","last_peered":"2023-10-06T03:17:03.342110+0000","last_clean":"2023-10-06T03:17:03.342110+0000","last_became_active":"2023-10-06T03:17:03.341491+0000","last_became_peered":"2023-10-06T03:17:03.341491+0000","last_unstale":"2023-10-06T03:17:03.342110+0000","last_undegraded":"2023-10-06T03:17:03.342110+0000","last_fullsized":"2023-10-06T03:17:03.342110+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.834084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335503+0000","last_change":"2023-10-06T03:17:03.335503+0000","last_active":"2023-10-06T03:17:03.335503+0000","last_peered":"2023-10-06T03:17:03.335503+0000","last_clean":"2023-10-06T03:17:03.335503+0000","last_became_active":"2023-10-06T03:17:03.335227+0000","last_became_peered":"2023-10-06T03:17:03.335227+0000","last_unstale":"2023-10-06T03:17:03.335503+0000","last_undegraded":"2023-10-06T03:17:03.335503+0000","last_fullsized":"2023-10-06T03:17:03.335503+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:49.498726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.336657+0000","last_change":"2023-10-06T03:17:03.336657+0000","last_active":"2023-10-06T03:17:03.336657+0000","last_peered":"2023-10-06T03:17:03.336657+0000","last_clean":"2023-10-06T03:17:03.336657+0000","last_became_active":"2023-10-06T03:17:03.336370+0000","last_became_peered":"2023-10-06T03:17:03.336370+0000","last_unstale":"2023-10-06T03:17:03.336657+0000","last_undegraded":"2023-10-06T03:17:03.336657+0000","last_fullsized":"2023-10-06T03:17:03.336657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:20.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.330548+0000","last_change":"2023-10-06T03:17:03.330548+0000","last_active":"2023-10-06T03:17:03.330548+0000","last_peered":"2023-10-06T03:17:03.330548+0000","last_clean":"2023-10-06T03:17:03.330548+0000","last_became_active":"2023-10-06T03:17:03.330285+0000","last_became_peered":"2023-10-06T03:17:03.330285+0000","last_unstale":"2023-10-06T03:17:03.330548+0000","last_undegraded":"2023-10-06T03:17:03.330548+0000","last_fullsized":"2023-10-06T03:17:03.330548+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:28.764166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344953+0000","last_change":"2023-10-06T03:17:03.339846+0000","last_active":"2023-10-06T03:17:03.344953+0000","last_peered":"2023-10-06T03:17:03.344953+0000","last_clean":"2023-10-06T03:17:03.344953+0000","last_became_active":"2023-10-06T03:17:03.339575+0000","last_became_peered":"2023-10-06T03:17:03.339575+0000","last_unstale":"2023-10-06T03:17:03.344953+0000","last_undegraded":"2023-10-06T03:17:03.344953+0000","last_fullsized":"2023-10-06T03:17:03.344953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:22:23.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338074+0000","last_change":"2023-10-06T03:17:03.338074+0000","last_active":"2023-10-06T03:17:03.338074+0000","last_peered":"2023-10-06T03:17:03.338074+0000","last_clean":"2023-10-06T03:17:03.338074+0000","last_became_active":"2023-10-06T03:17:03.337793+0000","last_became_peered":"2023-10-06T03:17:03.337793+0000","last_unstale":"2023-10-06T03:17:03.338074+0000","last_undegraded":"2023-10-06T03:17:03.338074+0000","last_fullsized":"2023-10-06T03:17:03.338074+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:58.653934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334325+0000","last_change":"2023-10-06T03:17:03.334325+0000","last_active":"2023-10-06T03:17:03.334325+0000","last_peered":"2023-10-06T03:17:03.334325+0000","last_clean":"2023-10-06T03:17:03.334325+0000","last_became_active":"2023-10-06T03:17:03.334091+0000","last_became_peered":"2023-10-06T03:17:03.334091+0000","last_unstale":"2023-10-06T03:17:03.334325+0000","last_undegraded":"2023-10-06T03:17:03.334325+0000","last_fullsized":"2023-10-06T03:17:03.334325+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:55.677587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.341766+0000","last_change":"2023-10-06T03:17:03.341766+0000","last_active":"2023-10-06T03:17:03.341766+0000","last_peered":"2023-10-06T03:17:03.341766+0000","last_clean":"2023-10-06T03:17:03.341766+0000","last_became_active":"2023-10-06T03:17:03.341512+0000","last_became_peered":"2023-10-06T03:17:03.341512+0000","last_unstale":"2023-10-06T03:17:03.341766+0000","last_undegraded":"2023-10-06T03:17:03.341766+0000","last_fullsized":"2023-10-06T03:17:03.341766+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:58.653934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.343487+0000","last_change":"2023-10-06T03:17:03.343487+0000","last_active":"2023-10-06T03:17:03.343487+0000","last_peered":"2023-10-06T03:17:03.343487+0000","last_clean":"2023-10-06T03:17:03.343487+0000","last_became_active":"2023-10-06T03:17:03.343240+0000","last_became_peered":"2023-10-06T03:17:03.343240+0000","last_unstale":"2023-10-06T03:17:03.343487+0000","last_undegraded":"2023-10-06T03:17:03.343487+0000","last_fullsized":"2023-10-06T03:17:03.343487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:05.743325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.331032+0000","last_change":"2023-10-06T03:17:03.331032+0000","last_active":"2023-10-06T03:17:03.331032+0000","last_peered":"2023-10-06T03:17:03.331032+0000","last_clean":"2023-10-06T03:17:03.331032+0000","last_became_active":"2023-10-06T03:17:03.330781+0000","last_became_peered":"2023-10-06T03:17:03.330781+0000","last_unstale":"2023-10-06T03:17:03.331032+0000","last_undegraded":"2023-10-06T03:17:03.331032+0000","last_fullsized":"2023-10-06T03:17:03.331032+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:50.520186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335609+0000","last_change":"2023-10-06T03:17:03.335609+0000","last_active":"2023-10-06T03:17:03.335609+0000","last_peered":"2023-10-06T03:17:03.335609+0000","last_clean":"2023-10-06T03:17:03.335609+0000","last_became_active":"2023-10-06T03:17:03.335005+0000","last_became_peered":"2023-10-06T03:17:03.335005+0000","last_unstale":"2023-10-06T03:17:03.335609+0000","last_undegraded":"2023-10-06T03:17:03.335609+0000","last_fullsized":"2023-10-06T03:17:03.335609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:49.919676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344495+0000","last_change":"2023-10-06T03:17:03.344495+0000","last_active":"2023-10-06T03:17:03.344495+0000","last_peered":"2023-10-06T03:17:03.344495+0000","last_clean":"2023-10-06T03:17:03.344495+0000","last_became_active":"2023-10-06T03:17:03.344282+0000","last_became_peered":"2023-10-06T03:17:03.344282+0000","last_unstale":"2023-10-06T03:17:03.344495+0000","last_undegraded":"2023-10-06T03:17:03.344495+0000","last_fullsized":"2023-10-06T03:17:03.344495+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.544266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338842+0000","last_change":"2023-10-06T03:17:03.338842+0000","last_active":"2023-10-06T03:17:03.338842+0000","last_peered":"2023-10-06T03:17:03.338842+0000","last_clean":"2023-10-06T03:17:03.338842+0000","last_became_active":"2023-10-06T03:17:03.338577+0000","last_became_peered":"2023-10-06T03:17:03.338577+0000","last_unstale":"2023-10-06T03:17:03.338842+0000","last_undegraded":"2023-10-06T03:17:03.338842+0000","last_fullsized":"2023-10-06T03:17:03.338842+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:20.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338116+0000","last_change":"2023-10-06T03:17:03.338116+0000","last_active":"2023-10-06T03:17:03.338116+0000","last_peered":"2023-10-06T03:17:03.338116+0000","last_clean":"2023-10-06T03:17:03.338116+0000","last_became_active":"2023-10-06T03:17:03.337158+0000","last_became_peered":"2023-10-06T03:17:03.337158+0000","last_unstale":"2023-10-06T03:17:03.338116+0000","last_undegraded":"2023-10-06T03:17:03.338116+0000","last_fullsized":"2023-10-06T03:17:03.338116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:47.636248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340594+0000","last_change":"2023-10-06T03:17:03.340594+0000","last_active":"2023-10-06T03:17:03.340594+0000","last_peered":"2023-10-06T03:17:03.340594+0000","last_clean":"2023-10-06T03:17:03.340594+0000","last_became_active":"2023-10-06T03:17:03.340316+0000","last_became_peered":"2023-10-06T03:17:03.340316+0000","last_unstale":"2023-10-06T03:17:03.340594+0000","last_undegraded":"2023-10-06T03:17:03.340594+0000","last_fullsized":"2023-10-06T03:17:03.340594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:35.668723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.339352+0000","last_change":"2023-10-06T03:17:03.339352+0000","last_active":"2023-10-06T03:17:03.339352+0000","last_peered":"2023-10-06T03:17:03.339352+0000","last_clean":"2023-10-06T03:17:03.339352+0000","last_became_active":"2023-10-06T03:17:03.339091+0000","last_became_peered":"2023-10-06T03:17:03.339091+0000","last_unstale":"2023-10-06T03:17:03.339352+0000","last_undegraded":"2023-10-06T03:17:03.339352+0000","last_fullsized":"2023-10-06T03:17:03.339352+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:08.801932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.345282+0000","last_change":"2023-10-06T03:17:03.340601+0000","last_active":"2023-10-06T03:17:03.345282+0000","last_peered":"2023-10-06T03:17:03.345282+0000","last_clean":"2023-10-06T03:17:03.345282+0000","last_became_active":"2023-10-06T03:17:03.340318+0000","last_became_peered":"2023-10-06T03:17:03.340318+0000","last_unstale":"2023-10-06T03:17:03.345282+0000","last_undegraded":"2023-10-06T03:17:03.345282+0000","last_fullsized":"2023-10-06T03:17:03.345282+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:05.865984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334686+0000","last_change":"2023-10-06T03:17:03.334686+0000","last_active":"2023-10-06T03:17:03.334686+0000","last_peered":"2023-10-06T03:17:03.334686+0000","last_clean":"2023-10-06T03:17:03.334686+0000","last_became_active":"2023-10-06T03:17:03.334435+0000","last_became_peered":"2023-10-06T03:17:03.334435+0000","last_unstale":"2023-10-06T03:17:03.334686+0000","last_undegraded":"2023-10-06T03:17:03.334686+0000","last_fullsized":"2023-10-06T03:17:03.334686+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:48.965120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338745+0000","last_change":"2023-10-06T03:17:03.338745+0000","last_active":"2023-10-06T03:17:03.338745+0000","last_peered":"2023-10-06T03:17:03.338745+0000","last_clean":"2023-10-06T03:17:03.338745+0000","last_became_active":"2023-10-06T03:17:03.338491+0000","last_became_peered":"2023-10-06T03:17:03.338491+0000","last_unstale":"2023-10-06T03:17:03.338745+0000","last_undegraded":"2023-10-06T03:17:03.338745+0000","last_fullsized":"2023-10-06T03:17:03.338745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:34.776895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.339832+0000","last_change":"2023-10-06T03:17:03.339832+0000","last_active":"2023-10-06T03:17:03.339832+0000","last_peered":"2023-10-06T03:17:03.339832+0000","last_clean":"2023-10-06T03:17:03.339832+0000","last_became_active":"2023-10-06T03:17:03.339581+0000","last_became_peered":"2023-10-06T03:17:03.339581+0000","last_unstale":"2023-10-06T03:17:03.339832+0000","last_undegraded":"2023-10-06T03:17:03.339832+0000","last_fullsized":"2023-10-06T03:17:03.339832+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:24.919018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.336809+0000","last_change":"2023-10-06T03:17:03.336809+0000","last_active":"2023-10-06T03:17:03.336809+0000","last_peered":"2023-10-06T03:17:03.336809+0000","last_clean":"2023-10-06T03:17:03.336809+0000","last_became_active":"2023-10-06T03:17:03.336563+0000","last_became_peered":"2023-10-06T03:17:03.336563+0000","last_unstale":"2023-10-06T03:17:03.336809+0000","last_undegraded":"2023-10-06T03:17:03.336809+0000","last_fullsized":"2023-10-06T03:17:03.336809+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:35.668723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337538+0000","last_change":"2023-10-06T03:17:03.337538+0000","last_active":"2023-10-06T03:17:03.337538+0000","last_peered":"2023-10-06T03:17:03.337538+0000","last_clean":"2023-10-06T03:17:03.337538+0000","last_became_active":"2023-10-06T03:17:03.336882+0000","last_became_peered":"2023-10-06T03:17:03.336882+0000","last_unstale":"2023-10-06T03:17:03.337538+0000","last_undegraded":"2023-10-06T03:17:03.337538+0000","last_fullsized":"2023-10-06T03:17:03.337538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:52.500181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342665+0000","last_change":"2023-10-06T03:17:03.342665+0000","last_active":"2023-10-06T03:17:03.342665+0000","last_peered":"2023-10-06T03:17:03.342665+0000","last_clean":"2023-10-06T03:17:03.342665+0000","last_became_active":"2023-10-06T03:17:03.342319+0000","last_became_peered":"2023-10-06T03:17:03.342319+0000","last_unstale":"2023-10-06T03:17:03.342665+0000","last_undegraded":"2023-10-06T03:17:03.342665+0000","last_fullsized":"2023-10-06T03:17:03.342665+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:49.498726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344177+0000","last_change":"2023-10-06T03:17:03.344177+0000","last_active":"2023-10-06T03:17:03.344177+0000","last_peered":"2023-10-06T03:17:03.344177+0000","last_clean":"2023-10-06T03:17:03.344177+0000","last_became_active":"2023-10-06T03:17:03.343936+0000","last_became_peered":"2023-10-06T03:17:03.343936+0000","last_unstale":"2023-10-06T03:17:03.344177+0000","last_undegraded":"2023-10-06T03:17:03.344177+0000","last_fullsized":"2023-10-06T03:17:03.344177+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:08.801932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342359+0000","last_change":"2023-10-06T03:17:03.342359+0000","last_active":"2023-10-06T03:17:03.342359+0000","last_peered":"2023-10-06T03:17:03.342359+0000","last_clean":"2023-10-06T03:17:03.342359+0000","last_became_active":"2023-10-06T03:17:03.341818+0000","last_became_peered":"2023-10-06T03:17:03.341818+0000","last_unstale":"2023-10-06T03:17:03.342359+0000","last_undegraded":"2023-10-06T03:17:03.342359+0000","last_fullsized":"2023-10-06T03:17:03.342359+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:34.631979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338152+0000","last_change":"2023-10-06T03:17:03.333994+0000","last_active":"2023-10-06T03:17:03.338152+0000","last_peered":"2023-10-06T03:17:03.338152+0000","last_clean":"2023-10-06T03:17:03.338152+0000","last_became_active":"2023-10-06T03:17:03.333768+0000","last_became_peered":"2023-10-06T03:17:03.333768+0000","last_unstale":"2023-10-06T03:17:03.338152+0000","last_undegraded":"2023-10-06T03:17:03.338152+0000","last_fullsized":"2023-10-06T03:17:03.338152+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.544266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344290+0000","last_change":"2023-10-06T03:17:03.344290+0000","last_active":"2023-10-06T03:17:03.344290+0000","last_peered":"2023-10-06T03:17:03.344290+0000","last_clean":"2023-10-06T03:17:03.344290+0000","last_became_active":"2023-10-06T03:17:03.342562+0000","last_became_peered":"2023-10-06T03:17:03.342562+0000","last_unstale":"2023-10-06T03:17:03.344290+0000","last_undegraded":"2023-10-06T03:17:03.344290+0000","last_fullsized":"2023-10-06T03:17:03.344290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:28.251742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"42'4","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.378534+0000","last_change":"2023-10-06T03:17:02.379393+0000","last_active":"2023-10-06T03:17:03.378534+0000","last_peered":"2023-10-06T03:17:03.378534+0000","last_clean":"2023-10-06T03:17:03.378534+0000","last_became_active":"2023-10-06T03:17:02.379045+0000","last_became_peered":"2023-10-06T03:17:02.379045+0000","last_unstale":"2023-10-06T03:17:03.378534+0000","last_undegraded":"2023-10-06T03:17:03.378534+0000","last_fullsized":"2023-10-06T03:17:03.378534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:54.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344205+0000","last_change":"2023-10-06T03:17:03.343224+0000","last_active":"2023-10-06T03:17:03.344205+0000","last_peered":"2023-10-06T03:17:03.344205+0000","last_clean":"2023-10-06T03:17:03.344205+0000","last_became_active":"2023-10-06T03:17:03.342669+0000","last_became_peered":"2023-10-06T03:17:03.342669+0000","last_unstale":"2023-10-06T03:17:03.344205+0000","last_undegraded":"2023-10-06T03:17:03.344205+0000","last_fullsized":"2023-10-06T03:17:03.344205+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:22.002578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.323929+0000","last_change":"2023-10-06T03:17:02.389197+0000","last_active":"2023-10-06T03:17:03.323929+0000","last_peered":"2023-10-06T03:17:03.323929+0000","last_clean":"2023-10-06T03:17:03.323929+0000","last_became_active":"2023-10-06T03:17:02.388952+0000","last_became_peered":"2023-10-06T03:17:02.388952+0000","last_unstale":"2023-10-06T03:17:03.323929+0000","last_undegraded":"2023-10-06T03:17:03.323929+0000","last_fullsized":"2023-10-06T03:17:03.323929+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:23.044475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340690+0000","last_change":"2023-10-06T03:17:03.340690+0000","last_active":"2023-10-06T03:17:03.340690+0000","last_peered":"2023-10-06T03:17:03.340690+0000","last_clean":"2023-10-06T03:17:03.340690+0000","last_became_active":"2023-10-06T03:17:03.340433+0000","last_became_peered":"2023-10-06T03:17:03.340433+0000","last_unstale":"2023-10-06T03:17:03.340690+0000","last_undegraded":"2023-10-06T03:17:03.340690+0000","last_fullsized":"2023-10-06T03:17:03.340690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:24.582718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.377806+0000","last_change":"2023-10-06T03:17:02.389806+0000","last_active":"2023-10-06T03:17:03.377806+0000","last_peered":"2023-10-06T03:17:03.377806+0000","last_clean":"2023-10-06T03:17:03.377806+0000","last_became_active":"2023-10-06T03:17:02.389555+0000","last_became_peered":"2023-10-06T03:17:02.389555+0000","last_unstale":"2023-10-06T03:17:03.377806+0000","last_undegraded":"2023-10-06T03:17:03.377806+0000","last_fullsized":"2023-10-06T03:17:03.377806+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:00.291744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334215+0000","last_change":"2023-10-06T03:17:03.334215+0000","last_active":"2023-10-06T03:17:03.334215+0000","last_peered":"2023-10-06T03:17:03.334215+0000","last_clean":"2023-10-06T03:17:03.334215+0000","last_became_active":"2023-10-06T03:17:03.333818+0000","last_became_peered":"2023-10-06T03:17:03.333818+0000","last_unstale":"2023-10-06T03:17:03.334215+0000","last_undegraded":"2023-10-06T03:17:03.334215+0000","last_fullsized":"2023-10-06T03:17:03.334215+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:52.183164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.382729+0000","last_change":"2023-10-06T03:17:02.389261+0000","last_active":"2023-10-06T03:17:03.382729+0000","last_peered":"2023-10-06T03:17:03.382729+0000","last_clean":"2023-10-06T03:17:03.382729+0000","last_became_active":"2023-10-06T03:17:02.389000+0000","last_became_peered":"2023-10-06T03:17:02.389000+0000","last_unstale":"2023-10-06T03:17:03.382729+0000","last_undegraded":"2023-10-06T03:17:03.382729+0000","last_fullsized":"2023-10-06T03:17:03.382729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:36.776340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.341276+0000","last_change":"2023-10-06T03:17:03.336855+0000","last_active":"2023-10-06T03:17:03.341276+0000","last_peered":"2023-10-06T03:17:03.341276+0000","last_clean":"2023-10-06T03:17:03.341276+0000","last_became_active":"2023-10-06T03:17:03.336591+0000","last_became_peered":"2023-10-06T03:17:03.336591+0000","last_unstale":"2023-10-06T03:17:03.341276+0000","last_undegraded":"2023-10-06T03:17:03.341276+0000","last_fullsized":"2023-10-06T03:17:03.341276+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.544266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.327824+0000","last_change":"2023-10-06T03:17:02.382965+0000","last_active":"2023-10-06T03:17:03.327824+0000","last_peered":"2023-10-06T03:17:03.327824+0000","last_clean":"2023-10-06T03:17:03.327824+0000","last_became_active":"2023-10-06T03:17:02.382586+0000","last_became_peered":"2023-10-06T03:17:02.382586+0000","last_unstale":"2023-10-06T03:17:03.327824+0000","last_undegraded":"2023-10-06T03:17:03.327824+0000","last_fullsized":"2023-10-06T03:17:03.327824+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:36.776340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344130+0000","last_change":"2023-10-06T03:17:03.344130+0000","last_active":"2023-10-06T03:17:03.344130+0000","last_peered":"2023-10-06T03:17:03.344130+0000","last_clean":"2023-10-06T03:17:03.344130+0000","last_became_active":"2023-10-06T03:17:03.343561+0000","last_became_peered":"2023-10-06T03:17:03.343561+0000","last_unstale":"2023-10-06T03:17:03.344130+0000","last_undegraded":"2023-10-06T03:17:03.344130+0000","last_fullsized":"2023-10-06T03:17:03.344130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:13.392326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.380936+0000","last_change":"2023-10-06T03:17:02.380758+0000","last_active":"2023-10-06T03:17:03.380936+0000","last_peered":"2023-10-06T03:17:03.380936+0000","last_clean":"2023-10-06T03:17:03.380936+0000","last_became_active":"2023-10-06T03:17:02.380526+0000","last_became_peered":"2023-10-06T03:17:02.380526+0000","last_unstale":"2023-10-06T03:17:03.380936+0000","last_undegraded":"2023-10-06T03:17:03.380936+0000","last_fullsized":"2023-10-06T03:17:03.380936+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:47.959809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.332742+0000","last_change":"2023-10-06T03:17:03.332742+0000","last_active":"2023-10-06T03:17:03.332742+0000","last_peered":"2023-10-06T03:17:03.332742+0000","last_clean":"2023-10-06T03:17:03.332742+0000","last_became_active":"2023-10-06T03:17:03.332486+0000","last_became_peered":"2023-10-06T03:17:03.332486+0000","last_unstale":"2023-10-06T03:17:03.332742+0000","last_undegraded":"2023-10-06T03:17:03.332742+0000","last_fullsized":"2023-10-06T03:17:03.332742+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:34.776895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.381748+0000","last_change":"2023-10-06T03:17:02.380047+0000","last_active":"2023-10-06T03:17:02.381748+0000","last_peered":"2023-10-06T03:17:02.381748+0000","last_clean":"2023-10-06T03:17:02.381748+0000","last_became_active":"2023-10-06T03:17:02.379803+0000","last_became_peered":"2023-10-06T03:17:02.379803+0000","last_unstale":"2023-10-06T03:17:02.381748+0000","last_undegraded":"2023-10-06T03:17:02.381748+0000","last_fullsized":"2023-10-06T03:17:02.381748+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:49.784369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.343971+0000","last_change":"2023-10-06T03:17:03.343971+0000","last_active":"2023-10-06T03:17:03.343971+0000","last_peered":"2023-10-06T03:17:03.343971+0000","last_clean":"2023-10-06T03:17:03.343971+0000","last_became_active":"2023-10-06T03:17:03.343697+0000","last_became_peered":"2023-10-06T03:17:03.343697+0000","last_unstale":"2023-10-06T03:17:03.343971+0000","last_undegraded":"2023-10-06T03:17:03.343971+0000","last_fullsized":"2023-10-06T03:17:03.343971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:20.276035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.387178+0000","last_change":"2023-10-06T03:17:02.380440+0000","last_active":"2023-10-06T03:17:02.387178+0000","last_peered":"2023-10-06T03:17:02.387178+0000","last_clean":"2023-10-06T03:17:02.387178+0000","last_became_active":"2023-10-06T03:17:02.380204+0000","last_became_peered":"2023-10-06T03:17:02.380204+0000","last_unstale":"2023-10-06T03:17:02.387178+0000","last_undegraded":"2023-10-06T03:17:02.387178+0000","last_fullsized":"2023-10-06T03:17:02.387178+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:46.630937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337785+0000","last_change":"2023-10-06T03:17:03.332561+0000","last_active":"2023-10-06T03:17:03.337785+0000","last_peered":"2023-10-06T03:17:03.337785+0000","last_clean":"2023-10-06T03:17:03.337785+0000","last_became_active":"2023-10-06T03:17:03.332293+0000","last_became_peered":"2023-10-06T03:17:03.332293+0000","last_unstale":"2023-10-06T03:17:03.337785+0000","last_undegraded":"2023-10-06T03:17:03.337785+0000","last_fullsized":"2023-10-06T03:17:03.337785+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:58.240171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.383978+0000","last_change":"2023-10-06T03:17:02.380584+0000","last_active":"2023-10-06T03:17:02.383978+0000","last_peered":"2023-10-06T03:17:02.383978+0000","last_clean":"2023-10-06T03:17:02.383978+0000","last_became_active":"2023-10-06T03:17:02.380252+0000","last_became_peered":"2023-10-06T03:17:02.380252+0000","last_unstale":"2023-10-06T03:17:02.383978+0000","last_undegraded":"2023-10-06T03:17:02.383978+0000","last_fullsized":"2023-10-06T03:17:02.383978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:12.758816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337858+0000","last_change":"2023-10-06T03:17:03.333768+0000","last_active":"2023-10-06T03:17:03.337858+0000","last_peered":"2023-10-06T03:17:03.337858+0000","last_clean":"2023-10-06T03:17:03.337858+0000","last_became_active":"2023-10-06T03:17:03.333020+0000","last_became_peered":"2023-10-06T03:17:03.333020+0000","last_unstale":"2023-10-06T03:17:03.337858+0000","last_undegraded":"2023-10-06T03:17:03.337858+0000","last_fullsized":"2023-10-06T03:17:03.337858+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:33.570976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328859+0000","last_change":"2023-10-06T03:17:02.386399+0000","last_active":"2023-10-06T03:17:03.328859+0000","last_peered":"2023-10-06T03:17:03.328859+0000","last_clean":"2023-10-06T03:17:03.328859+0000","last_became_active":"2023-10-06T03:17:02.386074+0000","last_became_peered":"2023-10-06T03:17:02.386074+0000","last_unstale":"2023-10-06T03:17:03.328859+0000","last_undegraded":"2023-10-06T03:17:03.328859+0000","last_fullsized":"2023-10-06T03:17:03.328859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:35.591643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342825+0000","last_change":"2023-10-06T03:17:03.342825+0000","last_active":"2023-10-06T03:17:03.342825+0000","last_peered":"2023-10-06T03:17:03.342825+0000","last_clean":"2023-10-06T03:17:03.342825+0000","last_became_active":"2023-10-06T03:17:03.342273+0000","last_became_peered":"2023-10-06T03:17:03.342273+0000","last_unstale":"2023-10-06T03:17:03.342825+0000","last_undegraded":"2023-10-06T03:17:03.342825+0000","last_fullsized":"2023-10-06T03:17:03.342825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:24.919018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"42'3","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.383028+0000","last_change":"2023-10-06T03:17:02.388005+0000","last_active":"2023-10-06T03:17:03.383028+0000","last_peered":"2023-10-06T03:17:03.383028+0000","last_clean":"2023-10-06T03:17:03.383028+0000","last_became_active":"2023-10-06T03:17:02.387811+0000","last_became_peered":"2023-10-06T03:17:02.387811+0000","last_unstale":"2023-10-06T03:17:03.383028+0000","last_undegraded":"2023-10-06T03:17:03.383028+0000","last_fullsized":"2023-10-06T03:17:03.383028+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:35.591643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335298+0000","last_change":"2023-10-06T03:17:03.331340+0000","last_active":"2023-10-06T03:17:03.335298+0000","last_peered":"2023-10-06T03:17:03.335298+0000","last_clean":"2023-10-06T03:17:03.335298+0000","last_became_active":"2023-10-06T03:17:03.331129+0000","last_became_peered":"2023-10-06T03:17:03.331129+0000","last_unstale":"2023-10-06T03:17:03.335298+0000","last_undegraded":"2023-10-06T03:17:03.335298+0000","last_fullsized":"2023-10-06T03:17:03.335298+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.834084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"42'6","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.384833+0000","last_change":"2023-10-06T03:17:02.389103+0000","last_active":"2023-10-06T03:17:03.384833+0000","last_peered":"2023-10-06T03:17:03.384833+0000","last_clean":"2023-10-06T03:17:03.384833+0000","last_became_active":"2023-10-06T03:17:02.388790+0000","last_became_peered":"2023-10-06T03:17:02.388790+0000","last_unstale":"2023-10-06T03:17:03.384833+0000","last_undegraded":"2023-10-06T03:17:03.384833+0000","last_fullsized":"2023-10-06T03:17:03.384833+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:35.591643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340123+0000","last_change":"2023-10-06T03:17:03.336893+0000","last_active":"2023-10-06T03:17:03.340123+0000","last_peered":"2023-10-06T03:17:03.340123+0000","last_clean":"2023-10-06T03:17:03.340123+0000","last_became_active":"2023-10-06T03:17:03.336624+0000","last_became_peered":"2023-10-06T03:17:03.336624+0000","last_unstale":"2023-10-06T03:17:03.340123+0000","last_undegraded":"2023-10-06T03:17:03.340123+0000","last_fullsized":"2023-10-06T03:17:03.340123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.834084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.379609+0000","last_change":"2023-10-06T03:17:02.381134+0000","last_active":"2023-10-06T03:17:03.379609+0000","last_peered":"2023-10-06T03:17:03.379609+0000","last_clean":"2023-10-06T03:17:03.379609+0000","last_became_active":"2023-10-06T03:17:02.380858+0000","last_became_peered":"2023-10-06T03:17:02.380858+0000","last_unstale":"2023-10-06T03:17:03.379609+0000","last_undegraded":"2023-10-06T03:17:03.379609+0000","last_fullsized":"2023-10-06T03:17:03.379609+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:51.494869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338051+0000","last_change":"2023-10-06T03:17:03.338051+0000","last_active":"2023-10-06T03:17:03.338051+0000","last_peered":"2023-10-06T03:17:03.338051+0000","last_clean":"2023-10-06T03:17:03.338051+0000","last_became_active":"2023-10-06T03:17:03.337841+0000","last_became_peered":"2023-10-06T03:17:03.337841+0000","last_unstale":"2023-10-06T03:17:03.338051+0000","last_undegraded":"2023-10-06T03:17:03.338051+0000","last_fullsized":"2023-10-06T03:17:03.338051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:50.267717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.389171+0000","last_change":"2023-10-06T03:17:02.386920+0000","last_active":"2023-10-06T03:17:02.389171+0000","last_peered":"2023-10-06T03:17:02.389171+0000","last_clean":"2023-10-06T03:17:02.389171+0000","last_became_active":"2023-10-06T03:17:02.386635+0000","last_became_peered":"2023-10-06T03:17:02.386635+0000","last_unstale":"2023-10-06T03:17:02.389171+0000","last_undegraded":"2023-10-06T03:17:02.389171+0000","last_fullsized":"2023-10-06T03:17:02.389171+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:27.758855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.341933+0000","last_change":"2023-10-06T03:17:03.341933+0000","last_active":"2023-10-06T03:17:03.341933+0000","last_peered":"2023-10-06T03:17:03.341933+0000","last_clean":"2023-10-06T03:17:03.341933+0000","last_became_active":"2023-10-06T03:17:03.341677+0000","last_became_peered":"2023-10-06T03:17:03.341677+0000","last_unstale":"2023-10-06T03:17:03.341933+0000","last_undegraded":"2023-10-06T03:17:03.341933+0000","last_fullsized":"2023-10-06T03:17:03.341933+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:49.919676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.381360+0000","last_change":"2023-10-06T03:17:02.379740+0000","last_active":"2023-10-06T03:17:02.381360+0000","last_peered":"2023-10-06T03:17:02.381360+0000","last_clean":"2023-10-06T03:17:02.381360+0000","last_became_active":"2023-10-06T03:17:02.379463+0000","last_became_peered":"2023-10-06T03:17:02.379463+0000","last_unstale":"2023-10-06T03:17:02.381360+0000","last_undegraded":"2023-10-06T03:17:02.381360+0000","last_fullsized":"2023-10-06T03:17:02.381360+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:52.731116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335847+0000","last_change":"2023-10-06T03:17:03.335847+0000","last_active":"2023-10-06T03:17:03.335847+0000","last_peered":"2023-10-06T03:17:03.335847+0000","last_clean":"2023-10-06T03:17:03.335847+0000","last_became_active":"2023-10-06T03:17:03.335353+0000","last_became_peered":"2023-10-06T03:17:03.335353+0000","last_unstale":"2023-10-06T03:17:03.335847+0000","last_undegraded":"2023-10-06T03:17:03.335847+0000","last_fullsized":"2023-10-06T03:17:03.335847+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:23.230341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"42'8","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.383038+0000","last_change":"2023-10-06T03:17:02.381906+0000","last_active":"2023-10-06T03:17:03.383038+0000","last_peered":"2023-10-06T03:17:03.383038+0000","last_clean":"2023-10-06T03:17:03.383038+0000","last_became_active":"2023-10-06T03:17:02.381685+0000","last_became_peered":"2023-10-06T03:17:02.381685+0000","last_unstale":"2023-10-06T03:17:03.383038+0000","last_undegraded":"2023-10-06T03:17:03.383038+0000","last_fullsized":"2023-10-06T03:17:03.383038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:33.626668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340565+0000","last_change":"2023-10-06T03:17:03.340565+0000","last_active":"2023-10-06T03:17:03.340565+0000","last_peered":"2023-10-06T03:17:03.340565+0000","last_clean":"2023-10-06T03:17:03.340565+0000","last_became_active":"2023-10-06T03:17:03.339209+0000","last_became_peered":"2023-10-06T03:17:03.339209+0000","last_unstale":"2023-10-06T03:17:03.340565+0000","last_undegraded":"2023-10-06T03:17:03.340565+0000","last_fullsized":"2023-10-06T03:17:03.340565+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:29.958504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328075+0000","last_change":"2023-10-06T03:17:02.385583+0000","last_active":"2023-10-06T03:17:03.328075+0000","last_peered":"2023-10-06T03:17:03.328075+0000","last_clean":"2023-10-06T03:17:03.328075+0000","last_became_active":"2023-10-06T03:17:02.385335+0000","last_became_peered":"2023-10-06T03:17:02.385335+0000","last_unstale":"2023-10-06T03:17:03.328075+0000","last_undegraded":"2023-10-06T03:17:03.328075+0000","last_fullsized":"2023-10-06T03:17:03.328075+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:34.663412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338196+0000","last_change":"2023-10-06T03:17:03.338196+0000","last_active":"2023-10-06T03:17:03.338196+0000","last_peered":"2023-10-06T03:17:03.338196+0000","last_clean":"2023-10-06T03:17:03.338196+0000","last_became_active":"2023-10-06T03:17:03.337957+0000","last_became_peered":"2023-10-06T03:17:03.337957+0000","last_unstale":"2023-10-06T03:17:03.338196+0000","last_undegraded":"2023-10-06T03:17:03.338196+0000","last_fullsized":"2023-10-06T03:17:03.338196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.475823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.381112+0000","last_change":"2023-10-06T03:17:02.380378+0000","last_active":"2023-10-06T03:17:03.381112+0000","last_peered":"2023-10-06T03:17:03.381112+0000","last_clean":"2023-10-06T03:17:03.381112+0000","last_became_active":"2023-10-06T03:17:02.380134+0000","last_became_peered":"2023-10-06T03:17:02.380134+0000","last_unstale":"2023-10-06T03:17:03.381112+0000","last_undegraded":"2023-10-06T03:17:03.381112+0000","last_fullsized":"2023-10-06T03:17:03.381112+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:30.506456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.341455+0000","last_change":"2023-10-06T03:17:03.339279+0000","last_active":"2023-10-06T03:17:03.341455+0000","last_peered":"2023-10-06T03:17:03.341455+0000","last_clean":"2023-10-06T03:17:03.341455+0000","last_became_active":"2023-10-06T03:17:03.338870+0000","last_became_peered":"2023-10-06T03:17:03.338870+0000","last_unstale":"2023-10-06T03:17:03.341455+0000","last_undegraded":"2023-10-06T03:17:03.341455+0000","last_fullsized":"2023-10-06T03:17:03.341455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:28.251742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328937+0000","last_change":"2023-10-06T03:17:02.385865+0000","last_active":"2023-10-06T03:17:03.328937+0000","last_peered":"2023-10-06T03:17:03.328937+0000","last_clean":"2023-10-06T03:17:03.328937+0000","last_became_active":"2023-10-06T03:17:02.385653+0000","last_became_peered":"2023-10-06T03:17:02.385653+0000","last_unstale":"2023-10-06T03:17:03.328937+0000","last_undegraded":"2023-10-06T03:17:03.328937+0000","last_fullsized":"2023-10-06T03:17:03.328937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:47.829218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334826+0000","last_change":"2023-10-06T03:17:03.334826+0000","last_active":"2023-10-06T03:17:03.334826+0000","last_peered":"2023-10-06T03:17:03.334826+0000","last_clean":"2023-10-06T03:17:03.334826+0000","last_became_active":"2023-10-06T03:17:03.334587+0000","last_became_peered":"2023-10-06T03:17:03.334587+0000","last_unstale":"2023-10-06T03:17:03.334826+0000","last_undegraded":"2023-10-06T03:17:03.334826+0000","last_fullsized":"2023-10-06T03:17:03.334826+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:57.951351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.386495+0000","last_change":"2023-10-06T03:17:02.382720+0000","last_active":"2023-10-06T03:17:02.386495+0000","last_peered":"2023-10-06T03:17:02.386495+0000","last_clean":"2023-10-06T03:17:02.386495+0000","last_became_active":"2023-10-06T03:17:02.382454+0000","last_became_peered":"2023-10-06T03:17:02.382454+0000","last_unstale":"2023-10-06T03:17:02.386495+0000","last_undegraded":"2023-10-06T03:17:02.386495+0000","last_fullsized":"2023-10-06T03:17:02.386495+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:00.291744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335132+0000","last_change":"2023-10-06T03:17:03.333237+0000","last_active":"2023-10-06T03:17:03.335132+0000","last_peered":"2023-10-06T03:17:03.335132+0000","last_clean":"2023-10-06T03:17:03.335132+0000","last_became_active":"2023-10-06T03:17:03.332968+0000","last_became_peered":"2023-10-06T03:17:03.332968+0000","last_unstale":"2023-10-06T03:17:03.335132+0000","last_undegraded":"2023-10-06T03:17:03.335132+0000","last_fullsized":"2023-10-06T03:17:03.335132+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:44.765153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.381177+0000","last_change":"2023-10-06T03:17:02.380310+0000","last_active":"2023-10-06T03:17:03.381177+0000","last_peered":"2023-10-06T03:17:03.381177+0000","last_clean":"2023-10-06T03:17:03.381177+0000","last_became_active":"2023-10-06T03:17:02.380074+0000","last_became_peered":"2023-10-06T03:17:02.380074+0000","last_unstale":"2023-10-06T03:17:03.381177+0000","last_undegraded":"2023-10-06T03:17:03.381177+0000","last_fullsized":"2023-10-06T03:17:03.381177+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:01.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335914+0000","last_change":"2023-10-06T03:17:03.335914+0000","last_active":"2023-10-06T03:17:03.335914+0000","last_peered":"2023-10-06T03:17:03.335914+0000","last_clean":"2023-10-06T03:17:03.335914+0000","last_became_active":"2023-10-06T03:17:03.335675+0000","last_became_peered":"2023-10-06T03:17:03.335675+0000","last_unstale":"2023-10-06T03:17:03.335914+0000","last_undegraded":"2023-10-06T03:17:03.335914+0000","last_fullsized":"2023-10-06T03:17:03.335914+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.475823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388560+0000","last_change":"2023-10-06T03:17:02.381337+0000","last_active":"2023-10-06T03:17:02.388560+0000","last_peered":"2023-10-06T03:17:02.388560+0000","last_clean":"2023-10-06T03:17:02.388560+0000","last_became_active":"2023-10-06T03:17:02.381131+0000","last_became_peered":"2023-10-06T03:17:02.381131+0000","last_unstale":"2023-10-06T03:17:02.388560+0000","last_undegraded":"2023-10-06T03:17:02.388560+0000","last_fullsized":"2023-10-06T03:17:02.388560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:47.959809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342795+0000","last_change":"2023-10-06T03:17:03.342795+0000","last_active":"2023-10-06T03:17:03.342795+0000","last_peered":"2023-10-06T03:17:03.342795+0000","last_clean":"2023-10-06T03:17:03.342795+0000","last_became_active":"2023-10-06T03:17:03.342531+0000","last_became_peered":"2023-10-06T03:17:03.342531+0000","last_unstale":"2023-10-06T03:17:03.342795+0000","last_undegraded":"2023-10-06T03:17:03.342795+0000","last_fullsized":"2023-10-06T03:17:03.342795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:29.958504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388211+0000","last_change":"2023-10-06T03:17:02.382985+0000","last_active":"2023-10-06T03:17:02.388211+0000","last_peered":"2023-10-06T03:17:02.388211+0000","last_clean":"2023-10-06T03:17:02.388211+0000","last_became_active":"2023-10-06T03:17:02.382731+0000","last_became_peered":"2023-10-06T03:17:02.382731+0000","last_unstale":"2023-10-06T03:17:02.388211+0000","last_undegraded":"2023-10-06T03:17:02.388211+0000","last_fullsized":"2023-10-06T03:17:02.388211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.577407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337513+0000","last_change":"2023-10-06T03:17:03.337513+0000","last_active":"2023-10-06T03:17:03.337513+0000","last_peered":"2023-10-06T03:17:03.337513+0000","last_clean":"2023-10-06T03:17:03.337513+0000","last_became_active":"2023-10-06T03:17:03.337248+0000","last_became_peered":"2023-10-06T03:17:03.337248+0000","last_unstale":"2023-10-06T03:17:03.337513+0000","last_undegraded":"2023-10-06T03:17:03.337513+0000","last_fullsized":"2023-10-06T03:17:03.337513+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:11.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.326999+0000","last_change":"2023-10-06T03:17:02.380597+0000","last_active":"2023-10-06T03:17:03.326999+0000","last_peered":"2023-10-06T03:17:03.326999+0000","last_clean":"2023-10-06T03:17:03.326999+0000","last_became_active":"2023-10-06T03:17:02.379563+0000","last_became_peered":"2023-10-06T03:17:02.379563+0000","last_unstale":"2023-10-06T03:17:03.326999+0000","last_undegraded":"2023-10-06T03:17:03.326999+0000","last_fullsized":"2023-10-06T03:17:03.326999+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:36.559344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337895+0000","last_change":"2023-10-06T03:17:03.337895+0000","last_active":"2023-10-06T03:17:03.337895+0000","last_peered":"2023-10-06T03:17:03.337895+0000","last_clean":"2023-10-06T03:17:03.337895+0000","last_became_active":"2023-10-06T03:17:03.337370+0000","last_became_peered":"2023-10-06T03:17:03.337370+0000","last_unstale":"2023-10-06T03:17:03.337895+0000","last_undegraded":"2023-10-06T03:17:03.337895+0000","last_fullsized":"2023-10-06T03:17:03.337895+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:58.240171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.394460+0000","last_change":"2023-10-06T03:17:02.383913+0000","last_active":"2023-10-06T03:17:02.394460+0000","last_peered":"2023-10-06T03:17:02.394460+0000","last_clean":"2023-10-06T03:17:02.394460+0000","last_became_active":"2023-10-06T03:17:02.383673+0000","last_became_peered":"2023-10-06T03:17:02.383673+0000","last_unstale":"2023-10-06T03:17:02.394460+0000","last_undegraded":"2023-10-06T03:17:02.394460+0000","last_fullsized":"2023-10-06T03:17:02.394460+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:57.283371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328676+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:17:03.328676+0000","last_peered":"2023-10-06T03:17:03.328676+0000","last_clean":"2023-10-06T03:17:03.328676+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:03.328676+0000","last_undegraded":"2023-10-06T03:17:03.328676+0000","last_fullsized":"2023-10-06T03:17:03.328676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342052+0000","last_change":"2023-10-06T03:17:03.340382+0000","last_active":"2023-10-06T03:17:03.342052+0000","last_peered":"2023-10-06T03:17:03.342052+0000","last_clean":"2023-10-06T03:17:03.342052+0000","last_became_active":"2023-10-06T03:17:03.340126+0000","last_became_peered":"2023-10-06T03:17:03.340126+0000","last_unstale":"2023-10-06T03:17:03.342052+0000","last_undegraded":"2023-10-06T03:17:03.342052+0000","last_fullsized":"2023-10-06T03:17:03.342052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:34.932214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388719+0000","last_change":"2023-10-06T03:17:02.384377+0000","last_active":"2023-10-06T03:17:02.388719+0000","last_peered":"2023-10-06T03:17:02.388719+0000","last_clean":"2023-10-06T03:17:02.388719+0000","last_became_active":"2023-10-06T03:17:02.384138+0000","last_became_peered":"2023-10-06T03:17:02.384138+0000","last_unstale":"2023-10-06T03:17:02.388719+0000","last_undegraded":"2023-10-06T03:17:02.388719+0000","last_fullsized":"2023-10-06T03:17:02.388719+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:12.758816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.379895+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:17:02.379895+0000","last_peered":"2023-10-06T03:17:02.379895+0000","last_clean":"2023-10-06T03:17:02.379895+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:02.379895+0000","last_undegraded":"2023-10-06T03:17:02.379895+0000","last_fullsized":"2023-10-06T03:17:02.379895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.331928+0000","last_change":"2023-10-06T03:17:03.331928+0000","last_active":"2023-10-06T03:17:03.331928+0000","last_peered":"2023-10-06T03:17:03.331928+0000","last_clean":"2023-10-06T03:17:03.331928+0000","last_became_active":"2023-10-06T03:17:03.331682+0000","last_became_peered":"2023-10-06T03:17:03.331682+0000","last_unstale":"2023-10-06T03:17:03.331928+0000","last_undegraded":"2023-10-06T03:17:03.331928+0000","last_fullsized":"2023-10-06T03:17:03.331928+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:24.582718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388923+0000","last_change":"2023-10-06T03:17:02.382295+0000","last_active":"2023-10-06T03:17:02.388923+0000","last_peered":"2023-10-06T03:17:02.388923+0000","last_clean":"2023-10-06T03:17:02.388923+0000","last_became_active":"2023-10-06T03:17:02.382010+0000","last_became_peered":"2023-10-06T03:17:02.382010+0000","last_unstale":"2023-10-06T03:17:02.388923+0000","last_undegraded":"2023-10-06T03:17:02.388923+0000","last_fullsized":"2023-10-06T03:17:02.388923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:44.451863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.385777+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:17:02.385777+0000","last_peered":"2023-10-06T03:17:02.385777+0000","last_clean":"2023-10-06T03:17:02.385777+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:02.385777+0000","last_undegraded":"2023-10-06T03:17:02.385777+0000","last_fullsized":"2023-10-06T03:17:02.385777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.371321+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:17:02.371321+0000","last_peered":"2023-10-06T03:17:02.371321+0000","last_clean":"2023-10-06T03:17:02.371321+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:17:02.371321+0000","last_undegraded":"2023-10-06T03:17:02.371321+0000","last_fullsized":"2023-10-06T03:17:02.371321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334060+0000","last_change":"2023-10-06T03:17:03.334060+0000","last_active":"2023-10-06T03:17:03.334060+0000","last_peered":"2023-10-06T03:17:03.334060+0000","last_clean":"2023-10-06T03:17:03.334060+0000","last_became_active":"2023-10-06T03:17:03.333513+0000","last_became_peered":"2023-10-06T03:17:03.333513+0000","last_unstale":"2023-10-06T03:17:03.334060+0000","last_undegraded":"2023-10-06T03:17:03.334060+0000","last_fullsized":"2023-10-06T03:17:03.334060+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.834084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388072+0000","last_change":"2023-10-06T03:17:02.382216+0000","last_active":"2023-10-06T03:17:02.388072+0000","last_peered":"2023-10-06T03:17:02.388072+0000","last_clean":"2023-10-06T03:17:02.388072+0000","last_became_active":"2023-10-06T03:17:02.381944+0000","last_became_peered":"2023-10-06T03:17:02.381944+0000","last_unstale":"2023-10-06T03:17:02.388072+0000","last_undegraded":"2023-10-06T03:17:02.388072+0000","last_fullsized":"2023-10-06T03:17:02.388072+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:52.731116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.371644+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:17:02.371644+0000","last_peered":"2023-10-06T03:17:02.371644+0000","last_clean":"2023-10-06T03:17:02.371644+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:02.371644+0000","last_undegraded":"2023-10-06T03:17:02.371644+0000","last_fullsized":"2023-10-06T03:17:02.371644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338003+0000","last_change":"2023-10-06T03:17:03.338003+0000","last_active":"2023-10-06T03:17:03.338003+0000","last_peered":"2023-10-06T03:17:03.338003+0000","last_clean":"2023-10-06T03:17:03.338003+0000","last_became_active":"2023-10-06T03:17:03.335333+0000","last_became_peered":"2023-10-06T03:17:03.335333+0000","last_unstale":"2023-10-06T03:17:03.338003+0000","last_undegraded":"2023-10-06T03:17:03.338003+0000","last_fullsized":"2023-10-06T03:17:03.338003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:11.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388244+0000","last_change":"2023-10-06T03:17:02.384639+0000","last_active":"2023-10-06T03:17:02.388244+0000","last_peered":"2023-10-06T03:17:02.388244+0000","last_clean":"2023-10-06T03:17:02.388244+0000","last_became_active":"2023-10-06T03:17:02.384395+0000","last_became_peered":"2023-10-06T03:17:02.384395+0000","last_unstale":"2023-10-06T03:17:02.388244+0000","last_undegraded":"2023-10-06T03:17:02.388244+0000","last_fullsized":"2023-10-06T03:17:02.388244+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:26.701467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.371227+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:17:02.371227+0000","last_peered":"2023-10-06T03:17:02.371227+0000","last_clean":"2023-10-06T03:17:02.371227+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:02.371227+0000","last_undegraded":"2023-10-06T03:17:02.371227+0000","last_fullsized":"2023-10-06T03:17:02.371227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338171+0000","last_change":"2023-10-06T03:17:03.333830+0000","last_active":"2023-10-06T03:17:03.338171+0000","last_peered":"2023-10-06T03:17:03.338171+0000","last_clean":"2023-10-06T03:17:03.338171+0000","last_became_active":"2023-10-06T03:17:03.333467+0000","last_became_peered":"2023-10-06T03:17:03.333467+0000","last_unstale":"2023-10-06T03:17:03.338171+0000","last_undegraded":"2023-10-06T03:17:03.338171+0000","last_fullsized":"2023-10-06T03:17:03.338171+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:28.251742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.379819+0000","last_change":"2023-10-06T03:17:02.386354+0000","last_active":"2023-10-06T03:17:03.379819+0000","last_peered":"2023-10-06T03:17:03.379819+0000","last_clean":"2023-10-06T03:17:03.379819+0000","last_became_active":"2023-10-06T03:17:02.386102+0000","last_became_peered":"2023-10-06T03:17:02.386102+0000","last_unstale":"2023-10-06T03:17:03.379819+0000","last_undegraded":"2023-10-06T03:17:03.379819+0000","last_fullsized":"2023-10-06T03:17:03.379819+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:00.894415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.326370+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:17:03.326370+0000","last_peered":"2023-10-06T03:17:03.326370+0000","last_clean":"2023-10-06T03:17:03.326370+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:03.326370+0000","last_undegraded":"2023-10-06T03:17:03.326370+0000","last_fullsized":"2023-10-06T03:17:03.326370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.333166+0000","last_change":"2023-10-06T03:17:03.333166+0000","last_active":"2023-10-06T03:17:03.333166+0000","last_peered":"2023-10-06T03:17:03.333166+0000","last_clean":"2023-10-06T03:17:03.333166+0000","last_became_active":"2023-10-06T03:17:03.332921+0000","last_became_peered":"2023-10-06T03:17:03.332921+0000","last_unstale":"2023-10-06T03:17:03.333166+0000","last_undegraded":"2023-10-06T03:17:03.333166+0000","last_fullsized":"2023-10-06T03:17:03.333166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:23.230341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328123+0000","last_change":"2023-10-06T03:17:02.386740+0000","last_active":"2023-10-06T03:17:03.328123+0000","last_peered":"2023-10-06T03:17:03.328123+0000","last_clean":"2023-10-06T03:17:03.328123+0000","last_became_active":"2023-10-06T03:17:02.386447+0000","last_became_peered":"2023-10-06T03:17:02.386447+0000","last_unstale":"2023-10-06T03:17:03.328123+0000","last_undegraded":"2023-10-06T03:17:03.328123+0000","last_fullsized":"2023-10-06T03:17:03.328123+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:52.731116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.375655+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:17:02.375655+0000","last_peered":"2023-10-06T03:17:02.375655+0000","last_clean":"2023-10-06T03:17:02.375655+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:02.375655+0000","last_undegraded":"2023-10-06T03:17:02.375655+0000","last_fullsized":"2023-10-06T03:17:02.375655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.333369+0000","last_change":"2023-10-06T03:17:03.333369+0000","last_active":"2023-10-06T03:17:03.333369+0000","last_peered":"2023-10-06T03:17:03.333369+0000","last_clean":"2023-10-06T03:17:03.333369+0000","last_became_active":"2023-10-06T03:17:03.332294+0000","last_became_peered":"2023-10-06T03:17:03.332294+0000","last_unstale":"2023-10-06T03:17:03.333369+0000","last_undegraded":"2023-10-06T03:17:03.333369+0000","last_fullsized":"2023-10-06T03:17:03.333369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:43.561513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.327271+0000","last_change":"2023-10-06T03:17:02.379303+0000","last_active":"2023-10-06T03:17:03.327271+0000","last_peered":"2023-10-06T03:17:03.327271+0000","last_clean":"2023-10-06T03:17:03.327271+0000","last_became_active":"2023-10-06T03:17:02.379014+0000","last_became_peered":"2023-10-06T03:17:02.379014+0000","last_unstale":"2023-10-06T03:17:03.327271+0000","last_undegraded":"2023-10-06T03:17:03.327271+0000","last_fullsized":"2023-10-06T03:17:03.327271+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:12.758816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.375889+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:17:02.375889+0000","last_peered":"2023-10-06T03:17:02.375889+0000","last_clean":"2023-10-06T03:17:02.375889+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:02.375889+0000","last_undegraded":"2023-10-06T03:17:02.375889+0000","last_fullsized":"2023-10-06T03:17:02.375889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":796240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":206372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.622},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.248},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.375},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.26000000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.439},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.501},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":205804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.31},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.252}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.438}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.497},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.44800000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.376}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.625},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":207306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.315}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.6960000000000002,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":207655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.437},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42099999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39800000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":207101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:17:07.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:17:07.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.571+0000 7ffa84151700 1 Processor -- start 2023-10-06T03:17:07.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.571+0000 7ffa84151700 1 -- start start 2023-10-06T03:17:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa84151700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c15d930 0x7ffa7c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa84151700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa7c1591b0 0x7ffa7c159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa84151700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c0b2ad0 con 0x7ffa7c15d560 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa84151700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c0b4160 con 0x7ffa7c1591b0 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa84151700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c159b70 con 0x7ffa7c15d930 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa81eed700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ffa7c15d560 0x7ffa7c0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43152/0 (socket says 172.21.15.82:43152) 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa81eed700 1 -- 172.21.15.82:0/331474113 learned_addr learned my addr 172.21.15.82:0/331474113 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830940677 0 0) 0x7ffa7c0b2ad0 con 0x7ffa7c15d560 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa68003570 con 0x7ffa7c15d560 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa816ec700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c15d930 0x7ffa7c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa826ee700 1 --2- 172.21.15.82:0/331474113 >> v2:172.21.15.134:3300/0 conn(0x7ffa7c1591b0 0x7ffa7c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 641720880 0 0) 0x7ffa68003570 con 0x7ffa7c15d560 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c15d930 msgr2=0x7ffa7c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c15d930 0x7ffa7c0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 >> v2:172.21.15.134:3300/0 conn(0x7ffa7c1591b0 msgr2=0x7ffa7c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 --2- 172.21.15.82:0/331474113 >> v2:172.21.15.134:3300/0 conn(0x7ffa7c1591b0 0x7ffa7c159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0b2230 con 0x7ffa7c15d560 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7ffa78001470 con 0x7ffa7c15d560 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 >> v1:172.21.15.82:6789/0 conn(0x7ffa7c15d560 legacy=0x7ffa7c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa68003a60 0x7ffa68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c15d930 0x7ffa68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa68004d50 0x7ffa680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0b4160 con 0x7ffa68004d50 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c159b70 con 0x7ffa68003a60 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.572+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800ba60 con 0x7ffa7c15d930 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa826ee700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa68004d50 0x7ffa680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa81eed700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa68003a60 0x7ffa68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa816ec700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c15d930 0x7ffa68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa826ee700 1 -- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c15d930 msgr2=0x7ffa68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa826ee700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c15d930 0x7ffa68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa826ee700 1 -- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa68003a60 msgr2=0x7ffa68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa826ee700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa68003a60 0x7ffa68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa826ee700 1 -- 172.21.15.82:0/331474113 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68003570 con 0x7ffa68004d50 2023-10-06T03:17:07.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa826ee700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa68004d50 0x7ffa680051c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e210 tx=0x7ffa7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea15aaf340c1857d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400ea60 con 0x7ffa68004d50 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400f040 con 0x7ffa68004d50 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.573+0000 7ffa80eeb700 1 -- 172.21.15.82:0/331474113 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400ee10 con 0x7ffa68004d50 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.574+0000 7ffa84151700 1 -- 172.21.15.82:0/331474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa68004d50 msgr2=0x7ffa680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.574+0000 7ffa84151700 1 --2- 172.21.15.82:0/331474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa68004d50 0x7ffa680051c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e210 tx=0x7ffa7400b040 comp rx=0 tx=0).stop 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.574+0000 7ffa826ee700 1 -- 172.21.15.82:0/331474113 reap_dead start 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.574+0000 7ffa84151700 1 -- 172.21.15.82:0/331474113 shutdown_connections 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.574+0000 7ffa84151700 1 -- 172.21.15.82:0/331474113 >> 172.21.15.82:0/331474113 conn(0x7ffa7c0d1180 msgr2=0x7ffa7c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.574+0000 7ffa84151700 1 -- 172.21.15.82:0/331474113 shutdown_connections 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.574+0000 7ffa84151700 1 -- 172.21.15.82:0/331474113 wait complete. 2023-10-06T03:17:07.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.575+0000 7ffa84151700 1 Processor -- start 2023-10-06T03:17:07.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.575+0000 7ffa84151700 1 -- start start 2023-10-06T03:17:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.575+0000 7ffa84151700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa7c14def0 0x7ffa7c13eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.575+0000 7ffa84151700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c14f6c0 0x7ffa7c14e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.575+0000 7ffa84151700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c14e800 0x7ffa7c15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.575+0000 7ffa84151700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c140020 con 0x7ffa7c14def0 2023-10-06T03:17:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.575+0000 7ffa84151700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c13f780 con 0x7ffa7c14f6c0 2023-10-06T03:17:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.575+0000 7ffa84151700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c13fa60 con 0x7ffa7c14e800 2023-10-06T03:17:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa7c14def0 0x7ffa7c13eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa7c14def0 0x7ffa7c13eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52114/0 (socket says 172.21.15.82:52114) 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 -- 172.21.15.82:0/375060685 learned_addr learned my addr 172.21.15.82:0/375060685 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 -- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c14e800 msgr2=0x7ffa7c15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c14e800 0x7ffa7c15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 -- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c14f6c0 msgr2=0x7ffa7c14e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa816ec700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c14f6c0 0x7ffa7c14e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c14f6c0 0x7ffa7c14e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 -- 172.21.15.82:0/375060685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c13fd40 con 0x7ffa7c14def0 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa81eed700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa7c14def0 0x7ffa7c13eee0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ffa780079e0 tx=0x7ffa7c0d0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa71ffb700 1 -- 172.21.15.82:0/375060685 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78018030 con 0x7ffa7c14def0 2023-10-06T03:17:07.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa71ffb700 1 -- 172.21.15.82:0/375060685 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7800f940 con 0x7ffa7c14def0 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c159e10 con 0x7ffa7c14def0 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa71ffb700 1 -- 172.21.15.82:0/375060685 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800fd00 con 0x7ffa7c14def0 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.576+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c13f420 con 0x7ffa7c14def0 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.577+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c15a050 con 0x7ffa7c14def0 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.578+0000 7ffa71ffb700 1 -- 172.21.15.82:0/375060685 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa7801b070 con 0x7ffa7c14def0 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.578+0000 7ffa71ffb700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ffa60066f30 0x7ffa600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.578+0000 7ffa71ffb700 1 -- 172.21.15.82:0/375060685 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffa78019070 con 0x7ffa7c14def0 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.578+0000 7ffa816ec700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ffa60066f30 0x7ffa600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.579+0000 7ffa816ec700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ffa60066f30 0x7ffa600693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c13cc60 tx=0x7ffa6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.582+0000 7ffa71ffb700 1 -- 172.21.15.82:0/375060685 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa7c15a050 con 0x7ffa7c14def0 2023-10-06T03:17:07.666 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-10-06T03:17:07.665+0000 7fecade25700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:17:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.762+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa7c15a050 con 0x7ffa60066f30 2023-10-06T03:17:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.771+0000 7ffa71ffb700 1 -- 172.21.15.82:0/375060685 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311539 (secure 0 0 0) 0x7ffa7c15a050 con 0x7ffa60066f30 2023-10-06T03:17:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:07.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ffa60066f30 msgr2=0x7ffa600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ffa60066f30 0x7ffa600693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c13cc60 tx=0x7ffa6c008040 comp rx=0 tx=0).stop 2023-10-06T03:17:07.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa7c14def0 msgr2=0x7ffa7c13eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa7c14def0 0x7ffa7c13eee0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ffa780079e0 tx=0x7ffa7c0d0570 comp rx=0 tx=0).stop 2023-10-06T03:17:07.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 shutdown_connections 2023-10-06T03:17:07.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ffa60066f30 0x7ffa600693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa7c14e800 0x7ffa7c15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa7c14def0 0x7ffa7c13eee0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 --2- 172.21.15.82:0/375060685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa7c14f6c0 0x7ffa7c14e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 >> 172.21.15.82:0/375060685 conn(0x7ffa7c0d1180 msgr2=0x7ffa7c0690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:07.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 shutdown_connections 2023-10-06T03:17:07.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.774+0000 7ffa84151700 1 -- 172.21.15.82:0/375060685 wait complete. 2023-10-06T03:17:07.779 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:17:07.787 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-06T03:17:07.166397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383348,"kb_used_data":5044,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591372,"statfs":{"total":773094113280,"available":770653564928,"internally_reserved":0,"allocated":5165056,"data_stored":2835391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.807555"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335254+0000","last_change":"2023-10-06T03:17:03.335254+0000","last_active":"2023-10-06T03:17:03.335254+0000","last_peered":"2023-10-06T03:17:03.335254+0000","last_clean":"2023-10-06T03:17:03.335254+0000","last_became_active":"2023-10-06T03:17:03.334948+0000","last_became_peered":"2023-10-06T03:17:03.334948+0000","last_unstale":"2023-10-06T03:17:03.335254+0000","last_undegraded":"2023-10-06T03:17:03.335254+0000","last_fullsized":"2023-10-06T03:17:03.335254+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:52.500181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.343511+0000","last_change":"2023-10-06T03:17:03.343511+0000","last_active":"2023-10-06T03:17:03.343511+0000","last_peered":"2023-10-06T03:17:03.343511+0000","last_clean":"2023-10-06T03:17:03.343511+0000","last_became_active":"2023-10-06T03:17:03.343227+0000","last_became_peered":"2023-10-06T03:17:03.343227+0000","last_unstale":"2023-10-06T03:17:03.343511+0000","last_undegraded":"2023-10-06T03:17:03.343511+0000","last_fullsized":"2023-10-06T03:17:03.343511+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:58.240171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335578+0000","last_change":"2023-10-06T03:17:03.335578+0000","last_active":"2023-10-06T03:17:03.335578+0000","last_peered":"2023-10-06T03:17:03.335578+0000","last_clean":"2023-10-06T03:17:03.335578+0000","last_became_active":"2023-10-06T03:17:03.335330+0000","last_became_peered":"2023-10-06T03:17:03.335330+0000","last_unstale":"2023-10-06T03:17:03.335578+0000","last_undegraded":"2023-10-06T03:17:03.335578+0000","last_fullsized":"2023-10-06T03:17:03.335578+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:52.183164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.345575+0000","last_change":"2023-10-06T03:17:03.345575+0000","last_active":"2023-10-06T03:17:03.345575+0000","last_peered":"2023-10-06T03:17:03.345575+0000","last_clean":"2023-10-06T03:17:03.345575+0000","last_became_active":"2023-10-06T03:17:03.345308+0000","last_became_peered":"2023-10-06T03:17:03.345308+0000","last_unstale":"2023-10-06T03:17:03.345575+0000","last_undegraded":"2023-10-06T03:17:03.345575+0000","last_fullsized":"2023-10-06T03:17:03.345575+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.336598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342116+0000","last_change":"2023-10-06T03:17:03.340062+0000","last_active":"2023-10-06T03:17:03.342116+0000","last_peered":"2023-10-06T03:17:03.342116+0000","last_clean":"2023-10-06T03:17:03.342116+0000","last_became_active":"2023-10-06T03:17:03.339757+0000","last_became_peered":"2023-10-06T03:17:03.339757+0000","last_unstale":"2023-10-06T03:17:03.342116+0000","last_undegraded":"2023-10-06T03:17:03.342116+0000","last_fullsized":"2023-10-06T03:17:03.342116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:22.002578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340342+0000","last_change":"2023-10-06T03:17:03.340342+0000","last_active":"2023-10-06T03:17:03.340342+0000","last_peered":"2023-10-06T03:17:03.340342+0000","last_clean":"2023-10-06T03:17:03.340342+0000","last_became_active":"2023-10-06T03:17:03.340109+0000","last_became_peered":"2023-10-06T03:17:03.340109+0000","last_unstale":"2023-10-06T03:17:03.340342+0000","last_undegraded":"2023-10-06T03:17:03.340342+0000","last_fullsized":"2023-10-06T03:17:03.340342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:37.781651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342110+0000","last_change":"2023-10-06T03:17:03.342110+0000","last_active":"2023-10-06T03:17:03.342110+0000","last_peered":"2023-10-06T03:17:03.342110+0000","last_clean":"2023-10-06T03:17:03.342110+0000","last_became_active":"2023-10-06T03:17:03.341491+0000","last_became_peered":"2023-10-06T03:17:03.341491+0000","last_unstale":"2023-10-06T03:17:03.342110+0000","last_undegraded":"2023-10-06T03:17:03.342110+0000","last_fullsized":"2023-10-06T03:17:03.342110+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.834084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335503+0000","last_change":"2023-10-06T03:17:03.335503+0000","last_active":"2023-10-06T03:17:03.335503+0000","last_peered":"2023-10-06T03:17:03.335503+0000","last_clean":"2023-10-06T03:17:03.335503+0000","last_became_active":"2023-10-06T03:17:03.335227+0000","last_became_peered":"2023-10-06T03:17:03.335227+0000","last_unstale":"2023-10-06T03:17:03.335503+0000","last_undegraded":"2023-10-06T03:17:03.335503+0000","last_fullsized":"2023-10-06T03:17:03.335503+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:49.498726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.336657+0000","last_change":"2023-10-06T03:17:03.336657+0000","last_active":"2023-10-06T03:17:03.336657+0000","last_peered":"2023-10-06T03:17:03.336657+0000","last_clean":"2023-10-06T03:17:03.336657+0000","last_became_active":"2023-10-06T03:17:03.336370+0000","last_became_peered":"2023-10-06T03:17:03.336370+0000","last_unstale":"2023-10-06T03:17:03.336657+0000","last_undegraded":"2023-10-06T03:17:03.336657+0000","last_fullsized":"2023-10-06T03:17:03.336657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:20.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.330548+0000","last_change":"2023-10-06T03:17:03.330548+0000","last_active":"2023-10-06T03:17:03.330548+0000","last_peered":"2023-10-06T03:17:03.330548+0000","last_clean":"2023-10-06T03:17:03.330548+0000","last_became_active":"2023-10-06T03:17:03.330285+0000","last_became_peered":"2023-10-06T03:17:03.330285+0000","last_unstale":"2023-10-06T03:17:03.330548+0000","last_undegraded":"2023-10-06T03:17:03.330548+0000","last_fullsized":"2023-10-06T03:17:03.330548+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:28.764166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344953+0000","last_change":"2023-10-06T03:17:03.339846+0000","last_active":"2023-10-06T03:17:03.344953+0000","last_peered":"2023-10-06T03:17:03.344953+0000","last_clean":"2023-10-06T03:17:03.344953+0000","last_became_active":"2023-10-06T03:17:03.339575+0000","last_became_peered":"2023-10-06T03:17:03.339575+0000","last_unstale":"2023-10-06T03:17:03.344953+0000","last_undegraded":"2023-10-06T03:17:03.344953+0000","last_fullsized":"2023-10-06T03:17:03.344953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:22:23.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338074+0000","last_change":"2023-10-06T03:17:03.338074+0000","last_active":"2023-10-06T03:17:03.338074+0000","last_peered":"2023-10-06T03:17:03.338074+0000","last_clean":"2023-10-06T03:17:03.338074+0000","last_became_active":"2023-10-06T03:17:03.337793+0000","last_became_peered":"2023-10-06T03:17:03.337793+0000","last_unstale":"2023-10-06T03:17:03.338074+0000","last_undegraded":"2023-10-06T03:17:03.338074+0000","last_fullsized":"2023-10-06T03:17:03.338074+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:58.653934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334325+0000","last_change":"2023-10-06T03:17:03.334325+0000","last_active":"2023-10-06T03:17:03.334325+0000","last_peered":"2023-10-06T03:17:03.334325+0000","last_clean":"2023-10-06T03:17:03.334325+0000","last_became_active":"2023-10-06T03:17:03.334091+0000","last_became_peered":"2023-10-06T03:17:03.334091+0000","last_unstale":"2023-10-06T03:17:03.334325+0000","last_undegraded":"2023-10-06T03:17:03.334325+0000","last_fullsized":"2023-10-06T03:17:03.334325+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:55.677587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.341766+0000","last_change":"2023-10-06T03:17:03.341766+0000","last_active":"2023-10-06T03:17:03.341766+0000","last_peered":"2023-10-06T03:17:03.341766+0000","last_clean":"2023-10-06T03:17:03.341766+0000","last_became_active":"2023-10-06T03:17:03.341512+0000","last_became_peered":"2023-10-06T03:17:03.341512+0000","last_unstale":"2023-10-06T03:17:03.341766+0000","last_undegraded":"2023-10-06T03:17:03.341766+0000","last_fullsized":"2023-10-06T03:17:03.341766+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:58.653934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.343487+0000","last_change":"2023-10-06T03:17:03.343487+0000","last_active":"2023-10-06T03:17:03.343487+0000","last_peered":"2023-10-06T03:17:03.343487+0000","last_clean":"2023-10-06T03:17:03.343487+0000","last_became_active":"2023-10-06T03:17:03.343240+0000","last_became_peered":"2023-10-06T03:17:03.343240+0000","last_unstale":"2023-10-06T03:17:03.343487+0000","last_undegraded":"2023-10-06T03:17:03.343487+0000","last_fullsized":"2023-10-06T03:17:03.343487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:05.743325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.331032+0000","last_change":"2023-10-06T03:17:03.331032+0000","last_active":"2023-10-06T03:17:03.331032+0000","last_peered":"2023-10-06T03:17:03.331032+0000","last_clean":"2023-10-06T03:17:03.331032+0000","last_became_active":"2023-10-06T03:17:03.330781+0000","last_became_peered":"2023-10-06T03:17:03.330781+0000","last_unstale":"2023-10-06T03:17:03.331032+0000","last_undegraded":"2023-10-06T03:17:03.331032+0000","last_fullsized":"2023-10-06T03:17:03.331032+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:50.520186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335609+0000","last_change":"2023-10-06T03:17:03.335609+0000","last_active":"2023-10-06T03:17:03.335609+0000","last_peered":"2023-10-06T03:17:03.335609+0000","last_clean":"2023-10-06T03:17:03.335609+0000","last_became_active":"2023-10-06T03:17:03.335005+0000","last_became_peered":"2023-10-06T03:17:03.335005+0000","last_unstale":"2023-10-06T03:17:03.335609+0000","last_undegraded":"2023-10-06T03:17:03.335609+0000","last_fullsized":"2023-10-06T03:17:03.335609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:49.919676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344495+0000","last_change":"2023-10-06T03:17:03.344495+0000","last_active":"2023-10-06T03:17:03.344495+0000","last_peered":"2023-10-06T03:17:03.344495+0000","last_clean":"2023-10-06T03:17:03.344495+0000","last_became_active":"2023-10-06T03:17:03.344282+0000","last_became_peered":"2023-10-06T03:17:03.344282+0000","last_unstale":"2023-10-06T03:17:03.344495+0000","last_undegraded":"2023-10-06T03:17:03.344495+0000","last_fullsized":"2023-10-06T03:17:03.344495+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.544266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338842+0000","last_change":"2023-10-06T03:17:03.338842+0000","last_active":"2023-10-06T03:17:03.338842+0000","last_peered":"2023-10-06T03:17:03.338842+0000","last_clean":"2023-10-06T03:17:03.338842+0000","last_became_active":"2023-10-06T03:17:03.338577+0000","last_became_peered":"2023-10-06T03:17:03.338577+0000","last_unstale":"2023-10-06T03:17:03.338842+0000","last_undegraded":"2023-10-06T03:17:03.338842+0000","last_fullsized":"2023-10-06T03:17:03.338842+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:20.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338116+0000","last_change":"2023-10-06T03:17:03.338116+0000","last_active":"2023-10-06T03:17:03.338116+0000","last_peered":"2023-10-06T03:17:03.338116+0000","last_clean":"2023-10-06T03:17:03.338116+0000","last_became_active":"2023-10-06T03:17:03.337158+0000","last_became_peered":"2023-10-06T03:17:03.337158+0000","last_unstale":"2023-10-06T03:17:03.338116+0000","last_undegraded":"2023-10-06T03:17:03.338116+0000","last_fullsized":"2023-10-06T03:17:03.338116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:47.636248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340594+0000","last_change":"2023-10-06T03:17:03.340594+0000","last_active":"2023-10-06T03:17:03.340594+0000","last_peered":"2023-10-06T03:17:03.340594+0000","last_clean":"2023-10-06T03:17:03.340594+0000","last_became_active":"2023-10-06T03:17:03.340316+0000","last_became_peered":"2023-10-06T03:17:03.340316+0000","last_unstale":"2023-10-06T03:17:03.340594+0000","last_undegraded":"2023-10-06T03:17:03.340594+0000","last_fullsized":"2023-10-06T03:17:03.340594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:35.668723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.339352+0000","last_change":"2023-10-06T03:17:03.339352+0000","last_active":"2023-10-06T03:17:03.339352+0000","last_peered":"2023-10-06T03:17:03.339352+0000","last_clean":"2023-10-06T03:17:03.339352+0000","last_became_active":"2023-10-06T03:17:03.339091+0000","last_became_peered":"2023-10-06T03:17:03.339091+0000","last_unstale":"2023-10-06T03:17:03.339352+0000","last_undegraded":"2023-10-06T03:17:03.339352+0000","last_fullsized":"2023-10-06T03:17:03.339352+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:08.801932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.345282+0000","last_change":"2023-10-06T03:17:03.340601+0000","last_active":"2023-10-06T03:17:03.345282+0000","last_peered":"2023-10-06T03:17:03.345282+0000","last_clean":"2023-10-06T03:17:03.345282+0000","last_became_active":"2023-10-06T03:17:03.340318+0000","last_became_peered":"2023-10-06T03:17:03.340318+0000","last_unstale":"2023-10-06T03:17:03.345282+0000","last_undegraded":"2023-10-06T03:17:03.345282+0000","last_fullsized":"2023-10-06T03:17:03.345282+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:05.865984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334686+0000","last_change":"2023-10-06T03:17:03.334686+0000","last_active":"2023-10-06T03:17:03.334686+0000","last_peered":"2023-10-06T03:17:03.334686+0000","last_clean":"2023-10-06T03:17:03.334686+0000","last_became_active":"2023-10-06T03:17:03.334435+0000","last_became_peered":"2023-10-06T03:17:03.334435+0000","last_unstale":"2023-10-06T03:17:03.334686+0000","last_undegraded":"2023-10-06T03:17:03.334686+0000","last_fullsized":"2023-10-06T03:17:03.334686+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:48.965120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338745+0000","last_change":"2023-10-06T03:17:03.338745+0000","last_active":"2023-10-06T03:17:03.338745+0000","last_peered":"2023-10-06T03:17:03.338745+0000","last_clean":"2023-10-06T03:17:03.338745+0000","last_became_active":"2023-10-06T03:17:03.338491+0000","last_became_peered":"2023-10-06T03:17:03.338491+0000","last_unstale":"2023-10-06T03:17:03.338745+0000","last_undegraded":"2023-10-06T03:17:03.338745+0000","last_fullsized":"2023-10-06T03:17:03.338745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:34.776895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.339832+0000","last_change":"2023-10-06T03:17:03.339832+0000","last_active":"2023-10-06T03:17:03.339832+0000","last_peered":"2023-10-06T03:17:03.339832+0000","last_clean":"2023-10-06T03:17:03.339832+0000","last_became_active":"2023-10-06T03:17:03.339581+0000","last_became_peered":"2023-10-06T03:17:03.339581+0000","last_unstale":"2023-10-06T03:17:03.339832+0000","last_undegraded":"2023-10-06T03:17:03.339832+0000","last_fullsized":"2023-10-06T03:17:03.339832+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:24.919018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.336809+0000","last_change":"2023-10-06T03:17:03.336809+0000","last_active":"2023-10-06T03:17:03.336809+0000","last_peered":"2023-10-06T03:17:03.336809+0000","last_clean":"2023-10-06T03:17:03.336809+0000","last_became_active":"2023-10-06T03:17:03.336563+0000","last_became_peered":"2023-10-06T03:17:03.336563+0000","last_unstale":"2023-10-06T03:17:03.336809+0000","last_undegraded":"2023-10-06T03:17:03.336809+0000","last_fullsized":"2023-10-06T03:17:03.336809+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:35.668723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337538+0000","last_change":"2023-10-06T03:17:03.337538+0000","last_active":"2023-10-06T03:17:03.337538+0000","last_peered":"2023-10-06T03:17:03.337538+0000","last_clean":"2023-10-06T03:17:03.337538+0000","last_became_active":"2023-10-06T03:17:03.336882+0000","last_became_peered":"2023-10-06T03:17:03.336882+0000","last_unstale":"2023-10-06T03:17:03.337538+0000","last_undegraded":"2023-10-06T03:17:03.337538+0000","last_fullsized":"2023-10-06T03:17:03.337538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:52.500181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342665+0000","last_change":"2023-10-06T03:17:03.342665+0000","last_active":"2023-10-06T03:17:03.342665+0000","last_peered":"2023-10-06T03:17:03.342665+0000","last_clean":"2023-10-06T03:17:03.342665+0000","last_became_active":"2023-10-06T03:17:03.342319+0000","last_became_peered":"2023-10-06T03:17:03.342319+0000","last_unstale":"2023-10-06T03:17:03.342665+0000","last_undegraded":"2023-10-06T03:17:03.342665+0000","last_fullsized":"2023-10-06T03:17:03.342665+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:49.498726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344177+0000","last_change":"2023-10-06T03:17:03.344177+0000","last_active":"2023-10-06T03:17:03.344177+0000","last_peered":"2023-10-06T03:17:03.344177+0000","last_clean":"2023-10-06T03:17:03.344177+0000","last_became_active":"2023-10-06T03:17:03.343936+0000","last_became_peered":"2023-10-06T03:17:03.343936+0000","last_unstale":"2023-10-06T03:17:03.344177+0000","last_undegraded":"2023-10-06T03:17:03.344177+0000","last_fullsized":"2023-10-06T03:17:03.344177+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:08.801932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342359+0000","last_change":"2023-10-06T03:17:03.342359+0000","last_active":"2023-10-06T03:17:03.342359+0000","last_peered":"2023-10-06T03:17:03.342359+0000","last_clean":"2023-10-06T03:17:03.342359+0000","last_became_active":"2023-10-06T03:17:03.341818+0000","last_became_peered":"2023-10-06T03:17:03.341818+0000","last_unstale":"2023-10-06T03:17:03.342359+0000","last_undegraded":"2023-10-06T03:17:03.342359+0000","last_fullsized":"2023-10-06T03:17:03.342359+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:34.631979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338152+0000","last_change":"2023-10-06T03:17:03.333994+0000","last_active":"2023-10-06T03:17:03.338152+0000","last_peered":"2023-10-06T03:17:03.338152+0000","last_clean":"2023-10-06T03:17:03.338152+0000","last_became_active":"2023-10-06T03:17:03.333768+0000","last_became_peered":"2023-10-06T03:17:03.333768+0000","last_unstale":"2023-10-06T03:17:03.338152+0000","last_undegraded":"2023-10-06T03:17:03.338152+0000","last_fullsized":"2023-10-06T03:17:03.338152+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.544266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344290+0000","last_change":"2023-10-06T03:17:03.344290+0000","last_active":"2023-10-06T03:17:03.344290+0000","last_peered":"2023-10-06T03:17:03.344290+0000","last_clean":"2023-10-06T03:17:03.344290+0000","last_became_active":"2023-10-06T03:17:03.342562+0000","last_became_peered":"2023-10-06T03:17:03.342562+0000","last_unstale":"2023-10-06T03:17:03.344290+0000","last_undegraded":"2023-10-06T03:17:03.344290+0000","last_fullsized":"2023-10-06T03:17:03.344290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:28.251742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"42'4","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.378534+0000","last_change":"2023-10-06T03:17:02.379393+0000","last_active":"2023-10-06T03:17:03.378534+0000","last_peered":"2023-10-06T03:17:03.378534+0000","last_clean":"2023-10-06T03:17:03.378534+0000","last_became_active":"2023-10-06T03:17:02.379045+0000","last_became_peered":"2023-10-06T03:17:02.379045+0000","last_unstale":"2023-10-06T03:17:03.378534+0000","last_undegraded":"2023-10-06T03:17:03.378534+0000","last_fullsized":"2023-10-06T03:17:03.378534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:54.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344205+0000","last_change":"2023-10-06T03:17:03.343224+0000","last_active":"2023-10-06T03:17:03.344205+0000","last_peered":"2023-10-06T03:17:03.344205+0000","last_clean":"2023-10-06T03:17:03.344205+0000","last_became_active":"2023-10-06T03:17:03.342669+0000","last_became_peered":"2023-10-06T03:17:03.342669+0000","last_unstale":"2023-10-06T03:17:03.344205+0000","last_undegraded":"2023-10-06T03:17:03.344205+0000","last_fullsized":"2023-10-06T03:17:03.344205+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:22.002578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.323929+0000","last_change":"2023-10-06T03:17:02.389197+0000","last_active":"2023-10-06T03:17:03.323929+0000","last_peered":"2023-10-06T03:17:03.323929+0000","last_clean":"2023-10-06T03:17:03.323929+0000","last_became_active":"2023-10-06T03:17:02.388952+0000","last_became_peered":"2023-10-06T03:17:02.388952+0000","last_unstale":"2023-10-06T03:17:03.323929+0000","last_undegraded":"2023-10-06T03:17:03.323929+0000","last_fullsized":"2023-10-06T03:17:03.323929+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:23.044475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340690+0000","last_change":"2023-10-06T03:17:03.340690+0000","last_active":"2023-10-06T03:17:03.340690+0000","last_peered":"2023-10-06T03:17:03.340690+0000","last_clean":"2023-10-06T03:17:03.340690+0000","last_became_active":"2023-10-06T03:17:03.340433+0000","last_became_peered":"2023-10-06T03:17:03.340433+0000","last_unstale":"2023-10-06T03:17:03.340690+0000","last_undegraded":"2023-10-06T03:17:03.340690+0000","last_fullsized":"2023-10-06T03:17:03.340690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:24.582718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.377806+0000","last_change":"2023-10-06T03:17:02.389806+0000","last_active":"2023-10-06T03:17:03.377806+0000","last_peered":"2023-10-06T03:17:03.377806+0000","last_clean":"2023-10-06T03:17:03.377806+0000","last_became_active":"2023-10-06T03:17:02.389555+0000","last_became_peered":"2023-10-06T03:17:02.389555+0000","last_unstale":"2023-10-06T03:17:03.377806+0000","last_undegraded":"2023-10-06T03:17:03.377806+0000","last_fullsized":"2023-10-06T03:17:03.377806+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:00.291744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334215+0000","last_change":"2023-10-06T03:17:03.334215+0000","last_active":"2023-10-06T03:17:03.334215+0000","last_peered":"2023-10-06T03:17:03.334215+0000","last_clean":"2023-10-06T03:17:03.334215+0000","last_became_active":"2023-10-06T03:17:03.333818+0000","last_became_peered":"2023-10-06T03:17:03.333818+0000","last_unstale":"2023-10-06T03:17:03.334215+0000","last_undegraded":"2023-10-06T03:17:03.334215+0000","last_fullsized":"2023-10-06T03:17:03.334215+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:52.183164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.382729+0000","last_change":"2023-10-06T03:17:02.389261+0000","last_active":"2023-10-06T03:17:03.382729+0000","last_peered":"2023-10-06T03:17:03.382729+0000","last_clean":"2023-10-06T03:17:03.382729+0000","last_became_active":"2023-10-06T03:17:02.389000+0000","last_became_peered":"2023-10-06T03:17:02.389000+0000","last_unstale":"2023-10-06T03:17:03.382729+0000","last_undegraded":"2023-10-06T03:17:03.382729+0000","last_fullsized":"2023-10-06T03:17:03.382729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:36.776340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.341276+0000","last_change":"2023-10-06T03:17:03.336855+0000","last_active":"2023-10-06T03:17:03.341276+0000","last_peered":"2023-10-06T03:17:03.341276+0000","last_clean":"2023-10-06T03:17:03.341276+0000","last_became_active":"2023-10-06T03:17:03.336591+0000","last_became_peered":"2023-10-06T03:17:03.336591+0000","last_unstale":"2023-10-06T03:17:03.341276+0000","last_undegraded":"2023-10-06T03:17:03.341276+0000","last_fullsized":"2023-10-06T03:17:03.341276+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.544266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.327824+0000","last_change":"2023-10-06T03:17:02.382965+0000","last_active":"2023-10-06T03:17:03.327824+0000","last_peered":"2023-10-06T03:17:03.327824+0000","last_clean":"2023-10-06T03:17:03.327824+0000","last_became_active":"2023-10-06T03:17:02.382586+0000","last_became_peered":"2023-10-06T03:17:02.382586+0000","last_unstale":"2023-10-06T03:17:03.327824+0000","last_undegraded":"2023-10-06T03:17:03.327824+0000","last_fullsized":"2023-10-06T03:17:03.327824+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:36.776340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.344130+0000","last_change":"2023-10-06T03:17:03.344130+0000","last_active":"2023-10-06T03:17:03.344130+0000","last_peered":"2023-10-06T03:17:03.344130+0000","last_clean":"2023-10-06T03:17:03.344130+0000","last_became_active":"2023-10-06T03:17:03.343561+0000","last_became_peered":"2023-10-06T03:17:03.343561+0000","last_unstale":"2023-10-06T03:17:03.344130+0000","last_undegraded":"2023-10-06T03:17:03.344130+0000","last_fullsized":"2023-10-06T03:17:03.344130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:13.392326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.380936+0000","last_change":"2023-10-06T03:17:02.380758+0000","last_active":"2023-10-06T03:17:03.380936+0000","last_peered":"2023-10-06T03:17:03.380936+0000","last_clean":"2023-10-06T03:17:03.380936+0000","last_became_active":"2023-10-06T03:17:02.380526+0000","last_became_peered":"2023-10-06T03:17:02.380526+0000","last_unstale":"2023-10-06T03:17:03.380936+0000","last_undegraded":"2023-10-06T03:17:03.380936+0000","last_fullsized":"2023-10-06T03:17:03.380936+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:47.959809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.332742+0000","last_change":"2023-10-06T03:17:03.332742+0000","last_active":"2023-10-06T03:17:03.332742+0000","last_peered":"2023-10-06T03:17:03.332742+0000","last_clean":"2023-10-06T03:17:03.332742+0000","last_became_active":"2023-10-06T03:17:03.332486+0000","last_became_peered":"2023-10-06T03:17:03.332486+0000","last_unstale":"2023-10-06T03:17:03.332742+0000","last_undegraded":"2023-10-06T03:17:03.332742+0000","last_fullsized":"2023-10-06T03:17:03.332742+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:34.776895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.381748+0000","last_change":"2023-10-06T03:17:02.380047+0000","last_active":"2023-10-06T03:17:02.381748+0000","last_peered":"2023-10-06T03:17:02.381748+0000","last_clean":"2023-10-06T03:17:02.381748+0000","last_became_active":"2023-10-06T03:17:02.379803+0000","last_became_peered":"2023-10-06T03:17:02.379803+0000","last_unstale":"2023-10-06T03:17:02.381748+0000","last_undegraded":"2023-10-06T03:17:02.381748+0000","last_fullsized":"2023-10-06T03:17:02.381748+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:49.784369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.343971+0000","last_change":"2023-10-06T03:17:03.343971+0000","last_active":"2023-10-06T03:17:03.343971+0000","last_peered":"2023-10-06T03:17:03.343971+0000","last_clean":"2023-10-06T03:17:03.343971+0000","last_became_active":"2023-10-06T03:17:03.343697+0000","last_became_peered":"2023-10-06T03:17:03.343697+0000","last_unstale":"2023-10-06T03:17:03.343971+0000","last_undegraded":"2023-10-06T03:17:03.343971+0000","last_fullsized":"2023-10-06T03:17:03.343971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:20.276035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.387178+0000","last_change":"2023-10-06T03:17:02.380440+0000","last_active":"2023-10-06T03:17:02.387178+0000","last_peered":"2023-10-06T03:17:02.387178+0000","last_clean":"2023-10-06T03:17:02.387178+0000","last_became_active":"2023-10-06T03:17:02.380204+0000","last_became_peered":"2023-10-06T03:17:02.380204+0000","last_unstale":"2023-10-06T03:17:02.387178+0000","last_undegraded":"2023-10-06T03:17:02.387178+0000","last_fullsized":"2023-10-06T03:17:02.387178+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:46.630937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337785+0000","last_change":"2023-10-06T03:17:03.332561+0000","last_active":"2023-10-06T03:17:03.337785+0000","last_peered":"2023-10-06T03:17:03.337785+0000","last_clean":"2023-10-06T03:17:03.337785+0000","last_became_active":"2023-10-06T03:17:03.332293+0000","last_became_peered":"2023-10-06T03:17:03.332293+0000","last_unstale":"2023-10-06T03:17:03.337785+0000","last_undegraded":"2023-10-06T03:17:03.337785+0000","last_fullsized":"2023-10-06T03:17:03.337785+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:58.240171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.383978+0000","last_change":"2023-10-06T03:17:02.380584+0000","last_active":"2023-10-06T03:17:02.383978+0000","last_peered":"2023-10-06T03:17:02.383978+0000","last_clean":"2023-10-06T03:17:02.383978+0000","last_became_active":"2023-10-06T03:17:02.380252+0000","last_became_peered":"2023-10-06T03:17:02.380252+0000","last_unstale":"2023-10-06T03:17:02.383978+0000","last_undegraded":"2023-10-06T03:17:02.383978+0000","last_fullsized":"2023-10-06T03:17:02.383978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:12.758816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337858+0000","last_change":"2023-10-06T03:17:03.333768+0000","last_active":"2023-10-06T03:17:03.337858+0000","last_peered":"2023-10-06T03:17:03.337858+0000","last_clean":"2023-10-06T03:17:03.337858+0000","last_became_active":"2023-10-06T03:17:03.333020+0000","last_became_peered":"2023-10-06T03:17:03.333020+0000","last_unstale":"2023-10-06T03:17:03.337858+0000","last_undegraded":"2023-10-06T03:17:03.337858+0000","last_fullsized":"2023-10-06T03:17:03.337858+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:33.570976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328859+0000","last_change":"2023-10-06T03:17:02.386399+0000","last_active":"2023-10-06T03:17:03.328859+0000","last_peered":"2023-10-06T03:17:03.328859+0000","last_clean":"2023-10-06T03:17:03.328859+0000","last_became_active":"2023-10-06T03:17:02.386074+0000","last_became_peered":"2023-10-06T03:17:02.386074+0000","last_unstale":"2023-10-06T03:17:03.328859+0000","last_undegraded":"2023-10-06T03:17:03.328859+0000","last_fullsized":"2023-10-06T03:17:03.328859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:35.591643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342825+0000","last_change":"2023-10-06T03:17:03.342825+0000","last_active":"2023-10-06T03:17:03.342825+0000","last_peered":"2023-10-06T03:17:03.342825+0000","last_clean":"2023-10-06T03:17:03.342825+0000","last_became_active":"2023-10-06T03:17:03.342273+0000","last_became_peered":"2023-10-06T03:17:03.342273+0000","last_unstale":"2023-10-06T03:17:03.342825+0000","last_undegraded":"2023-10-06T03:17:03.342825+0000","last_fullsized":"2023-10-06T03:17:03.342825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:24.919018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"42'3","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.383028+0000","last_change":"2023-10-06T03:17:02.388005+0000","last_active":"2023-10-06T03:17:03.383028+0000","last_peered":"2023-10-06T03:17:03.383028+0000","last_clean":"2023-10-06T03:17:03.383028+0000","last_became_active":"2023-10-06T03:17:02.387811+0000","last_became_peered":"2023-10-06T03:17:02.387811+0000","last_unstale":"2023-10-06T03:17:03.383028+0000","last_undegraded":"2023-10-06T03:17:03.383028+0000","last_fullsized":"2023-10-06T03:17:03.383028+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:35.591643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335298+0000","last_change":"2023-10-06T03:17:03.331340+0000","last_active":"2023-10-06T03:17:03.335298+0000","last_peered":"2023-10-06T03:17:03.335298+0000","last_clean":"2023-10-06T03:17:03.335298+0000","last_became_active":"2023-10-06T03:17:03.331129+0000","last_became_peered":"2023-10-06T03:17:03.331129+0000","last_unstale":"2023-10-06T03:17:03.335298+0000","last_undegraded":"2023-10-06T03:17:03.335298+0000","last_fullsized":"2023-10-06T03:17:03.335298+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.834084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"42'6","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.384833+0000","last_change":"2023-10-06T03:17:02.389103+0000","last_active":"2023-10-06T03:17:03.384833+0000","last_peered":"2023-10-06T03:17:03.384833+0000","last_clean":"2023-10-06T03:17:03.384833+0000","last_became_active":"2023-10-06T03:17:02.388790+0000","last_became_peered":"2023-10-06T03:17:02.388790+0000","last_unstale":"2023-10-06T03:17:03.384833+0000","last_undegraded":"2023-10-06T03:17:03.384833+0000","last_fullsized":"2023-10-06T03:17:03.384833+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:35.591643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340123+0000","last_change":"2023-10-06T03:17:03.336893+0000","last_active":"2023-10-06T03:17:03.340123+0000","last_peered":"2023-10-06T03:17:03.340123+0000","last_clean":"2023-10-06T03:17:03.340123+0000","last_became_active":"2023-10-06T03:17:03.336624+0000","last_became_peered":"2023-10-06T03:17:03.336624+0000","last_unstale":"2023-10-06T03:17:03.340123+0000","last_undegraded":"2023-10-06T03:17:03.340123+0000","last_fullsized":"2023-10-06T03:17:03.340123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.834084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.379609+0000","last_change":"2023-10-06T03:17:02.381134+0000","last_active":"2023-10-06T03:17:03.379609+0000","last_peered":"2023-10-06T03:17:03.379609+0000","last_clean":"2023-10-06T03:17:03.379609+0000","last_became_active":"2023-10-06T03:17:02.380858+0000","last_became_peered":"2023-10-06T03:17:02.380858+0000","last_unstale":"2023-10-06T03:17:03.379609+0000","last_undegraded":"2023-10-06T03:17:03.379609+0000","last_fullsized":"2023-10-06T03:17:03.379609+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:51.494869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338051+0000","last_change":"2023-10-06T03:17:03.338051+0000","last_active":"2023-10-06T03:17:03.338051+0000","last_peered":"2023-10-06T03:17:03.338051+0000","last_clean":"2023-10-06T03:17:03.338051+0000","last_became_active":"2023-10-06T03:17:03.337841+0000","last_became_peered":"2023-10-06T03:17:03.337841+0000","last_unstale":"2023-10-06T03:17:03.338051+0000","last_undegraded":"2023-10-06T03:17:03.338051+0000","last_fullsized":"2023-10-06T03:17:03.338051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:50.267717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.389171+0000","last_change":"2023-10-06T03:17:02.386920+0000","last_active":"2023-10-06T03:17:02.389171+0000","last_peered":"2023-10-06T03:17:02.389171+0000","last_clean":"2023-10-06T03:17:02.389171+0000","last_became_active":"2023-10-06T03:17:02.386635+0000","last_became_peered":"2023-10-06T03:17:02.386635+0000","last_unstale":"2023-10-06T03:17:02.389171+0000","last_undegraded":"2023-10-06T03:17:02.389171+0000","last_fullsized":"2023-10-06T03:17:02.389171+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:27.758855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.341933+0000","last_change":"2023-10-06T03:17:03.341933+0000","last_active":"2023-10-06T03:17:03.341933+0000","last_peered":"2023-10-06T03:17:03.341933+0000","last_clean":"2023-10-06T03:17:03.341933+0000","last_became_active":"2023-10-06T03:17:03.341677+0000","last_became_peered":"2023-10-06T03:17:03.341677+0000","last_unstale":"2023-10-06T03:17:03.341933+0000","last_undegraded":"2023-10-06T03:17:03.341933+0000","last_fullsized":"2023-10-06T03:17:03.341933+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:49.919676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.381360+0000","last_change":"2023-10-06T03:17:02.379740+0000","last_active":"2023-10-06T03:17:02.381360+0000","last_peered":"2023-10-06T03:17:02.381360+0000","last_clean":"2023-10-06T03:17:02.381360+0000","last_became_active":"2023-10-06T03:17:02.379463+0000","last_became_peered":"2023-10-06T03:17:02.379463+0000","last_unstale":"2023-10-06T03:17:02.381360+0000","last_undegraded":"2023-10-06T03:17:02.381360+0000","last_fullsized":"2023-10-06T03:17:02.381360+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:52.731116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335847+0000","last_change":"2023-10-06T03:17:03.335847+0000","last_active":"2023-10-06T03:17:03.335847+0000","last_peered":"2023-10-06T03:17:03.335847+0000","last_clean":"2023-10-06T03:17:03.335847+0000","last_became_active":"2023-10-06T03:17:03.335353+0000","last_became_peered":"2023-10-06T03:17:03.335353+0000","last_unstale":"2023-10-06T03:17:03.335847+0000","last_undegraded":"2023-10-06T03:17:03.335847+0000","last_fullsized":"2023-10-06T03:17:03.335847+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:23.230341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"42'8","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.383038+0000","last_change":"2023-10-06T03:17:02.381906+0000","last_active":"2023-10-06T03:17:03.383038+0000","last_peered":"2023-10-06T03:17:03.383038+0000","last_clean":"2023-10-06T03:17:03.383038+0000","last_became_active":"2023-10-06T03:17:02.381685+0000","last_became_peered":"2023-10-06T03:17:02.381685+0000","last_unstale":"2023-10-06T03:17:03.383038+0000","last_undegraded":"2023-10-06T03:17:03.383038+0000","last_fullsized":"2023-10-06T03:17:03.383038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:33.626668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.340565+0000","last_change":"2023-10-06T03:17:03.340565+0000","last_active":"2023-10-06T03:17:03.340565+0000","last_peered":"2023-10-06T03:17:03.340565+0000","last_clean":"2023-10-06T03:17:03.340565+0000","last_became_active":"2023-10-06T03:17:03.339209+0000","last_became_peered":"2023-10-06T03:17:03.339209+0000","last_unstale":"2023-10-06T03:17:03.340565+0000","last_undegraded":"2023-10-06T03:17:03.340565+0000","last_fullsized":"2023-10-06T03:17:03.340565+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:29.958504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328075+0000","last_change":"2023-10-06T03:17:02.385583+0000","last_active":"2023-10-06T03:17:03.328075+0000","last_peered":"2023-10-06T03:17:03.328075+0000","last_clean":"2023-10-06T03:17:03.328075+0000","last_became_active":"2023-10-06T03:17:02.385335+0000","last_became_peered":"2023-10-06T03:17:02.385335+0000","last_unstale":"2023-10-06T03:17:03.328075+0000","last_undegraded":"2023-10-06T03:17:03.328075+0000","last_fullsized":"2023-10-06T03:17:03.328075+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:34.663412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338196+0000","last_change":"2023-10-06T03:17:03.338196+0000","last_active":"2023-10-06T03:17:03.338196+0000","last_peered":"2023-10-06T03:17:03.338196+0000","last_clean":"2023-10-06T03:17:03.338196+0000","last_became_active":"2023-10-06T03:17:03.337957+0000","last_became_peered":"2023-10-06T03:17:03.337957+0000","last_unstale":"2023-10-06T03:17:03.338196+0000","last_undegraded":"2023-10-06T03:17:03.338196+0000","last_fullsized":"2023-10-06T03:17:03.338196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.475823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.381112+0000","last_change":"2023-10-06T03:17:02.380378+0000","last_active":"2023-10-06T03:17:03.381112+0000","last_peered":"2023-10-06T03:17:03.381112+0000","last_clean":"2023-10-06T03:17:03.381112+0000","last_became_active":"2023-10-06T03:17:02.380134+0000","last_became_peered":"2023-10-06T03:17:02.380134+0000","last_unstale":"2023-10-06T03:17:03.381112+0000","last_undegraded":"2023-10-06T03:17:03.381112+0000","last_fullsized":"2023-10-06T03:17:03.381112+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:30.506456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.341455+0000","last_change":"2023-10-06T03:17:03.339279+0000","last_active":"2023-10-06T03:17:03.341455+0000","last_peered":"2023-10-06T03:17:03.341455+0000","last_clean":"2023-10-06T03:17:03.341455+0000","last_became_active":"2023-10-06T03:17:03.338870+0000","last_became_peered":"2023-10-06T03:17:03.338870+0000","last_unstale":"2023-10-06T03:17:03.341455+0000","last_undegraded":"2023-10-06T03:17:03.341455+0000","last_fullsized":"2023-10-06T03:17:03.341455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:28.251742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328937+0000","last_change":"2023-10-06T03:17:02.385865+0000","last_active":"2023-10-06T03:17:03.328937+0000","last_peered":"2023-10-06T03:17:03.328937+0000","last_clean":"2023-10-06T03:17:03.328937+0000","last_became_active":"2023-10-06T03:17:02.385653+0000","last_became_peered":"2023-10-06T03:17:02.385653+0000","last_unstale":"2023-10-06T03:17:03.328937+0000","last_undegraded":"2023-10-06T03:17:03.328937+0000","last_fullsized":"2023-10-06T03:17:03.328937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:47.829218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334826+0000","last_change":"2023-10-06T03:17:03.334826+0000","last_active":"2023-10-06T03:17:03.334826+0000","last_peered":"2023-10-06T03:17:03.334826+0000","last_clean":"2023-10-06T03:17:03.334826+0000","last_became_active":"2023-10-06T03:17:03.334587+0000","last_became_peered":"2023-10-06T03:17:03.334587+0000","last_unstale":"2023-10-06T03:17:03.334826+0000","last_undegraded":"2023-10-06T03:17:03.334826+0000","last_fullsized":"2023-10-06T03:17:03.334826+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:57.951351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.386495+0000","last_change":"2023-10-06T03:17:02.382720+0000","last_active":"2023-10-06T03:17:02.386495+0000","last_peered":"2023-10-06T03:17:02.386495+0000","last_clean":"2023-10-06T03:17:02.386495+0000","last_became_active":"2023-10-06T03:17:02.382454+0000","last_became_peered":"2023-10-06T03:17:02.382454+0000","last_unstale":"2023-10-06T03:17:02.386495+0000","last_undegraded":"2023-10-06T03:17:02.386495+0000","last_fullsized":"2023-10-06T03:17:02.386495+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:00.291744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335132+0000","last_change":"2023-10-06T03:17:03.333237+0000","last_active":"2023-10-06T03:17:03.335132+0000","last_peered":"2023-10-06T03:17:03.335132+0000","last_clean":"2023-10-06T03:17:03.335132+0000","last_became_active":"2023-10-06T03:17:03.332968+0000","last_became_peered":"2023-10-06T03:17:03.332968+0000","last_unstale":"2023-10-06T03:17:03.335132+0000","last_undegraded":"2023-10-06T03:17:03.335132+0000","last_fullsized":"2023-10-06T03:17:03.335132+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:44.765153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.381177+0000","last_change":"2023-10-06T03:17:02.380310+0000","last_active":"2023-10-06T03:17:03.381177+0000","last_peered":"2023-10-06T03:17:03.381177+0000","last_clean":"2023-10-06T03:17:03.381177+0000","last_became_active":"2023-10-06T03:17:02.380074+0000","last_became_peered":"2023-10-06T03:17:02.380074+0000","last_unstale":"2023-10-06T03:17:03.381177+0000","last_undegraded":"2023-10-06T03:17:03.381177+0000","last_fullsized":"2023-10-06T03:17:03.381177+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:01.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.335914+0000","last_change":"2023-10-06T03:17:03.335914+0000","last_active":"2023-10-06T03:17:03.335914+0000","last_peered":"2023-10-06T03:17:03.335914+0000","last_clean":"2023-10-06T03:17:03.335914+0000","last_became_active":"2023-10-06T03:17:03.335675+0000","last_became_peered":"2023-10-06T03:17:03.335675+0000","last_unstale":"2023-10-06T03:17:03.335914+0000","last_undegraded":"2023-10-06T03:17:03.335914+0000","last_fullsized":"2023-10-06T03:17:03.335914+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:43.475823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388560+0000","last_change":"2023-10-06T03:17:02.381337+0000","last_active":"2023-10-06T03:17:02.388560+0000","last_peered":"2023-10-06T03:17:02.388560+0000","last_clean":"2023-10-06T03:17:02.388560+0000","last_became_active":"2023-10-06T03:17:02.381131+0000","last_became_peered":"2023-10-06T03:17:02.381131+0000","last_unstale":"2023-10-06T03:17:02.388560+0000","last_undegraded":"2023-10-06T03:17:02.388560+0000","last_fullsized":"2023-10-06T03:17:02.388560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:47.959809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342795+0000","last_change":"2023-10-06T03:17:03.342795+0000","last_active":"2023-10-06T03:17:03.342795+0000","last_peered":"2023-10-06T03:17:03.342795+0000","last_clean":"2023-10-06T03:17:03.342795+0000","last_became_active":"2023-10-06T03:17:03.342531+0000","last_became_peered":"2023-10-06T03:17:03.342531+0000","last_unstale":"2023-10-06T03:17:03.342795+0000","last_undegraded":"2023-10-06T03:17:03.342795+0000","last_fullsized":"2023-10-06T03:17:03.342795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:29.958504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388211+0000","last_change":"2023-10-06T03:17:02.382985+0000","last_active":"2023-10-06T03:17:02.388211+0000","last_peered":"2023-10-06T03:17:02.388211+0000","last_clean":"2023-10-06T03:17:02.388211+0000","last_became_active":"2023-10-06T03:17:02.382731+0000","last_became_peered":"2023-10-06T03:17:02.382731+0000","last_unstale":"2023-10-06T03:17:02.388211+0000","last_undegraded":"2023-10-06T03:17:02.388211+0000","last_fullsized":"2023-10-06T03:17:02.388211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.577407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337513+0000","last_change":"2023-10-06T03:17:03.337513+0000","last_active":"2023-10-06T03:17:03.337513+0000","last_peered":"2023-10-06T03:17:03.337513+0000","last_clean":"2023-10-06T03:17:03.337513+0000","last_became_active":"2023-10-06T03:17:03.337248+0000","last_became_peered":"2023-10-06T03:17:03.337248+0000","last_unstale":"2023-10-06T03:17:03.337513+0000","last_undegraded":"2023-10-06T03:17:03.337513+0000","last_fullsized":"2023-10-06T03:17:03.337513+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:11.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.326999+0000","last_change":"2023-10-06T03:17:02.380597+0000","last_active":"2023-10-06T03:17:03.326999+0000","last_peered":"2023-10-06T03:17:03.326999+0000","last_clean":"2023-10-06T03:17:03.326999+0000","last_became_active":"2023-10-06T03:17:02.379563+0000","last_became_peered":"2023-10-06T03:17:02.379563+0000","last_unstale":"2023-10-06T03:17:03.326999+0000","last_undegraded":"2023-10-06T03:17:03.326999+0000","last_fullsized":"2023-10-06T03:17:03.326999+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:36.559344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.337895+0000","last_change":"2023-10-06T03:17:03.337895+0000","last_active":"2023-10-06T03:17:03.337895+0000","last_peered":"2023-10-06T03:17:03.337895+0000","last_clean":"2023-10-06T03:17:03.337895+0000","last_became_active":"2023-10-06T03:17:03.337370+0000","last_became_peered":"2023-10-06T03:17:03.337370+0000","last_unstale":"2023-10-06T03:17:03.337895+0000","last_undegraded":"2023-10-06T03:17:03.337895+0000","last_fullsized":"2023-10-06T03:17:03.337895+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:58.240171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.394460+0000","last_change":"2023-10-06T03:17:02.383913+0000","last_active":"2023-10-06T03:17:02.394460+0000","last_peered":"2023-10-06T03:17:02.394460+0000","last_clean":"2023-10-06T03:17:02.394460+0000","last_became_active":"2023-10-06T03:17:02.383673+0000","last_became_peered":"2023-10-06T03:17:02.383673+0000","last_unstale":"2023-10-06T03:17:02.394460+0000","last_undegraded":"2023-10-06T03:17:02.394460+0000","last_fullsized":"2023-10-06T03:17:02.394460+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:57.283371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328676+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:17:03.328676+0000","last_peered":"2023-10-06T03:17:03.328676+0000","last_clean":"2023-10-06T03:17:03.328676+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:03.328676+0000","last_undegraded":"2023-10-06T03:17:03.328676+0000","last_fullsized":"2023-10-06T03:17:03.328676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.342052+0000","last_change":"2023-10-06T03:17:03.340382+0000","last_active":"2023-10-06T03:17:03.342052+0000","last_peered":"2023-10-06T03:17:03.342052+0000","last_clean":"2023-10-06T03:17:03.342052+0000","last_became_active":"2023-10-06T03:17:03.340126+0000","last_became_peered":"2023-10-06T03:17:03.340126+0000","last_unstale":"2023-10-06T03:17:03.342052+0000","last_undegraded":"2023-10-06T03:17:03.342052+0000","last_fullsized":"2023-10-06T03:17:03.342052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:34.932214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388719+0000","last_change":"2023-10-06T03:17:02.384377+0000","last_active":"2023-10-06T03:17:02.388719+0000","last_peered":"2023-10-06T03:17:02.388719+0000","last_clean":"2023-10-06T03:17:02.388719+0000","last_became_active":"2023-10-06T03:17:02.384138+0000","last_became_peered":"2023-10-06T03:17:02.384138+0000","last_unstale":"2023-10-06T03:17:02.388719+0000","last_undegraded":"2023-10-06T03:17:02.388719+0000","last_fullsized":"2023-10-06T03:17:02.388719+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:12.758816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.379895+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:17:02.379895+0000","last_peered":"2023-10-06T03:17:02.379895+0000","last_clean":"2023-10-06T03:17:02.379895+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:02.379895+0000","last_undegraded":"2023-10-06T03:17:02.379895+0000","last_fullsized":"2023-10-06T03:17:02.379895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.331928+0000","last_change":"2023-10-06T03:17:03.331928+0000","last_active":"2023-10-06T03:17:03.331928+0000","last_peered":"2023-10-06T03:17:03.331928+0000","last_clean":"2023-10-06T03:17:03.331928+0000","last_became_active":"2023-10-06T03:17:03.331682+0000","last_became_peered":"2023-10-06T03:17:03.331682+0000","last_unstale":"2023-10-06T03:17:03.331928+0000","last_undegraded":"2023-10-06T03:17:03.331928+0000","last_fullsized":"2023-10-06T03:17:03.331928+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:24.582718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388923+0000","last_change":"2023-10-06T03:17:02.382295+0000","last_active":"2023-10-06T03:17:02.388923+0000","last_peered":"2023-10-06T03:17:02.388923+0000","last_clean":"2023-10-06T03:17:02.388923+0000","last_became_active":"2023-10-06T03:17:02.382010+0000","last_became_peered":"2023-10-06T03:17:02.382010+0000","last_unstale":"2023-10-06T03:17:02.388923+0000","last_undegraded":"2023-10-06T03:17:02.388923+0000","last_fullsized":"2023-10-06T03:17:02.388923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:44.451863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.385777+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:17:02.385777+0000","last_peered":"2023-10-06T03:17:02.385777+0000","last_clean":"2023-10-06T03:17:02.385777+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:02.385777+0000","last_undegraded":"2023-10-06T03:17:02.385777+0000","last_fullsized":"2023-10-06T03:17:02.385777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.371321+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:17:02.371321+0000","last_peered":"2023-10-06T03:17:02.371321+0000","last_clean":"2023-10-06T03:17:02.371321+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:17:02.371321+0000","last_undegraded":"2023-10-06T03:17:02.371321+0000","last_fullsized":"2023-10-06T03:17:02.371321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.334060+0000","last_change":"2023-10-06T03:17:03.334060+0000","last_active":"2023-10-06T03:17:03.334060+0000","last_peered":"2023-10-06T03:17:03.334060+0000","last_clean":"2023-10-06T03:17:03.334060+0000","last_became_active":"2023-10-06T03:17:03.333513+0000","last_became_peered":"2023-10-06T03:17:03.333513+0000","last_unstale":"2023-10-06T03:17:03.334060+0000","last_undegraded":"2023-10-06T03:17:03.334060+0000","last_fullsized":"2023-10-06T03:17:03.334060+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.834084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388072+0000","last_change":"2023-10-06T03:17:02.382216+0000","last_active":"2023-10-06T03:17:02.388072+0000","last_peered":"2023-10-06T03:17:02.388072+0000","last_clean":"2023-10-06T03:17:02.388072+0000","last_became_active":"2023-10-06T03:17:02.381944+0000","last_became_peered":"2023-10-06T03:17:02.381944+0000","last_unstale":"2023-10-06T03:17:02.388072+0000","last_undegraded":"2023-10-06T03:17:02.388072+0000","last_fullsized":"2023-10-06T03:17:02.388072+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:52.731116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.371644+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:17:02.371644+0000","last_peered":"2023-10-06T03:17:02.371644+0000","last_clean":"2023-10-06T03:17:02.371644+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:02.371644+0000","last_undegraded":"2023-10-06T03:17:02.371644+0000","last_fullsized":"2023-10-06T03:17:02.371644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338003+0000","last_change":"2023-10-06T03:17:03.338003+0000","last_active":"2023-10-06T03:17:03.338003+0000","last_peered":"2023-10-06T03:17:03.338003+0000","last_clean":"2023-10-06T03:17:03.338003+0000","last_became_active":"2023-10-06T03:17:03.335333+0000","last_became_peered":"2023-10-06T03:17:03.335333+0000","last_unstale":"2023-10-06T03:17:03.338003+0000","last_undegraded":"2023-10-06T03:17:03.338003+0000","last_fullsized":"2023-10-06T03:17:03.338003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:11.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.388244+0000","last_change":"2023-10-06T03:17:02.384639+0000","last_active":"2023-10-06T03:17:02.388244+0000","last_peered":"2023-10-06T03:17:02.388244+0000","last_clean":"2023-10-06T03:17:02.388244+0000","last_became_active":"2023-10-06T03:17:02.384395+0000","last_became_peered":"2023-10-06T03:17:02.384395+0000","last_unstale":"2023-10-06T03:17:02.388244+0000","last_undegraded":"2023-10-06T03:17:02.388244+0000","last_fullsized":"2023-10-06T03:17:02.388244+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:26.701467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.371227+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:17:02.371227+0000","last_peered":"2023-10-06T03:17:02.371227+0000","last_clean":"2023-10-06T03:17:02.371227+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:02.371227+0000","last_undegraded":"2023-10-06T03:17:02.371227+0000","last_fullsized":"2023-10-06T03:17:02.371227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.338171+0000","last_change":"2023-10-06T03:17:03.333830+0000","last_active":"2023-10-06T03:17:03.338171+0000","last_peered":"2023-10-06T03:17:03.338171+0000","last_clean":"2023-10-06T03:17:03.338171+0000","last_became_active":"2023-10-06T03:17:03.333467+0000","last_became_peered":"2023-10-06T03:17:03.333467+0000","last_unstale":"2023-10-06T03:17:03.338171+0000","last_undegraded":"2023-10-06T03:17:03.338171+0000","last_fullsized":"2023-10-06T03:17:03.338171+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:28.251742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.379819+0000","last_change":"2023-10-06T03:17:02.386354+0000","last_active":"2023-10-06T03:17:03.379819+0000","last_peered":"2023-10-06T03:17:03.379819+0000","last_clean":"2023-10-06T03:17:03.379819+0000","last_became_active":"2023-10-06T03:17:02.386102+0000","last_became_peered":"2023-10-06T03:17:02.386102+0000","last_unstale":"2023-10-06T03:17:03.379819+0000","last_undegraded":"2023-10-06T03:17:03.379819+0000","last_fullsized":"2023-10-06T03:17:03.379819+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:00.894415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.326370+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:17:03.326370+0000","last_peered":"2023-10-06T03:17:03.326370+0000","last_clean":"2023-10-06T03:17:03.326370+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:03.326370+0000","last_undegraded":"2023-10-06T03:17:03.326370+0000","last_fullsized":"2023-10-06T03:17:03.326370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.333166+0000","last_change":"2023-10-06T03:17:03.333166+0000","last_active":"2023-10-06T03:17:03.333166+0000","last_peered":"2023-10-06T03:17:03.333166+0000","last_clean":"2023-10-06T03:17:03.333166+0000","last_became_active":"2023-10-06T03:17:03.332921+0000","last_became_peered":"2023-10-06T03:17:03.332921+0000","last_unstale":"2023-10-06T03:17:03.333166+0000","last_undegraded":"2023-10-06T03:17:03.333166+0000","last_fullsized":"2023-10-06T03:17:03.333166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:23.230341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.328123+0000","last_change":"2023-10-06T03:17:02.386740+0000","last_active":"2023-10-06T03:17:03.328123+0000","last_peered":"2023-10-06T03:17:03.328123+0000","last_clean":"2023-10-06T03:17:03.328123+0000","last_became_active":"2023-10-06T03:17:02.386447+0000","last_became_peered":"2023-10-06T03:17:02.386447+0000","last_unstale":"2023-10-06T03:17:03.328123+0000","last_undegraded":"2023-10-06T03:17:03.328123+0000","last_fullsized":"2023-10-06T03:17:03.328123+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:52.731116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.375655+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:17:02.375655+0000","last_peered":"2023-10-06T03:17:02.375655+0000","last_clean":"2023-10-06T03:17:02.375655+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:02.375655+0000","last_undegraded":"2023-10-06T03:17:02.375655+0000","last_fullsized":"2023-10-06T03:17:02.375655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.333369+0000","last_change":"2023-10-06T03:17:03.333369+0000","last_active":"2023-10-06T03:17:03.333369+0000","last_peered":"2023-10-06T03:17:03.333369+0000","last_clean":"2023-10-06T03:17:03.333369+0000","last_became_active":"2023-10-06T03:17:03.332294+0000","last_became_peered":"2023-10-06T03:17:03.332294+0000","last_unstale":"2023-10-06T03:17:03.333369+0000","last_undegraded":"2023-10-06T03:17:03.333369+0000","last_fullsized":"2023-10-06T03:17:03.333369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:02.358058+0000","last_clean_scrub_stamp":"2023-10-06T03:17:02.358058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:43.561513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:17:03.327271+0000","last_change":"2023-10-06T03:17:02.379303+0000","last_active":"2023-10-06T03:17:03.327271+0000","last_peered":"2023-10-06T03:17:03.327271+0000","last_clean":"2023-10-06T03:17:03.327271+0000","last_became_active":"2023-10-06T03:17:02.379014+0000","last_became_peered":"2023-10-06T03:17:02.379014+0000","last_unstale":"2023-10-06T03:17:03.327271+0000","last_undegraded":"2023-10-06T03:17:03.327271+0000","last_fullsized":"2023-10-06T03:17:03.327271+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:01.352747+0000","last_clean_scrub_stamp":"2023-10-06T03:17:01.352747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:12.758816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:17:02.375889+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:17:02.375889+0000","last_peered":"2023-10-06T03:17:02.375889+0000","last_clean":"2023-10-06T03:17:02.375889+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:02.375889+0000","last_undegraded":"2023-10-06T03:17:02.375889+0000","last_fullsized":"2023-10-06T03:17:02.375889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":796240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":206372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.622},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":797629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.248},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.375},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.26000000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.439},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.501},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":205804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.31},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.252}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.438}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.497},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.44800000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":207284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.376}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.625},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":207306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.315}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.6960000000000002,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":207655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.437},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42099999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39800000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":207101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:17:07.794 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:17:07.794 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:17:07.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.950+0000 7f74c9136700 1 Processor -- start 2023-10-06T03:17:07.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.950+0000 7f74c9136700 1 -- start start 2023-10-06T03:17:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c9136700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c4069b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c9136700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74c4142a60 0x7f74c4142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c9136700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c4069700 con 0x7f74c415d3f0 2023-10-06T03:17:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c9136700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40690f0 con 0x7f74c4142a60 2023-10-06T03:17:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c9136700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40b60a0 con 0x7f74c415d7c0 2023-10-06T03:17:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c8935700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74c4142a60 0x7f74c4142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c8935700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74c4142a60 0x7f74c4142ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52124/0 (socket says 172.21.15.82:52124) 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c8935700 1 -- 172.21.15.82:0/3714916958 learned_addr learned my addr 172.21.15.82:0/3714916958 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c37fe700 1 --2- 172.21.15.82:0/3714916958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c4069b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c8935700 1 -- 172.21.15.82:0/3714916958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 msgr2=0x7f74c4069b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c8935700 1 --2- 172.21.15.82:0/3714916958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c4069b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c8935700 1 -- 172.21.15.82:0/3714916958 >> v1:172.21.15.134:6789/0 conn(0x7f74c415d3f0 legacy=0x7f74c40b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c8935700 1 -- 172.21.15.82:0/3714916958 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4069390 con 0x7f74c4142a60 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c37fe700 1 --2- 172.21.15.82:0/3714916958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c4069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c8935700 1 --2- 172.21.15.82:0/3714916958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c4142a60 0x7f74c4142ee0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009f20 tx=0x7f74bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163dddb2165483eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c2ffd700 1 -- 172.21.15.82:0/3714916958 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00e070 con 0x7f74c4142a60 2023-10-06T03:17:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c2ffd700 1 -- 172.21.15.82:0/3714916958 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc00ba80 con 0x7f74c4142a60 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.951+0000 7f74c2ffd700 1 -- 172.21.15.82:0/3714916958 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0092e0 con 0x7f74c4142a60 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.952+0000 7f74c9136700 1 -- 172.21.15.82:0/3714916958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c4142a60 msgr2=0x7f74c4142ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.952+0000 7f74c9136700 1 --2- 172.21.15.82:0/3714916958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c4142a60 0x7f74c4142ee0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009f20 tx=0x7f74bc009840 comp rx=0 tx=0).stop 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.952+0000 7f74c9136700 1 -- 172.21.15.82:0/3714916958 shutdown_connections 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.952+0000 7f74c9136700 1 --2- 172.21.15.82:0/3714916958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c4142a60 0x7f74c4142ee0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.952+0000 7f74c9136700 1 --2- 172.21.15.82:0/3714916958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c4069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.952+0000 7f74c9136700 1 -- 172.21.15.82:0/3714916958 >> 172.21.15.82:0/3714916958 conn(0x7f74c40ccf70 msgr2=0x7f74c40cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.952+0000 7f74c9136700 1 -- 172.21.15.82:0/3714916958 shutdown_connections 2023-10-06T03:17:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.952+0000 7f74c9136700 1 -- 172.21.15.82:0/3714916958 wait complete. 2023-10-06T03:17:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.953+0000 7f74c9136700 1 Processor -- start 2023-10-06T03:17:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.953+0000 7f74c9136700 1 -- start start 2023-10-06T03:17:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c9136700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c4142a60 0x7f74c4134740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c9136700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c415d3f0 0x7f74c40cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c9136700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c40cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c9136700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40cc2a0 con 0x7f74c415d3f0 2023-10-06T03:17:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c9136700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40cb690 con 0x7f74c4142a60 2023-10-06T03:17:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c9136700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40cb970 con 0x7f74c415d7c0 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c415d3f0 0x7f74c40cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c415d3f0 0x7f74c40cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52138/0 (socket says 172.21.15.82:52138) 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 -- 172.21.15.82:0/1381482429 learned_addr learned my addr 172.21.15.82:0/1381482429 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 -- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 msgr2=0x7f74c40cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c8935700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c40cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c40cfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 -- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c4142a60 msgr2=0x7f74c4134740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c4142a60 0x7f74c4134740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 -- 172.21.15.82:0/1381482429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc009ae0 con 0x7f74c415d3f0 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.954+0000 7f74c37fe700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c415d3f0 0x7f74c40cf920 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f74b400d860 tx=0x7f74b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.955+0000 7f74abfff700 1 -- 172.21.15.82:0/1381482429 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b40125f0 con 0x7f74c415d3f0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.955+0000 7f74abfff700 1 -- 172.21.15.82:0/1381482429 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4012750 con 0x7f74c415d3f0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.955+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c40cbc50 con 0x7f74c415d3f0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.955+0000 7f74abfff700 1 -- 172.21.15.82:0/1381482429 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4012ad0 con 0x7f74c415d3f0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.955+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c40ca880 con 0x7f74c415d3f0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.955+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c404c3c0 con 0x7f74c415d3f0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.956+0000 7f74abfff700 1 -- 172.21.15.82:0/1381482429 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74b4014430 con 0x7f74c415d3f0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.956+0000 7f74abfff700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f74b0066f30 0x7f74b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.956+0000 7f74abfff700 1 -- 172.21.15.82:0/1381482429 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74b4084b20 con 0x7f74c415d3f0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.956+0000 7f74c3fff700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f74b0066f30 0x7f74b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.957+0000 7f74c3fff700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f74b0066f30 0x7f74b00693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f74b8001730 tx=0x7f74b8007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:07.960+0000 7f74abfff700 1 -- 172.21.15.82:0/1381482429 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74b4051c30 con 0x7f74c415d3f0 2023-10-06T03:17:08.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.215+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f74c4143420 con 0x7f74c415d3f0 2023-10-06T03:17:08.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.218+0000 7f74abfff700 1 -- 172.21.15.82:0/1381482429 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f74b4055250 con 0x7f74c415d3f0 2023-10-06T03:17:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f74b0066f30 msgr2=0x7f74b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f74b0066f30 0x7f74b00693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f74b8001730 tx=0x7f74b8007b40 comp rx=0 tx=0).stop 2023-10-06T03:17:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c415d3f0 msgr2=0x7f74c40cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c415d3f0 0x7f74c40cf920 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f74b400d860 tx=0x7f74b4008040 comp rx=0 tx=0).stop 2023-10-06T03:17:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 shutdown_connections 2023-10-06T03:17:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f74b0066f30 0x7f74b00693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74c415d7c0 0x7f74c40cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c4142a60 0x7f74c4134740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 --2- 172.21.15.82:0/1381482429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c415d3f0 0x7f74c40cf920 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.220+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 >> 172.21.15.82:0/1381482429 conn(0x7f74c40ccf70 msgr2=0x7f74c41406c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:08.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.221+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 shutdown_connections 2023-10-06T03:17:08.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.221+0000 7f74c9136700 1 -- 172.21.15.82:0/1381482429 wait complete. 2023-10-06T03:17:08.223 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-10-06T03:17:08.233 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:08.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.347+0000 7f99febb5700 1 Processor -- start 2023-10-06T03:17:08.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.347+0000 7f99febb5700 1 -- start start 2023-10-06T03:17:08.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99febb5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99f815d560 0x7f99f80d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:08.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99febb5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99f815d930 0x7f99f80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:08.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99febb5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f80b2ad0 con 0x7f99f81591b0 2023-10-06T03:17:08.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99febb5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f80b4160 con 0x7f99f815d560 2023-10-06T03:17:08.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99febb5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f80b1f80 con 0x7f99f815d930 2023-10-06T03:17:08.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99fc951700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99f815d560 0x7f99f80d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99fd152700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f99f81591b0 0x7f99f8159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43166/0 (socket says 172.21.15.82:43166) 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99fd152700 1 -- 172.21.15.82:0/579363152 learned_addr learned my addr 172.21.15.82:0/579363152 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99f7fff700 1 --2- 172.21.15.82:0/579363152 >> v2:172.21.15.134:3300/0 conn(0x7f99f815d930 0x7f99f80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.348+0000 7f99fc951700 1 -- 172.21.15.82:0/579363152 >> v2:172.21.15.134:3300/0 conn(0x7f99f815d930 msgr2=0x7f99f80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99fc951700 1 --2- 172.21.15.82:0/579363152 >> v2:172.21.15.134:3300/0 conn(0x7f99f815d930 0x7f99f80b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99fc951700 1 -- 172.21.15.82:0/579363152 >> v1:172.21.15.82:6789/0 conn(0x7f99f81591b0 legacy=0x7f99f8159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99f77fe700 1 -- 172.21.15.82:0/579363152 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797770084 0 0) 0x7f99f80b2ad0 con 0x7f99f81591b0 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99fc951700 1 -- 172.21.15.82:0/579363152 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80b2230 con 0x7f99f815d560 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99fc951700 1 --2- 172.21.15.82:0/579363152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f80d0030 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f99f815e440 tx=0x7f99ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1eeba50988ed89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99f77fe700 1 -- 172.21.15.82:0/579363152 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00b6b0 con 0x7f99f815d560 2023-10-06T03:17:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99f77fe700 1 -- 172.21.15.82:0/579363152 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec00b810 con 0x7f99f815d560 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99f77fe700 1 -- 172.21.15.82:0/579363152 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00bbb0 con 0x7f99f815d560 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99febb5700 1 -- 172.21.15.82:0/579363152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 msgr2=0x7f99f80d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99febb5700 1 --2- 172.21.15.82:0/579363152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f80d0030 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f99f815e440 tx=0x7f99ec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99febb5700 1 -- 172.21.15.82:0/579363152 shutdown_connections 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99febb5700 1 --2- 172.21.15.82:0/579363152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f80d0030 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99febb5700 1 --2- 172.21.15.82:0/579363152 >> v2:172.21.15.134:3300/0 conn(0x7f99f815d930 0x7f99f80b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99febb5700 1 -- 172.21.15.82:0/579363152 >> 172.21.15.82:0/579363152 conn(0x7f99f80d1180 msgr2=0x7f99f8069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99febb5700 1 -- 172.21.15.82:0/579363152 shutdown_connections 2023-10-06T03:17:08.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.349+0000 7f99febb5700 1 -- 172.21.15.82:0/579363152 wait complete. 2023-10-06T03:17:08.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.350+0000 7f99febb5700 1 Processor -- start 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99febb5700 1 -- start start 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99febb5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99f81591b0 0x7f99f814f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99febb5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f8150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99febb5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99f815d930 0x7f99f81540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99febb5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f81502a0 con 0x7f99f815d560 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99febb5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8157670 con 0x7f99f815d930 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99febb5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f814fc50 con 0x7f99f81591b0 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99f7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f8150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.351+0000 7f99f7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f8150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52150/0 (socket says 172.21.15.82:52150) 2023-10-06T03:17:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f7fff700 1 -- 172.21.15.82:0/1194893194 learned_addr learned my addr 172.21.15.82:0/1194893194 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f7fff700 1 -- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99f81591b0 msgr2=0x7f99f814f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f7fff700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99f81591b0 0x7f99f814f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f7fff700 1 -- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99f815d930 msgr2=0x7f99f81540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f7fff700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99f815d930 0x7f99f81540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f7fff700 1 -- 172.21.15.82:0/1194893194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec009420 con 0x7f99f815d560 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f7fff700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f8150730 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c7d0 tx=0x7f99e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f4ff9700 1 -- 172.21.15.82:0/1194893194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4011600 con 0x7f99f815d560 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f4ff9700 1 -- 172.21.15.82:0/1194893194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e4011760 con 0x7f99f815d560 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f814ff30 con 0x7f99f815d560 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99f4ff9700 1 -- 172.21.15.82:0/1194893194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4011b00 con 0x7f99f815d560 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.352+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f8150e30 con 0x7f99f815d560 2023-10-06T03:17:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.353+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f814fab0 con 0x7f99f815d560 2023-10-06T03:17:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.353+0000 7f99f4ff9700 1 -- 172.21.15.82:0/1194893194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99e40193f0 con 0x7f99f815d560 2023-10-06T03:17:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.354+0000 7f99f4ff9700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f99dc066fb0 0x7f99dc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.354+0000 7f99f4ff9700 1 -- 172.21.15.82:0/1194893194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f99e4084a90 con 0x7f99f815d560 2023-10-06T03:17:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.354+0000 7f99fc951700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f99dc066fb0 0x7f99dc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.355+0000 7f99fc951700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f99dc066fb0 0x7f99dc069460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0091e0 tx=0x7f99ec017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.358+0000 7f99f4ff9700 1 -- 172.21.15.82:0/1194893194 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f814fab0 con 0x7f99f815d560 2023-10-06T03:17:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.586+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99f814fab0 con 0x7f99f815d560 2023-10-06T03:17:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.587+0000 7f99f4ff9700 1 -- 172.21.15.82:0/1194893194 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f99f814fab0 con 0x7f99f815d560 2023-10-06T03:17:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:08.588 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2460851709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2460851709},{"type":"v1","addr":"172.21.15.134:6837","nonce":2460851709}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/771524024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":771524024},{"type":"v1","addr":"172.21.15.134:6836","nonce":771524024}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/3256175471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3256175471},{"type":"v1","addr":"172.21.15.82:6834","nonce":3256175471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:02.753418+0000","modified":"2023-10-06T03:17:06.382667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1910803570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1910803570},{"type":"v1","addr":"172.21.15.82:6835","nonce":1910803570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f99dc066fb0 msgr2=0x7f99dc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f99dc066fb0 0x7f99dc069460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0091e0 tx=0x7f99ec017000 comp rx=0 tx=0).stop 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 msgr2=0x7f99f8150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f8150730 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c7d0 tx=0x7f99e4008040 comp rx=0 tx=0).stop 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 shutdown_connections 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99f815d930 0x7f99f81540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f99dc066fb0 0x7f99dc069460 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99f81591b0 0x7f99f814f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 --2- 172.21.15.82:0/1194893194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99f815d560 0x7f99f8150730 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 >> 172.21.15.82:0/1194893194 conn(0x7f99f80d1180 msgr2=0x7f99f8068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 shutdown_connections 2023-10-06T03:17:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:08.589+0000 7f99febb5700 1 -- 172.21.15.82:0/1194893194 wait complete. 2023-10-06T03:17:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2023-10-06T03:17:09.003 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:17:02.753418+0000', 'modified': '2023-10-06T03:17:06.382667+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5403}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5403': {'gid': 5403, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6835/1910803570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6833', 'nonce': 1910803570}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 1910803570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:17:09.004 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:17:09.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:17:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.119+0000 7fe5c680b700 1 Processor -- start 2023-10-06T03:17:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.119+0000 7fe5c680b700 1 -- start start 2023-10-06T03:17:09.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c680b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c015de80 0x7fe5c00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c680b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5c00b61d0 0x7fe5c015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c680b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c0069380 con 0x7fe5c0142e90 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c680b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c0069f20 con 0x7fe5c00b61d0 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c680b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0068770 con 0x7fe5c015de80 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c5809700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe5c0142e90 0x7fe5c0069810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43172/0 (socket says 172.21.15.82:43172) 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c5809700 1 -- 172.21.15.82:0/13030855 learned_addr learned my addr 172.21.15.82:0/13030855 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c5008700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c015de80 0x7fe5c00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c600a700 1 --2- 172.21.15.82:0/13030855 >> v2:172.21.15.134:3300/0 conn(0x7fe5c00b61d0 0x7fe5c015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134391132 0 0) 0x7fe5c0069380 con 0x7fe5c0142e90 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5ac003570 con 0x7fe5c0142e90 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 539190784 0 0) 0x7fe5ac003570 con 0x7fe5c0142e90 2023-10-06T03:17:09.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c015de80 msgr2=0x7fe5c00b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c015de80 0x7fe5c00b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 >> v2:172.21.15.134:3300/0 conn(0x7fe5c00b61d0 msgr2=0x7fe5c015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 --2- 172.21.15.82:0/13030855 >> v2:172.21.15.134:3300/0 conn(0x7fe5c00b61d0 0x7fe5c015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0068a50 con 0x7fe5c0142e90 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fe5bc001470 con 0x7fe5c0142e90 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 >> v1:172.21.15.82:6789/0 conn(0x7fe5c0142e90 legacy=0x7fe5c0069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac003a60 0x7fe5ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5ac004810 0x7fe5ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c015de80 0x7fe5ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0069f20 con 0x7fe5ac004810 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0068770 con 0x7fe5ac003a60 2023-10-06T03:17:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.120+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac00ba60 con 0x7fe5c015de80 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c5008700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5ac004810 0x7fe5ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c5809700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac003a60 0x7fe5ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c600a700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c015de80 0x7fe5ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c5008700 1 -- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c015de80 msgr2=0x7fe5ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c5008700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c015de80 0x7fe5ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c5008700 1 -- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac003a60 msgr2=0x7fe5ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c5008700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac003a60 0x7fe5ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c5008700 1 -- 172.21.15.82:0/13030855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac003570 con 0x7fe5ac004810 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c5008700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5ac004810 0x7fe5ac004c80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009c00 tx=0x7fe5b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597f505a84ecec0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000e710 con 0x7fe5ac004810 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000e870 con 0x7fe5ac004810 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.121+0000 7fe5c4807700 1 -- 172.21.15.82:0/13030855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000ec30 con 0x7fe5ac004810 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.122+0000 7fe5c680b700 1 -- 172.21.15.82:0/13030855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5ac004810 msgr2=0x7fe5ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.122+0000 7fe5c680b700 1 --2- 172.21.15.82:0/13030855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5ac004810 0x7fe5ac004c80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009c00 tx=0x7fe5b00091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.122+0000 7fe5c600a700 1 -- 172.21.15.82:0/13030855 reap_dead start 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.122+0000 7fe5c680b700 1 -- 172.21.15.82:0/13030855 shutdown_connections 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.122+0000 7fe5c680b700 1 -- 172.21.15.82:0/13030855 >> 172.21.15.82:0/13030855 conn(0x7fe5c00ccfe0 msgr2=0x7fe5c00cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.122+0000 7fe5c680b700 1 -- 172.21.15.82:0/13030855 shutdown_connections 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.122+0000 7fe5c680b700 1 -- 172.21.15.82:0/13030855 wait complete. 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.123+0000 7fe5c680b700 1 Processor -- start 2023-10-06T03:17:09.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.123+0000 7fe5c680b700 1 -- start start 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.123+0000 7fe5c680b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac004810 0x7fe5c0131900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.123+0000 7fe5c680b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c00b12b0 0x7fe5c00b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.123+0000 7fe5c680b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c00cb220 0x7fe5c00cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c680b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0132d60 con 0x7fe5c00b12b0 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c680b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00b1c60 con 0x7fe5ac004810 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c680b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0131e40 con 0x7fe5c00cb220 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c00b12b0 0x7fe5c00b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c00b12b0 0x7fe5c00b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52170/0 (socket says 172.21.15.82:52170) 2023-10-06T03:17:09.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 -- 172.21.15.82:0/1489268039 learned_addr learned my addr 172.21.15.82:0/1489268039 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5809700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac004810 0x7fe5c0131900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c600a700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c00cb220 0x7fe5c00cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 -- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c00cb220 msgr2=0x7fe5c00cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c00cb220 0x7fe5c00cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 -- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac004810 msgr2=0x7fe5c0131900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac004810 0x7fe5c0131900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 -- 172.21.15.82:0/1489268039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c01320e0 con 0x7fe5c00b12b0 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c5008700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c00b12b0 0x7fe5c00b1720 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000e4b0 tx=0x7fe5b001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5b5ffb700 1 -- 172.21.15.82:0/1489268039 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0023070 con 0x7fe5c00b12b0 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5b5ffb700 1 -- 172.21.15.82:0/1489268039 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000e9e0 con 0x7fe5c00b12b0 2023-10-06T03:17:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c680b700 1 -- 172.21.15.82:0/1489268039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c01323c0 con 0x7fe5c00b12b0 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5b5ffb700 1 -- 172.21.15.82:0/1489268039 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000e710 con 0x7fe5c00b12b0 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.124+0000 7fe5c680b700 1 -- 172.21.15.82:0/1489268039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c0132980 con 0x7fe5c00b12b0 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.126+0000 7fe5b5ffb700 1 -- 172.21.15.82:0/1489268039 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5b0013470 con 0x7fe5c00b12b0 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.126+0000 7fe5b5ffb700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe5a4066f30 0x7fe5a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.126+0000 7fe5b5ffb700 1 -- 172.21.15.82:0/1489268039 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5b0085b60 con 0x7fe5c00b12b0 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.126+0000 7fe5c5809700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe5a4066f30 0x7fe5a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.127+0000 7fe5c5809700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe5a4066f30 0x7fe5a40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc007f50 tx=0x7fe5bc001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.128+0000 7fe5d0d65b80 1 Processor -- start 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.128+0000 7fe5d0d65b80 1 -- start start 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 0x55f926bd6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdc2c0 0x55f926bd7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdda10 0x55f926bd7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f926b31a70 con 0x55f926bdda10 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f926b2f270 con 0x55f926bfbe50 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f926b2b060 con 0x55f926bdc2c0 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdda10 0x55f926bd7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdda10 0x55f926bd7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52186/0 (socket says 172.21.15.82:52186) 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 -- 172.21.15.82:0/885082311 learned_addr learned my addr 172.21.15.82:0/885082311 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c5809700 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 0x55f926bd6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c5008700 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdc2c0 0x55f926bd7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 -- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdc2c0 msgr2=0x55f926bd7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdc2c0 0x55f926bd7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 -- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 msgr2=0x55f926bd6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 0x55f926bd6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 -- 172.21.15.82:0/885082311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9269c5270 con 0x55f926bdda10 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c5809700 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 0x55f926bd6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5c600a700 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdda10 0x55f926bd7740 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80094d0 tx=0x7fe5b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dd383a47b895d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5aaffd700 1 -- 172.21.15.82:0/885082311 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800e040 con 0x55f926bdda10 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5aaffd700 1 -- 172.21.15.82:0/885082311 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b800f040 con 0x55f926bdda10 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.129+0000 7fe5aaffd700 1 -- 172.21.15.82:0/885082311 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b801e670 con 0x55f926bdda10 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/885082311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdda10 msgr2=0x55f926bd7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdda10 0x55f926bd7740 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80094d0 tx=0x7fe5b800b040 comp rx=0 tx=0).stop 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/885082311 shutdown_connections 2023-10-06T03:17:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdda10 0x55f926bd7740 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 0x55f926bd6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/885082311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdc2c0 0x55f926bd7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/885082311 >> 172.21.15.82:0/885082311 conn(0x55f926bdbe80 msgr2=0x55f926bdc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/885082311 shutdown_connections 2023-10-06T03:17:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.130+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/885082311 wait complete. 2023-10-06T03:17:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.131+0000 7fe5d0d65b80 1 -- start start 2023-10-06T03:17:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.131+0000 7fe5d0d65b80 1 Processor -- start 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926bfcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdda10 0x55f926c21940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bfbe50 0x55f926c21e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f926ad6890 con 0x55f926bdc2c0 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f926af1ea0 con 0x55f926bdda10 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9269ade30 con 0x55f926bfbe50 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5d0d65b80 10 client.0 _ll_register_callbacks cb 0x55f926b9e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926bfcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926bfcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52188/0 (socket says 172.21.15.82:52188) 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 -- 172.21.15.82:0/4186326995 learned_addr learned my addr 172.21.15.82:0/4186326995 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c600a700 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bfbe50 0x55f926c21e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5008700 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdda10 0x55f926c21940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 -- 172.21.15.82:0/4186326995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bfbe50 msgr2=0x55f926c21e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bfbe50 0x55f926c21e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 -- 172.21.15.82:0/4186326995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdda10 msgr2=0x55f926c21940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdda10 0x55f926c21940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 -- 172.21.15.82:0/4186326995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f926967fe0 con 0x55f926bdc2c0 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5c5809700 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926bfcb70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc015b70 tx=0x7fe5bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ed2e4b9741c274 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe59ffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-10-06T03:17:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe59ffff700 1 -- 172.21.15.82:0/4186326995 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc01a040 con 0x55f926bdc2c0 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe59ffff700 1 -- 172.21.15.82:0/4186326995 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5bc024c60 con 0x55f926bdc2c0 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.132+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4186326995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f926bcf940 con 0x55f926bdc2c0 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe59ffff700 1 -- 172.21.15.82:0/4186326995 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5bc007890 con 0x55f926bdc2c0 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5d0d65b80 10 client.5550 fetch_fsmap learned FSMap version 23 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4186326995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55f926af9780 con 0x55f926bdc2c0 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe59ffff700 1 -- 172.21.15.82:0/4186326995 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f926bcf940 con 0x55f926bdc2c0 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe59ffff700 1 -- 172.21.15.82:0/4186326995 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe5bc020050 con 0x55f926bdc2c0 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5d0d65b80 10 client.5550 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5d0d65b80 10 client.5550 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5d0d65b80 20 client.5550 populate_metadata read hostname 'smithi082' 2023-10-06T03:17:09.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] conn(0x55f926c25330 0x55f926c25700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5d0d65b80 4 client.5550 mds_command: new command op to 5403 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4186326995 --> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f926bac870 con 0x55f926c25330 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5c5008700 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] conn(0x55f926c25330 0x55f926c25700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe59ffff700 10 client.5550 ms_handle_connect on v2:172.21.15.82:6833/1910803570 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.133+0000 7fe5c5008700 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] conn(0x55f926c25330 0x55f926c25700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb8dc9be253c4ead server_cookie=1c71e1087f12c4c9 in_seq=0 out_seq=0 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe59ffff700 1 -- 172.21.15.82:0/4186326995 <== mds.0 v2:172.21.15.82:6833/1910803570 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f926bac870 con 0x55f926c25330 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe59ffff700 10 client.5550 handle_command_reply: tid=0 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 client.5550 shutdown 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4186326995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 msgr2=0x55f926bfcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926bfcb70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc015b70 tx=0x7fe5bc017000 comp rx=0 tx=0).stop 2023-10-06T03:17:09.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4186326995 shutdown_connections 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] conn(0x55f926c25330 0x55f926c25700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bfbe50 0x55f926c21e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926bfcb70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe59ffff700 0 client.5550 ms_handle_reset on v2:172.21.15.82:6833/1910803570 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4186326995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdda10 0x55f926c21940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4186326995 >> 172.21.15.82:0/4186326995 conn(0x55f926bdbe80 msgr2=0x55f926bdad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4186326995 shutdown_connections 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4186326995 wait complete. 2023-10-06T03:17:09.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.134+0000 7fe5d0d65b80 20 client.5550 trim_cache size 0 max 16384 2023-10-06T03:17:09.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5d0d65b80 1 Processor -- start 2023-10-06T03:17:09.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5d0d65b80 1 -- start start 2023-10-06T03:17:09.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926c075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 0x55f926bfc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 0x55f926c091f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f926c07c90 con 0x55f926bdc2c0 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f926bcf700 con 0x55f926bfbe50 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f926bba2e0 con 0x55f926bdda10 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5c5809700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926c075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5c5809700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926c075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52202/0 (socket says 172.21.15.82:52202) 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.151+0000 7fe5c5809700 1 -- 172.21.15.82:0/1725452414 learned_addr learned my addr 172.21.15.82:0/1725452414 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5c5809700 1 -- 172.21.15.82:0/1725452414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 msgr2=0x55f926bfc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5c5809700 1 --2- 172.21.15.82:0/1725452414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 0x55f926bfc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5c5809700 1 -- 172.21.15.82:0/1725452414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 msgr2=0x55f926c091f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5c5809700 1 --2- 172.21.15.82:0/1725452414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 0x55f926c091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5c5809700 1 -- 172.21.15.82:0/1725452414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f926ae0470 con 0x55f926bdc2c0 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5c5809700 1 --2- 172.21.15.82:0/1725452414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926c075c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02e430 tx=0x7fe5bc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfafcdfc5f8940 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5ab7fe700 1 -- 172.21.15.82:0/1725452414 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0071b0 con 0x55f926bdc2c0 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5ab7fe700 1 -- 172.21.15.82:0/1725452414 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc014c50 con 0x55f926bdc2c0 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5ab7fe700 1 -- 172.21.15.82:0/1725452414 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc02e4f0 con 0x55f926bdc2c0 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/1725452414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 msgr2=0x55f926c075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/1725452414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926c075c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02e430 tx=0x7fe5bc01b000 comp rx=0 tx=0).stop 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/1725452414 shutdown_connections 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/1725452414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bfbe50 0x55f926c091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/1725452414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bdc2c0 0x55f926c075c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/1725452414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 0x55f926bfc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.152+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/1725452414 >> 172.21.15.82:0/1725452414 conn(0x55f926bdbe80 msgr2=0x55f926bdc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:09.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.153+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/1725452414 shutdown_connections 2023-10-06T03:17:09.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.153+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/1725452414 wait complete. 2023-10-06T03:17:09.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.153+0000 7fe5d0d65b80 1 -- start start 2023-10-06T03:17:09.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.153+0000 7fe5d0d65b80 1 Processor -- start 2023-10-06T03:17:09.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdc2c0 0x55f926bfef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 0x55f926bff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5d0d65b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bfbe50 0x55f926c06b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f926c87e20 con 0x55f926bfbe50 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f926bd7740 con 0x55f926bdc2c0 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5d0d65b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f926c89d50 con 0x55f926bdda10 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5d0d65b80 10 client.0 _ll_register_callbacks cb 0x55f926b9e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bfbe50 0x55f926c06b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bfbe50 0x55f926c06b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52210/0 (socket says 172.21.15.82:52210) 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 -- 172.21.15.82:0/4082386436 learned_addr learned my addr 172.21.15.82:0/4082386436 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c5008700 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 0x55f926bff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c5809700 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdc2c0 0x55f926bfef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 -- 172.21.15.82:0/4082386436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 msgr2=0x55f926bff4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 0x55f926bff4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 -- 172.21.15.82:0/4082386436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdc2c0 msgr2=0x55f926bfef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdc2c0 0x55f926bfef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 -- 172.21.15.82:0/4082386436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f926af9780 con 0x55f926bfbe50 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe5c600a700 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bfbe50 0x55f926c06b90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009870 tx=0x7fe5b8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e86b0e6df8ad06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.154+0000 7fe59ffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe59ffff700 1 -- 172.21.15.82:0/4082386436 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800e070 con 0x55f926bfbe50 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe59ffff700 1 -- 172.21.15.82:0/4082386436 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5b801a070 con 0x55f926bfbe50 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4082386436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5b800f040 con 0x55f926bfbe50 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe59ffff700 1 -- 172.21.15.82:0/4082386436 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5b8028850 con 0x55f926bfbe50 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 10 client.5556 fetch_fsmap learned FSMap version 23 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4082386436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55f92698ff80 con 0x55f926bfbe50 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe59ffff700 1 -- 172.21.15.82:0/4082386436 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b800f040 con 0x55f926bfbe50 2023-10-06T03:17:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe59ffff700 1 -- 172.21.15.82:0/4082386436 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe5b80143e0 con 0x55f926bfbe50 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 10 client.5556 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 10 client.5556 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 20 client.5556 populate_metadata read hostname 'smithi082' 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] conn(0x55f926c07140 0x55f926c07510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 4 client.5556 mds_command: new command op to 5403 tid=0[{"prefix": "status"}] 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4082386436 --> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f926acde00 con 0x55f926c07140 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5c5809700 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] conn(0x55f926c07140 0x55f926c07510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe59ffff700 10 client.5556 ms_handle_connect on v2:172.21.15.82:6833/1910803570 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.155+0000 7fe5c5809700 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] conn(0x55f926c07140 0x55f926c07510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a518e3caf5c57038 server_cookie=32a7069f9cac3fdc in_seq=0 out_seq=0 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe59ffff700 1 -- 172.21.15.82:0/4082386436 <== mds.0 v2:172.21.15.82:6833/1910803570 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f926acde00 con 0x55f926c07140 2023-10-06T03:17:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe59ffff700 10 client.5556 handle_command_reply: tid=0 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 client.5556 shutdown 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4082386436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bfbe50 msgr2=0x55f926c06b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bfbe50 0x55f926c06b90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009870 tx=0x7fe5b8020000 comp rx=0 tx=0).stop 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4082386436 shutdown_connections 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.82:6833/1910803570,v1:172.21.15.82:6835/1910803570] conn(0x55f926c07140 0x55f926c07510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f926bfbe50 0x55f926c06b90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f926bdc2c0 0x55f926bfef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 --2- 172.21.15.82:0/4082386436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f926bdda10 0x55f926bff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4082386436 >> 172.21.15.82:0/4082386436 conn(0x55f926bdbe80 msgr2=0x55f926bd1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe59ffff700 0 client.5556 ms_handle_reset on v2:172.21.15.82:6833/1910803570 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4082386436 shutdown_connections 2023-10-06T03:17:09.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 1 -- 172.21.15.82:0/4082386436 wait complete. 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5d0d65b80 20 client.5556 trim_cache size 0 max 16384 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "968d6894-b90c-4b96-8e67-09d8a805d810", 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5403, 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-10-06T03:17:09.164 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 5.785204373, 2023-10-06T03:17:09.165 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 23, 2023-10-06T03:17:09.165 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 43, 2023-10-06T03:17:09.165 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 43, 2023-10-06T03:17:09.165 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 11.910055486999999 2023-10-06T03:17:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5c680b700 1 -- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe5a4066f30 msgr2=0x7fe5a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5c680b700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe5a4066f30 0x7fe5a40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc007f50 tx=0x7fe5bc001e90 comp rx=0 tx=0).stop 2023-10-06T03:17:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5c680b700 1 -- 172.21.15.82:0/1489268039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c00b12b0 msgr2=0x7fe5c00b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5c680b700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c00b12b0 0x7fe5c00b1720 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000e4b0 tx=0x7fe5b001a000 comp rx=0 tx=0).stop 2023-10-06T03:17:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5c680b700 1 -- 172.21.15.82:0/1489268039 shutdown_connections 2023-10-06T03:17:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5c680b700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe5a4066f30 0x7fe5a40693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5c680b700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c00cb220 0x7fe5c00cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.156+0000 7fe5c680b700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac004810 0x7fe5c0131900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.157+0000 7fe5c680b700 1 --2- 172.21.15.82:0/1489268039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5c00b12b0 0x7fe5c00b1720 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.157+0000 7fe5c680b700 1 -- 172.21.15.82:0/1489268039 >> 172.21.15.82:0/1489268039 conn(0x7fe5c00ccfe0 msgr2=0x7fe5c015d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.157+0000 7fe5c680b700 1 -- 172.21.15.82:0/1489268039 shutdown_connections 2023-10-06T03:17:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.157+0000 7fe5c680b700 1 -- 172.21.15.82:0/1489268039 wait complete. 2023-10-06T03:17:09.169 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:17:09.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.282+0000 7fe674e12700 1 Processor -- start 2023-10-06T03:17:09.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.282+0000 7fe674e12700 1 -- start start 2023-10-06T03:17:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe674e12700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe670159510 0x7fe6700acb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe674e12700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6700685d0 0x7fe6701633d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe674e12700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700adbb0 con 0x7fe6700ad070 2023-10-06T03:17:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe674e12700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700ae210 con 0x7fe670159510 2023-10-06T03:17:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe674e12700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700ad5f0 con 0x7fe6700685d0 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe66ed9d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6700685d0 0x7fe6701633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe66e59c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe670159510 0x7fe6700acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe66ed9d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6700685d0 0x7fe6701633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:57992/0 (socket says 172.21.15.82:57992) 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe66e59c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe670159510 0x7fe6700acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58852/0 (socket says 172.21.15.82:58852) 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe66ed9d700 1 -- 172.21.15.82:0/3333491361 learned_addr learned my addr 172.21.15.82:0/3333491361 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.283+0000 7fe665d9b700 1 --1- 172.21.15.82:0/3333491361 >> v1:172.21.15.134:6789/0 conn(0x7fe6700ad070 0x7fe670067ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:38624/0 (socket says 172.21.15.82:38624) 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe66ed9d700 1 -- 172.21.15.82:0/3333491361 >> v2:172.21.15.134:3300/0 conn(0x7fe670159510 msgr2=0x7fe6700acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe66ed9d700 1 --2- 172.21.15.82:0/3333491361 >> v2:172.21.15.134:3300/0 conn(0x7fe670159510 0x7fe6700acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe66ed9d700 1 -- 172.21.15.82:0/3333491361 >> v1:172.21.15.134:6789/0 conn(0x7fe6700ad070 legacy=0x7fe670067ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe66ed9d700 1 -- 172.21.15.82:0/3333491361 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700ad8d0 con 0x7fe6700685d0 2023-10-06T03:17:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe66ed9d700 1 --2- 172.21.15.82:0/3333491361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6700685d0 0x7fe6701633d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe668009f20 tx=0x7fe668009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3d6e0efd13a48fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe66dd9b700 1 -- 172.21.15.82:0/3333491361 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800e070 con 0x7fe6700685d0 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe66dd9b700 1 -- 172.21.15.82:0/3333491361 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800b9d0 con 0x7fe6700685d0 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe66dd9b700 1 -- 172.21.15.82:0/3333491361 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680092e0 con 0x7fe6700685d0 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe674e12700 1 -- 172.21.15.82:0/3333491361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6700685d0 msgr2=0x7fe6701633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.284+0000 7fe674e12700 1 --2- 172.21.15.82:0/3333491361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6700685d0 0x7fe6701633d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe668009f20 tx=0x7fe668009840 comp rx=0 tx=0).stop 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.285+0000 7fe674e12700 1 -- 172.21.15.82:0/3333491361 shutdown_connections 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.285+0000 7fe674e12700 1 --2- 172.21.15.82:0/3333491361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6700685d0 0x7fe6701633d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.285+0000 7fe674e12700 1 --2- 172.21.15.82:0/3333491361 >> v2:172.21.15.134:3300/0 conn(0x7fe670159510 0x7fe6700acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.285+0000 7fe674e12700 1 -- 172.21.15.82:0/3333491361 >> 172.21.15.82:0/3333491361 conn(0x7fe67006e6b0 msgr2=0x7fe67006afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.285+0000 7fe674e12700 1 -- 172.21.15.82:0/3333491361 shutdown_connections 2023-10-06T03:17:09.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.285+0000 7fe674e12700 1 -- 172.21.15.82:0/3333491361 wait complete. 2023-10-06T03:17:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.286+0000 7fe674e12700 1 Processor -- start 2023-10-06T03:17:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.286+0000 7fe674e12700 1 -- start start 2023-10-06T03:17:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe674e12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6700685d0 0x7fe67014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe674e12700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6700ad070 0x7fe67014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe674e12700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe670159510 0x7fe670169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe674e12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67015c5f0 con 0x7fe6700685d0 2023-10-06T03:17:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe674e12700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67015a7d0 con 0x7fe6700ad070 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe674e12700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67015aab0 con 0x7fe670159510 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6700685d0 0x7fe67014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6700685d0 0x7fe67014dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52216/0 (socket says 172.21.15.82:52216) 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 -- 172.21.15.82:0/3807659601 learned_addr learned my addr 172.21.15.82:0/3807659601 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66ed9d700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe670159510 0x7fe670169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe665d9b700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6700ad070 0x7fe67014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 -- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe670159510 msgr2=0x7fe670169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe670159510 0x7fe670169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 -- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6700ad070 msgr2=0x7fe67014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6700ad070 0x7fe67014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 -- 172.21.15.82:0/3807659601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009ae0 con 0x7fe6700685d0 2023-10-06T03:17:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe66e59c700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6700685d0 0x7fe67014dc60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe66000e930 tx=0x7fe6600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe666ffd700 1 -- 172.21.15.82:0/3807659601 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660013680 con 0x7fe6700685d0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe666ffd700 1 -- 172.21.15.82:0/3807659601 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6600137e0 con 0x7fe6700685d0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe666ffd700 1 -- 172.21.15.82:0/3807659601 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660013b80 con 0x7fe6700685d0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe670069ca0 con 0x7fe6700685d0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.287+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67015c1c0 con 0x7fe6700685d0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.288+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe670069ec0 con 0x7fe6700685d0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.289+0000 7fe666ffd700 1 -- 172.21.15.82:0/3807659601 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe66000c3e0 con 0x7fe6700685d0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.289+0000 7fe666ffd700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe650066f30 0x7fe6500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.289+0000 7fe666ffd700 1 -- 172.21.15.82:0/3807659601 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe660084740 con 0x7fe6700685d0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.289+0000 7fe665d9b700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe650066f30 0x7fe6500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.290+0000 7fe665d9b700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe650066f30 0x7fe6500693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe67015bfb0 tx=0x7fe658007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:09.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.293+0000 7fe666ffd700 1 -- 172.21.15.82:0/3807659601 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe660051850 con 0x7fe6700685d0 2023-10-06T03:17:09.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.522+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe67015c730 con 0x7fe6700685d0 2023-10-06T03:17:09.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.523+0000 7fe666ffd700 1 -- 172.21.15.82:0/3807659601 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe660054e70 con 0x7fe6700685d0 2023-10-06T03:17:09.524 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:17:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe650066f30 msgr2=0x7fe6500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe650066f30 0x7fe6500693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe67015bfb0 tx=0x7fe658007eb0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6700685d0 msgr2=0x7fe67014dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:09.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6700685d0 0x7fe67014dc60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe66000e930 tx=0x7fe6600091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 shutdown_connections 2023-10-06T03:17:09.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe650066f30 0x7fe6500693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe670159510 0x7fe670169830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6700685d0 0x7fe67014dc60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 --2- 172.21.15.82:0/3807659601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6700ad070 0x7fe67014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:09.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.524+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 >> 172.21.15.82:0/3807659601 conn(0x7fe67006e6b0 msgr2=0x7fe670158830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:09.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.525+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 shutdown_connections 2023-10-06T03:17:09.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:09.525+0000 7fe674e12700 1 -- 172.21.15.82:0/3807659601 wait complete. 2023-10-06T03:17:09.537 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:17:09.537 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:17:09.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-10-06T03:17:09.537 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:17:09.537 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:09.537 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:17:09.538 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:17:09.538 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:17:09.538 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:17:09.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:09.538 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-10-06T03:17:09.554 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:17:09.554 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:17:09.554 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:17:09.554 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:09.554 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-10-06T03:17:09.554 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:09.554 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:09.554 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:09.555 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-10-06T03:17:09.555 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:09.555 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:09.555 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-10-06T03:17:09.555 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:09.555 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:09.556 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:17:09.556 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:09.556 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:17:09.556 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42433sec preferred_lft 42433sec 2023-10-06T03:17:09.556 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-10-06T03:17:09.556 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:09.557 INFO:teuthology.orchestra.run.smithi082.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:17:09.557 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 36:95:8d:ad:89:e0 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:09.557 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:17:09.557 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:09.557 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::8c5f:c4ff:fe3a:9eac/64 scope link 2023-10-06T03:17:09.557 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:09.557 INFO:teuthology.orchestra.run.smithi082.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:17:09.557 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether be:dd:8c:84:42:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:17:09.558 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::bcdd:8cff:fe84:42c0/64 scope link 2023-10-06T03:17:09.558 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:09.558 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:17:09.558 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 36:95:8d:ad:89:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:17:09.558 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::3495:8dff:fead:89e0/64 scope link 2023-10-06T03:17:09.558 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:09.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:09.559 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:17:09.617 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-10-06T03:17:09.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:09.619 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-10-06T03:17:09.674 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-10-06T03:17:09.675 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:17:09.675 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:17:09.675 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:17:09.675 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:17:09.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:09.675 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:17:09.675 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:17:09.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:17:09.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:17:09.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:17:09.676 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:17:09.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:09.774 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:17:09.789 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:17:09.789 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:17:09.789 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:17:09.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:09.789 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-10-06T03:17:09.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:17:09.854 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:09.909 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:17:09.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:17:09.910 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:09.964 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:17:09.964 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:17:09.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:17:10.042 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:17:10.043 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:17:10.043 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:17:10.051 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:17:10.051 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:17:10.051 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:17:10.051 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:17:10.051 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:17:10.073 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:17:10.073 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:17:10.074 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:17:10.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:17:10.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:17:10.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:17:10.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:17:10.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:17:10.075 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:17:10.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:10.076 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:10.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:17:10.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.293+0000 7ff3c62f8700 1 Processor -- start 2023-10-06T03:17:10.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.293+0000 7ff3c62f8700 1 -- start start 2023-10-06T03:17:10.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c62f8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3c015d480 0x7ff3c0069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:10.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c62f8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3c00b0a20 0x7ff3c00b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:10.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c62f8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c00687c0 con 0x7ff3c0069da0 2023-10-06T03:17:10.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c62f8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c0068aa0 con 0x7ff3c00b0a20 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c62f8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c0068d80 con 0x7ff3c015d480 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c5af7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3c00b0a20 0x7ff3c00b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c5af7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3c00b0a20 0x7ff3c00b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52222/0 (socket says 172.21.15.82:52222) 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c5af7700 1 -- 172.21.15.82:0/2343314121 learned_addr learned my addr 172.21.15.82:0/2343314121 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c52f6700 1 --2- 172.21.15.82:0/2343314121 >> v2:172.21.15.134:3300/0 conn(0x7ff3c015d480 0x7ff3c0069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c5af7700 1 -- 172.21.15.82:0/2343314121 >> v2:172.21.15.134:3300/0 conn(0x7ff3c015d480 msgr2=0x7ff3c0069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c5af7700 1 --2- 172.21.15.82:0/2343314121 >> v2:172.21.15.134:3300/0 conn(0x7ff3c015d480 0x7ff3c0069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c5af7700 1 -- 172.21.15.82:0/2343314121 >> v1:172.21.15.134:6789/0 conn(0x7ff3c0069da0 legacy=0x7ff3c00b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:10.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c5af7700 1 -- 172.21.15.82:0/2343314121 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0069060 con 0x7ff3c00b0a20 2023-10-06T03:17:10.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.294+0000 7ff3c52f6700 1 --2- 172.21.15.82:0/2343314121 >> v2:172.21.15.134:3300/0 conn(0x7ff3c015d480 0x7ff3c0069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:10.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c5af7700 1 --2- 172.21.15.82:0/2343314121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c00b0a20 0x7ff3c00b5c30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0071370 tx=0x7ff3b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815e8efcc882dabb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:10.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3b7fff700 1 -- 172.21.15.82:0/2343314121 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b800e070 con 0x7ff3c00b0a20 2023-10-06T03:17:10.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3b7fff700 1 -- 172.21.15.82:0/2343314121 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b800ba10 con 0x7ff3c00b0a20 2023-10-06T03:17:10.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3b7fff700 1 -- 172.21.15.82:0/2343314121 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80092e0 con 0x7ff3c00b0a20 2023-10-06T03:17:10.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c62f8700 1 -- 172.21.15.82:0/2343314121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c00b0a20 msgr2=0x7ff3c00b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:10.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/2343314121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c00b0a20 0x7ff3c00b5c30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0071370 tx=0x7ff3b8009840 comp rx=0 tx=0).stop 2023-10-06T03:17:10.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c62f8700 1 -- 172.21.15.82:0/2343314121 shutdown_connections 2023-10-06T03:17:10.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/2343314121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c00b0a20 0x7ff3c00b5c30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/2343314121 >> v2:172.21.15.134:3300/0 conn(0x7ff3c015d480 0x7ff3c0069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c62f8700 1 -- 172.21.15.82:0/2343314121 >> 172.21.15.82:0/2343314121 conn(0x7ff3c00ccf80 msgr2=0x7ff3c00cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:10.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c62f8700 1 -- 172.21.15.82:0/2343314121 shutdown_connections 2023-10-06T03:17:10.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.295+0000 7ff3c62f8700 1 -- 172.21.15.82:0/2343314121 wait complete. 2023-10-06T03:17:10.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.297+0000 7ff3c62f8700 1 Processor -- start 2023-10-06T03:17:10.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.297+0000 7ff3c62f8700 1 -- start start 2023-10-06T03:17:10.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.297+0000 7ff3c62f8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3c0069da0 0x7ff3c0140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:10.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.297+0000 7ff3c62f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3c00b0a20 0x7ff3c016aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:10.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.297+0000 7ff3c62f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c015d480 0x7ff3c016c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:10.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.297+0000 7ff3c62f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c016b420 con 0x7ff3c015d480 2023-10-06T03:17:10.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.297+0000 7ff3c62f8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c016b700 con 0x7ff3c00b0a20 2023-10-06T03:17:10.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.297+0000 7ff3c62f8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c016b9e0 con 0x7ff3c0069da0 2023-10-06T03:17:10.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c015d480 0x7ff3c016c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:10.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c015d480 0x7ff3c016c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52226/0 (socket says 172.21.15.82:52226) 2023-10-06T03:17:10.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 -- 172.21.15.82:0/3964948150 learned_addr learned my addr 172.21.15.82:0/3964948150 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:10.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c52f6700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3c0069da0 0x7ff3c0140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:10.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c4af5700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3c00b0a20 0x7ff3c016aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:10.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 -- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3c0069da0 msgr2=0x7ff3c0140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:10.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3c0069da0 0x7ff3c0140610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 -- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3c00b0a20 msgr2=0x7ff3c016aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:10.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3c00b0a20 0x7ff3c016aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 -- 172.21.15.82:0/3964948150 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8009ae0 con 0x7ff3c015d480 2023-10-06T03:17:10.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c5af7700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c015d480 0x7ff3c016c4c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8003000 tx=0x7ff3b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:10.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3b57fa700 1 -- 172.21.15.82:0/3964948150 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80032f0 con 0x7ff3c015d480 2023-10-06T03:17:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3b57fa700 1 -- 172.21.15.82:0/3964948150 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8012e60 con 0x7ff3c015d480 2023-10-06T03:17:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c016bcc0 con 0x7ff3c015d480 2023-10-06T03:17:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3b57fa700 1 -- 172.21.15.82:0/3964948150 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b801d670 con 0x7ff3c015d480 2023-10-06T03:17:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.298+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c0140b50 con 0x7ff3c015d480 2023-10-06T03:17:10.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.299+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c004c3c0 con 0x7ff3c015d480 2023-10-06T03:17:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.299+0000 7ff3b57fa700 1 -- 172.21.15.82:0/3964948150 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3b801daa0 con 0x7ff3c015d480 2023-10-06T03:17:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.300+0000 7ff3b57fa700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff3a4066f30 0x7ff3a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.300+0000 7ff3b57fa700 1 -- 172.21.15.82:0/3964948150 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff3b8085f70 con 0x7ff3c015d480 2023-10-06T03:17:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.300+0000 7ff3c52f6700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff3a4066f30 0x7ff3a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.301+0000 7ff3c52f6700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff3a4066f30 0x7ff3a40693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc006fd0 tx=0x7ff3bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:10.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.304+0000 7ff3b57fa700 1 -- 172.21.15.82:0/3964948150 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3b80b75a0 con 0x7ff3c015d480 2023-10-06T03:17:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.532+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff3c0069340 con 0x7ff3c015d480 2023-10-06T03:17:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.532+0000 7ff3b57fa700 1 -- 172.21.15.82:0/3964948150 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff3b8053080 con 0x7ff3c015d480 2023-10-06T03:17:10.533 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:17:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff3a4066f30 msgr2=0x7ff3a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff3a4066f30 0x7ff3a40693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc006fd0 tx=0x7ff3bc008040 comp rx=0 tx=0).stop 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c015d480 msgr2=0x7ff3c016c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c015d480 0x7ff3c016c4c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8003000 tx=0x7ff3b8017000 comp rx=0 tx=0).stop 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 shutdown_connections 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c015d480 0x7ff3c016c4c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff3a4066f30 0x7ff3a40693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3c0069da0 0x7ff3c0140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 --2- 172.21.15.82:0/3964948150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3c00b0a20 0x7ff3c016aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 >> 172.21.15.82:0/3964948150 conn(0x7ff3c00ccf80 msgr2=0x7ff3c00cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 shutdown_connections 2023-10-06T03:17:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:10.535+0000 7ff3c62f8700 1 -- 172.21.15.82:0/3964948150 wait complete. 2023-10-06T03:17:10.547 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:17:10.547 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:17:10.547 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-10-06T03:17:10.547 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:17:10.547 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:10.547 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:17:10.548 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:17:10.548 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:17:10.548 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:17:10.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:10.548 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:10.567 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42430sec preferred_lft 42430sec 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:10.568 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::942d:80ff:fe6e:b134/64 scope link 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::7074:feff:fe81:9e88/64 scope link 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether ee:c9:40:4f:89:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:17:10.569 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ecc9:40ff:fe4f:892c/64 scope link 2023-10-06T03:17:10.570 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:10.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:10.570 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:17:10.633 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-10-06T03:17:10.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:10.635 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-10-06T03:17:10.694 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-10-06T03:17:10.694 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:17:10.694 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:17:10.694 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:17:10.694 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:17:10.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:10.695 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:17:10.695 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:17:10.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:17:10.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:17:10.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:17:10.695 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:17:10.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:10.799 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:17:10.813 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:17:10.813 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:17:10.814 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:17:10.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:10.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-10-06T03:17:10.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:17:10.878 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:10.933 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:17:10.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:17:10.934 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:10.988 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:17:10.988 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:17:10.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:17:11.068 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:17:11.068 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:17:11.069 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:17:11.077 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:17:11.077 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:17:11.077 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:17:11.077 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:17:11.077 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:17:11.098 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:17:11.098 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:17:11.099 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:17:11.099 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:17:11.099 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:17:11.099 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:17:11.099 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:17:11.099 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:17:11.100 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:17:11.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:11.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:11.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:11.165 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-10-06T03:17:11.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:11.184 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2023-10-06T03:17:11.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:17:11.240 INFO:teuthology.orchestra.run.smithi082.stderr:./subdir: ceph.quota.max_files: No such attribute 2023-10-06T03:17:11.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:11.240 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2023-10-06T03:17:11.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:17:11.257 INFO:teuthology.orchestra.run.smithi134.stderr:./subdir: ceph.quota.max_files: No such attribute 2023-10-06T03:17:11.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:11.258 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 10 ./subdir) 2023-10-06T03:17:11.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:11.298 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2023-10-06T03:17:11.354 INFO:teuthology.orchestra.run.smithi082.stdout:10 2023-10-06T03:17:11.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:11.355 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2023-10-06T03:17:11.370 INFO:teuthology.orchestra.run.smithi134.stdout:10 2023-10-06T03:17:11.370 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:17:11.370 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:17:11.431 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:17:11.472 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:17:11.472 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:17:11.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:11.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:11.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:17:11.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:11.511 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:17:11.566 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:17:11.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:11.566 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:11.608 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:17:11.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:11.608 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:17:11.663 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:11.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.776+0000 7f467a6d4700 1 Processor -- start 2023-10-06T03:17:11.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.776+0000 7f467a6d4700 1 -- start start 2023-10-06T03:17:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f467a6d4700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f46740c8970 0x7f46740c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f467a6d4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740c9320 con 0x7f46740cbf90 2023-10-06T03:17:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f467a6d4700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740c4830 con 0x7f4674141130 2023-10-06T03:17:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f467a6d4700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4674158250 con 0x7f46740c8970 2023-10-06T03:17:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f4679ed3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f46740cbf90 0x7f46740cc3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43180/0 (socket says 172.21.15.82:43180) 2023-10-06T03:17:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f4679ed3700 1 -- 172.21.15.82:0/1786185683 learned_addr learned my addr 172.21.15.82:0/1786185683 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f4678ed1700 1 --2- 172.21.15.82:0/1786185683 >> v2:172.21.15.134:3300/0 conn(0x7f46740c8970 0x7f46740c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f466bfff700 1 -- 172.21.15.82:0/1786185683 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053519179 0 0) 0x7f46740c9320 con 0x7f46740cbf90 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.777+0000 7f466bfff700 1 -- 172.21.15.82:0/1786185683 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4660003570 con 0x7f46740cbf90 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f466bfff700 1 -- 172.21.15.82:0/1786185683 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776855819 0 0) 0x7f46740c4830 con 0x7f4674141130 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f466bfff700 1 -- 172.21.15.82:0/1786185683 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46740c9320 con 0x7f4674141130 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f466bfff700 1 -- 172.21.15.82:0/1786185683 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 864213468 0 0) 0x7f4660003570 con 0x7f46740cbf90 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f4678ed1700 1 -- 172.21.15.82:0/1786185683 >> v1:172.21.15.134:6789/0 conn(0x7f4674141130 legacy=0x7f46740c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f4678ed1700 1 -- 172.21.15.82:0/1786185683 >> v1:172.21.15.82:6789/0 conn(0x7f46740cbf90 legacy=0x7f46740cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f4678ed1700 1 -- 172.21.15.82:0/1786185683 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740c3c20 con 0x7f46740c8970 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f4678ed1700 1 --2- 172.21.15.82:0/1786185683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46740c8970 0x7f46740c8de0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46640098e0 tx=0x7f46640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bec53e5313eb8f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f466bfff700 1 -- 172.21.15.82:0/1786185683 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c001470 con 0x7f46740c8970 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f466bfff700 1 -- 172.21.15.82:0/1786185683 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4664011420 con 0x7f46740c8970 2023-10-06T03:17:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f466bfff700 1 -- 172.21.15.82:0/1786185683 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640117c0 con 0x7f46740c8970 2023-10-06T03:17:11.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f467a6d4700 1 -- 172.21.15.82:0/1786185683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46740c8970 msgr2=0x7f46740c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:11.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.778+0000 7f467a6d4700 1 --2- 172.21.15.82:0/1786185683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46740c8970 0x7f46740c8de0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46640098e0 tx=0x7f46640091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:11.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.779+0000 7f467a6d4700 1 -- 172.21.15.82:0/1786185683 shutdown_connections 2023-10-06T03:17:11.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.779+0000 7f467a6d4700 1 --2- 172.21.15.82:0/1786185683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46740c8970 0x7f46740c8de0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:11.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.779+0000 7f467a6d4700 1 -- 172.21.15.82:0/1786185683 >> 172.21.15.82:0/1786185683 conn(0x7f46740ce330 msgr2=0x7f46740ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:11.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.779+0000 7f467a6d4700 1 -- 172.21.15.82:0/1786185683 shutdown_connections 2023-10-06T03:17:11.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.779+0000 7f467a6d4700 1 -- 172.21.15.82:0/1786185683 wait complete. 2023-10-06T03:17:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.780+0000 7f467a6d4700 1 Processor -- start 2023-10-06T03:17:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.780+0000 7f467a6d4700 1 -- start start 2023-10-06T03:17:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f467a6d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46740c8970 0x7f46741578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f467a6d4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46740cbf90 0x7f467406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f467a6d4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4674141130 0x7f467406b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f467a6d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4674157e00 con 0x7f46740c8970 2023-10-06T03:17:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f467a6d4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467413f550 con 0x7f4674141130 2023-10-06T03:17:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f467a6d4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467413b860 con 0x7f46740cbf90 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46740c8970 0x7f46741578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46740c8970 0x7f46741578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52234/0 (socket says 172.21.15.82:52234) 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 -- 172.21.15.82:0/2655480621 learned_addr learned my addr 172.21.15.82:0/2655480621 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f4679ed3700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4674141130 0x7f467406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f4678ed1700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46740cbf90 0x7f467406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 -- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46740cbf90 msgr2=0x7f467406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46740cbf90 0x7f467406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 -- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4674141130 msgr2=0x7f467406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4674141130 0x7f467406b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 -- 172.21.15.82:0/2655480621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009420 con 0x7f46740c8970 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f4679ed3700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4674141130 0x7f467406b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46796d2700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46740c8970 0x7f46741578c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f467000cd30 tx=0x7f4670002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46697fa700 1 -- 172.21.15.82:0/2655480621 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467000ab70 con 0x7f46740c8970 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46697fa700 1 -- 172.21.15.82:0/2655480621 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000acd0 con 0x7f46740c8970 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f46697fa700 1 -- 172.21.15.82:0/2655480621 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670012650 con 0x7f46740c8970 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467413ec20 con 0x7f46740c8970 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.781+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467413f1e0 con 0x7f46740c8970 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.782+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467404c3c0 con 0x7f46740c8970 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.783+0000 7f46697fa700 1 -- 172.21.15.82:0/2655480621 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4670012a00 con 0x7f46740c8970 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.783+0000 7f46697fa700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.783+0000 7f46697fa700 1 -- 172.21.15.82:0/2655480621 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4670084e30 con 0x7f46740c8970 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.783+0000 7f4678ed1700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.784+0000 7f4678ed1700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4658066f30 0x7f46580693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f46640093f0 tx=0x7f4664016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:11.787+0000 7f46697fa700 1 -- 172.21.15.82:0/2655480621 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4670051f40 con 0x7f46740c8970 2023-10-06T03:17:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.012+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46740c3f00 con 0x7f46740c8970 2023-10-06T03:17:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.013+0000 7f46697fa700 1 -- 172.21.15.82:0/2655480621 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f4670055560 con 0x7f46740c8970 2023-10-06T03:17:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:12.014 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2460851709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2460851709},{"type":"v1","addr":"172.21.15.134:6837","nonce":2460851709}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/771524024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":771524024},{"type":"v1","addr":"172.21.15.134:6836","nonce":771524024}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/3256175471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3256175471},{"type":"v1","addr":"172.21.15.82:6834","nonce":3256175471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:02.753418+0000","modified":"2023-10-06T03:17:06.382667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1910803570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1910803570},{"type":"v1","addr":"172.21.15.82:6835","nonce":1910803570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:17:12.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4658066f30 msgr2=0x7f46580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4658066f30 0x7f46580693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f46640093f0 tx=0x7f4664016000 comp rx=0 tx=0).stop 2023-10-06T03:17:12.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46740c8970 msgr2=0x7f46741578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46740c8970 0x7f46741578c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f467000cd30 tx=0x7f4670002b90 comp rx=0 tx=0).stop 2023-10-06T03:17:12.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 shutdown_connections 2023-10-06T03:17:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4674141130 0x7f467406b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46740c8970 0x7f46741578c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 --2- 172.21.15.82:0/2655480621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46740cbf90 0x7f467406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 >> 172.21.15.82:0/2655480621 conn(0x7f46740ce330 msgr2=0x7f4674158420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 shutdown_connections 2023-10-06T03:17:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.015+0000 7f467a6d4700 1 -- 172.21.15.82:0/2655480621 wait complete. 2023-10-06T03:17:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2023-10-06T03:17:12.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:12.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.141+0000 7f6367cae700 1 Processor -- start 2023-10-06T03:17:12.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.141+0000 7f6367cae700 1 -- start start 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f6367cae700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f636015d560 0x7f63600d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f6367cae700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63601591b0 0x7f6360159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f6367cae700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63600b2ad0 con 0x7f636015d930 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f6367cae700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63600b4160 con 0x7f636015d560 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f6367cae700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6360159b70 con 0x7f63601591b0 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f636624b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63601591b0 0x7f6360159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f6365a4a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f636015d560 0x7f63600d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f6365249700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f636015d930 0x7f63600b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:38646/0 (socket says 172.21.15.82:38646) 2023-10-06T03:17:12.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.142+0000 7f6365249700 1 -- 172.21.15.82:0/2326777367 learned_addr learned my addr 172.21.15.82:0/2326777367 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:12.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6364a48700 1 -- 172.21.15.82:0/2326777367 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706832754 0 0) 0x7f63600b2ad0 con 0x7f636015d930 2023-10-06T03:17:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6364a48700 1 -- 172.21.15.82:0/2326777367 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f634c003570 con 0x7f636015d930 2023-10-06T03:17:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6365a4a700 1 -- 172.21.15.82:0/2326777367 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63601591b0 msgr2=0x7f6360159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6365a4a700 1 --2- 172.21.15.82:0/2326777367 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63601591b0 0x7f6360159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6365a4a700 1 -- 172.21.15.82:0/2326777367 >> v1:172.21.15.134:6789/0 conn(0x7f636015d930 legacy=0x7f63600b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6365a4a700 1 -- 172.21.15.82:0/2326777367 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63600b2230 con 0x7f636015d560 2023-10-06T03:17:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f636624b700 1 --2- 172.21.15.82:0/2326777367 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63601591b0 0x7f6360159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6365a4a700 1 --2- 172.21.15.82:0/2326777367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d560 0x7f63600d0030 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098e0 tx=0x7f635c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5fdac88eaa1c910 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6364a48700 1 -- 172.21.15.82:0/2326777367 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c011630 con 0x7f636015d560 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6364a48700 1 -- 172.21.15.82:0/2326777367 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c011790 con 0x7f636015d560 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.143+0000 7f6364a48700 1 -- 172.21.15.82:0/2326777367 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c011b30 con 0x7f636015d560 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.144+0000 7f6367cae700 1 -- 172.21.15.82:0/2326777367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d560 msgr2=0x7f63600d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.144+0000 7f6367cae700 1 --2- 172.21.15.82:0/2326777367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d560 0x7f63600d0030 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098e0 tx=0x7f635c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.144+0000 7f6367cae700 1 -- 172.21.15.82:0/2326777367 shutdown_connections 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.144+0000 7f6367cae700 1 --2- 172.21.15.82:0/2326777367 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63601591b0 0x7f6360159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.144+0000 7f6367cae700 1 --2- 172.21.15.82:0/2326777367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d560 0x7f63600d0030 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.144+0000 7f6367cae700 1 -- 172.21.15.82:0/2326777367 >> 172.21.15.82:0/2326777367 conn(0x7f63600d1180 msgr2=0x7f6360069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.144+0000 7f6367cae700 1 -- 172.21.15.82:0/2326777367 shutdown_connections 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.144+0000 7f6367cae700 1 -- 172.21.15.82:0/2326777367 wait complete. 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.145+0000 7f6367cae700 1 Processor -- start 2023-10-06T03:17:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.145+0000 7f6367cae700 1 -- start start 2023-10-06T03:17:12.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6367cae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63601591b0 0x7f6360154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6367cae700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f636015d560 0x7f63600c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6367cae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d930 0x7f63600c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6367cae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636015cc50 con 0x7f63601591b0 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6367cae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636015c040 con 0x7f636015d930 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6367cae700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636015c320 con 0x7f636015d560 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63601591b0 0x7f6360154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63601591b0 0x7f6360154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52240/0 (socket says 172.21.15.82:52240) 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 -- 172.21.15.82:0/3723878901 learned_addr learned my addr 172.21.15.82:0/3723878901 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f636624b700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d930 0x7f63600c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365249700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f636015d560 0x7f63600c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 -- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f636015d560 msgr2=0x7f63600c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f636015d560 0x7f63600c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 -- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d930 msgr2=0x7f63600c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d930 0x7f63600c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 -- 172.21.15.82:0/3723878901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6358009a20 con 0x7f63601591b0 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f636624b700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d930 0x7f63600c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6365a4a700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63601591b0 0x7f6360154dc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6360064a20 tx=0x7f635c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6355ffb700 1 -- 172.21.15.82:0/3723878901 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c011b10 con 0x7f63601591b0 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6355ffb700 1 -- 172.21.15.82:0/3723878901 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c0253f0 con 0x7f63601591b0 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c009420 con 0x7f63601591b0 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.146+0000 7f6355ffb700 1 -- 172.21.15.82:0/3723878901 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c025790 con 0x7f63601591b0 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.147+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636015c8e0 con 0x7f63601591b0 2023-10-06T03:17:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.147+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6360064050 con 0x7f63601591b0 2023-10-06T03:17:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.148+0000 7f6355ffb700 1 -- 172.21.15.82:0/3723878901 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f635c025b80 con 0x7f63601591b0 2023-10-06T03:17:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.148+0000 7f6355ffb700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6344066f30 0x7f63440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.148+0000 7f6355ffb700 1 -- 172.21.15.82:0/3723878901 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f635c085ff0 con 0x7f63601591b0 2023-10-06T03:17:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.148+0000 7f6365249700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6344066f30 0x7f63440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.149+0000 7f6365249700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6344066f30 0x7f63440693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f63600c8760 tx=0x7f6350009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.152+0000 7f6355ffb700 1 -- 172.21.15.82:0/3723878901 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f635c0b75a0 con 0x7f63601591b0 2023-10-06T03:17:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.336+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63600b2510 con 0x7f63601591b0 2023-10-06T03:17:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.337+0000 7f6355ffb700 1 -- 172.21.15.82:0/3723878901 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f635c053080 con 0x7f63601591b0 2023-10-06T03:17:12.339 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:12.339 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":43,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:04.321808+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:00.394566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:01.721357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:12.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6344066f30 msgr2=0x7f63440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6344066f30 0x7f63440693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f63600c8760 tx=0x7f6350009040 comp rx=0 tx=0).stop 2023-10-06T03:17:12.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63601591b0 msgr2=0x7f6360154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63601591b0 0x7f6360154dc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6360064a20 tx=0x7f635c017000 comp rx=0 tx=0).stop 2023-10-06T03:17:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 shutdown_connections 2023-10-06T03:17:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f636015d930 0x7f63600c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63601591b0 0x7f6360154dc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6344066f30 0x7f63440693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 --2- 172.21.15.82:0/3723878901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f636015d560 0x7f63600c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 >> 172.21.15.82:0/3723878901 conn(0x7f63600d1180 msgr2=0x7f6360155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:12.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 shutdown_connections 2023-10-06T03:17:12.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.339+0000 7f6367cae700 1 -- 172.21.15.82:0/3723878901 wait complete. 2023-10-06T03:17:12.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:17:00.394566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:17:01.721357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:17:12.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:17:12.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.471+0000 7fe7b240c700 1 Processor -- start 2023-10-06T03:17:12.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.471+0000 7fe7b240c700 1 -- start start 2023-10-06T03:17:12.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7b240c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1598d0 0x7fe7ac15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7b240c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac15dd20 con 0x7fe7ac159500 2023-10-06T03:17:12.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7b240c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac0b1110 con 0x7fe7ac15d8e0 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7b240c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0b13b0 con 0x7fe7ac1598d0 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7abfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe7ac159500 0x7fe7ac0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43188/0 (socket says 172.21.15.82:43188) 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7abfff700 1 -- 172.21.15.82:0/1447310083 learned_addr learned my addr 172.21.15.82:0/1447310083 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7ab7fe700 1 --2- 172.21.15.82:0/1447310083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1598d0 0x7fe7ac15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7aaffd700 1 -- 172.21.15.82:0/1447310083 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904200475 0 0) 0x7fe7ac15dd20 con 0x7fe7ac159500 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7aaffd700 1 -- 172.21.15.82:0/1447310083 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe794003570 con 0x7fe7ac159500 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7aaffd700 1 -- 172.21.15.82:0/1447310083 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137733452 0 0) 0x7fe7ac0b1110 con 0x7fe7ac15d8e0 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7aaffd700 1 -- 172.21.15.82:0/1447310083 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7ac15dd20 con 0x7fe7ac15d8e0 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7ab7fe700 1 -- 172.21.15.82:0/1447310083 >> v1:172.21.15.134:6789/0 conn(0x7fe7ac15d8e0 legacy=0x7fe7ac0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7aaffd700 1 -- 172.21.15.82:0/1447310083 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2731620270 0 0) 0x7fe794003570 con 0x7fe7ac159500 2023-10-06T03:17:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7ab7fe700 1 -- 172.21.15.82:0/1447310083 >> v1:172.21.15.82:6789/0 conn(0x7fe7ac159500 legacy=0x7fe7ac0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.472+0000 7fe7ab7fe700 1 -- 172.21.15.82:0/1447310083 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac0b1690 con 0x7fe7ac1598d0 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7ab7fe700 1 --2- 172.21.15.82:0/1447310083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1598d0 0x7fe7ac15d3a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009910 tx=0x7fe7a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9da9aacf65aff05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7aaffd700 1 -- 172.21.15.82:0/1447310083 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c001470 con 0x7fe7ac1598d0 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7aaffd700 1 -- 172.21.15.82:0/1447310083 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0011420 con 0x7fe7ac1598d0 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7aaffd700 1 -- 172.21.15.82:0/1447310083 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00117c0 con 0x7fe7ac1598d0 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7b240c700 1 -- 172.21.15.82:0/1447310083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1598d0 msgr2=0x7fe7ac15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7b240c700 1 --2- 172.21.15.82:0/1447310083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1598d0 0x7fe7ac15d3a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009910 tx=0x7fe7a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7b240c700 1 -- 172.21.15.82:0/1447310083 shutdown_connections 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7b240c700 1 --2- 172.21.15.82:0/1447310083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac1598d0 0x7fe7ac15d3a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7b240c700 1 -- 172.21.15.82:0/1447310083 >> 172.21.15.82:0/1447310083 conn(0x7fe7ac067630 msgr2=0x7fe7ac069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7b240c700 1 -- 172.21.15.82:0/1447310083 shutdown_connections 2023-10-06T03:17:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.473+0000 7fe7b240c700 1 -- 172.21.15.82:0/1447310083 wait complete. 2023-10-06T03:17:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.474+0000 7fe7b240c700 1 Processor -- start 2023-10-06T03:17:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7b240c700 1 -- start start 2023-10-06T03:17:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7b240c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac159500 0x7fe7ac1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7b240c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac1598d0 0x7fe7ac150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7b240c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac15d8e0 0x7fe7ac0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7b240c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0b6020 con 0x7fe7ac159500 2023-10-06T03:17:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7b240c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0b65e0 con 0x7fe7ac1598d0 2023-10-06T03:17:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7b240c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac148800 con 0x7fe7ac15d8e0 2023-10-06T03:17:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7abfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac159500 0x7fe7ac1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.475+0000 7fe7abfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac159500 0x7fe7ac1482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52256/0 (socket says 172.21.15.82:52256) 2023-10-06T03:17:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7abfff700 1 -- 172.21.15.82:0/627275745 learned_addr learned my addr 172.21.15.82:0/627275745 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7ab7fe700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac1598d0 0x7fe7ac150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7b09a9700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac15d8e0 0x7fe7ac0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7abfff700 1 -- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac15d8e0 msgr2=0x7fe7ac0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7abfff700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac15d8e0 0x7fe7ac0b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7abfff700 1 -- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac1598d0 msgr2=0x7fe7ac150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7abfff700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac1598d0 0x7fe7ac150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7abfff700 1 -- 172.21.15.82:0/627275745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0009420 con 0x7fe7ac159500 2023-10-06T03:17:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7abfff700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac159500 0x7fe7ac1482c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00cb70 tx=0x7fe79c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe793fff700 1 -- 172.21.15.82:0/627275745 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00ce80 con 0x7fe7ac159500 2023-10-06T03:17:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe793fff700 1 -- 172.21.15.82:0/627275745 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c007360 con 0x7fe7ac159500 2023-10-06T03:17:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe793fff700 1 -- 172.21.15.82:0/627275745 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c007700 con 0x7fe7ac159500 2023-10-06T03:17:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac1505b0 con 0x7fe7ac159500 2023-10-06T03:17:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.476+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac0b52a0 con 0x7fe7ac159500 2023-10-06T03:17:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.477+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac064050 con 0x7fe7ac159500 2023-10-06T03:17:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.478+0000 7fe793fff700 1 -- 172.21.15.82:0/627275745 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe79c004a40 con 0x7fe7ac159500 2023-10-06T03:17:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.478+0000 7fe793fff700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe798066f30 0x7fe7980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.478+0000 7fe793fff700 1 -- 172.21.15.82:0/627275745 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe79c083a80 con 0x7fe7ac159500 2023-10-06T03:17:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.478+0000 7fe7ab7fe700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe798066f30 0x7fe7980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.479+0000 7fe7ab7fe700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe798066f30 0x7fe7980693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00030c0 tx=0x7fe7a0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.482+0000 7fe793fff700 1 -- 172.21.15.82:0/627275745 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe79c050c10 con 0x7fe7ac159500 2023-10-06T03:17:12.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.664+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe7ac151a60 con 0x7fe7ac159500 2023-10-06T03:17:12.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.665+0000 7fe793fff700 1 -- 172.21.15.82:0/627275745 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe79c018020 con 0x7fe7ac159500 2023-10-06T03:17:12.666 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:17:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe798066f30 msgr2=0x7fe7980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe798066f30 0x7fe7980693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00030c0 tx=0x7fe7a0016000 comp rx=0 tx=0).stop 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac159500 msgr2=0x7fe7ac1482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac159500 0x7fe7ac1482c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00cb70 tx=0x7fe79c001b50 comp rx=0 tx=0).stop 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 shutdown_connections 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe798066f30 0x7fe7980693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7ac15d8e0 0x7fe7ac0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac159500 0x7fe7ac1482c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 --2- 172.21.15.82:0/627275745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ac1598d0 0x7fe7ac150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 >> 172.21.15.82:0/627275745 conn(0x7fe7ac067630 msgr2=0x7fe7ac153600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 shutdown_connections 2023-10-06T03:17:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.667+0000 7fe7b240c700 1 -- 172.21.15.82:0/627275745 wait complete. 2023-10-06T03:17:12.680 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:17:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.796+0000 7f5da58f3700 1 Processor -- start 2023-10-06T03:17:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.796+0000 7f5da58f3700 1 -- start start 2023-10-06T03:17:12.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.797+0000 7f5da58f3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5da00c80d0 0x7f5da01613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.797+0000 7f5da58f3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da00c87a0 con 0x7f5da013fb10 2023-10-06T03:17:12.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.797+0000 7f5da58f3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da006adb0 con 0x7f5da013fee0 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.797+0000 7f5da58f3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da006b090 con 0x7f5da00c80d0 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.797+0000 7f5d9f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5da00c80d0 0x7f5da01613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.797+0000 7f5d9effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5da013fb10 0x7f5da006a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43190/0 (socket says 172.21.15.82:43190) 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.797+0000 7f5d9effd700 1 -- 172.21.15.82:0/4215550845 learned_addr learned my addr 172.21.15.82:0/4215550845 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5d9f7fe700 1 -- 172.21.15.82:0/4215550845 >> v1:172.21.15.134:6789/0 conn(0x7f5da013fee0 legacy=0x7f5da00c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5d9f7fe700 1 -- 172.21.15.82:0/4215550845 >> v1:172.21.15.82:6789/0 conn(0x7f5da013fb10 legacy=0x7f5da006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5d9f7fe700 1 -- 172.21.15.82:0/4215550845 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da006b370 con 0x7f5da00c80d0 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5d9e7fc700 1 -- 172.21.15.82:0/4215550845 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118144144 0 0) 0x7f5da00c87a0 con 0x7f5da013fb10 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5d9f7fe700 1 --2- 172.21.15.82:0/4215550845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da00c80d0 0x7f5da01613a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800d0d0 tx=0x7f5d9800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf319691a4650d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5d9e7fc700 1 -- 172.21.15.82:0/4215550845 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98010070 con 0x7f5da00c80d0 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5d9e7fc700 1 -- 172.21.15.82:0/4215550845 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9800ddf0 con 0x7f5da00c80d0 2023-10-06T03:17:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5d9e7fc700 1 -- 172.21.15.82:0/4215550845 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800b320 con 0x7f5da00c80d0 2023-10-06T03:17:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5da58f3700 1 -- 172.21.15.82:0/4215550845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da00c80d0 msgr2=0x7f5da01613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5da58f3700 1 --2- 172.21.15.82:0/4215550845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da00c80d0 0x7f5da01613a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800d0d0 tx=0x7f5d9800b990 comp rx=0 tx=0).stop 2023-10-06T03:17:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5da58f3700 1 -- 172.21.15.82:0/4215550845 shutdown_connections 2023-10-06T03:17:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5da58f3700 1 --2- 172.21.15.82:0/4215550845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da00c80d0 0x7f5da01613a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5da58f3700 1 -- 172.21.15.82:0/4215550845 >> 172.21.15.82:0/4215550845 conn(0x7f5da006e760 msgr2=0x7f5da006eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5da58f3700 1 -- 172.21.15.82:0/4215550845 shutdown_connections 2023-10-06T03:17:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.798+0000 7f5da58f3700 1 -- 172.21.15.82:0/4215550845 wait complete. 2023-10-06T03:17:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5da58f3700 1 Processor -- start 2023-10-06T03:17:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5da58f3700 1 -- start start 2023-10-06T03:17:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5da58f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5da00c80d0 0x7f5da0131010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5da58f3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da013fb10 0x7f5da00c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5da58f3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5da013fee0 0x7f5da00c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5da58f3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0156a50 con 0x7f5da013fb10 2023-10-06T03:17:12.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5da58f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da00c6430 con 0x7f5da00c80d0 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5da58f3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0156ca0 con 0x7f5da013fee0 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5d967fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da013fb10 0x7f5da00c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.800+0000 7f5d967fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da013fb10 0x7f5da00c2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52280/0 (socket says 172.21.15.82:52280) 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d967fc700 1 -- 172.21.15.82:0/427249632 learned_addr learned my addr 172.21.15.82:0/427249632 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d9f7fe700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5da013fee0 0x7f5da00c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d9effd700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5da00c80d0 0x7f5da0131010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d967fc700 1 -- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5da013fee0 msgr2=0x7f5da00c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d967fc700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5da013fee0 0x7f5da00c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d967fc700 1 -- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5da00c80d0 msgr2=0x7f5da0131010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d967fc700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5da00c80d0 0x7f5da0131010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d967fc700 1 -- 172.21.15.82:0/427249632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9800bc30 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d967fc700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da013fb10 0x7f5da00c2220 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800c7c0 tx=0x7f5d88007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d977fe700 1 -- 172.21.15.82:0/427249632 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88011590 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d977fe700 1 -- 172.21.15.82:0/427249632 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d880116f0 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da0156f80 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5d977fe700 1 -- 172.21.15.82:0/427249632 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88011ab0 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.801+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da0131550 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.802+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da01574a0 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.802+0000 7f5d977fe700 1 -- 172.21.15.82:0/427249632 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d8801b3b0 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.803+0000 7f5d977fe700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5d80066f30 0x7f5d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.803+0000 7f5d977fe700 1 -- 172.21.15.82:0/427249632 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d88083ac0 con 0x7f5da013fb10 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.803+0000 7f5d9effd700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5d80066f30 0x7f5d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.803+0000 7f5d9effd700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5d80066f30 0x7f5d800693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5da00c7920 tx=0x7f5d90007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:12.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.807+0000 7f5d977fe700 1 -- 172.21.15.82:0/427249632 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5da01574a0 con 0x7f5da013fb10 2023-10-06T03:17:12.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.992+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5da01574a0 con 0x7f5da013fb10 2023-10-06T03:17:12.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.993+0000 7f5d977fe700 1 -- 172.21.15.82:0/427249632 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5da01574a0 con 0x7f5da013fb10 2023-10-06T03:17:12.994 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:17:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5d80066f30 msgr2=0x7f5d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5d80066f30 0x7f5d800693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5da00c7920 tx=0x7f5d90007d10 comp rx=0 tx=0).stop 2023-10-06T03:17:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da013fb10 msgr2=0x7f5da00c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da013fb10 0x7f5da00c2220 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800c7c0 tx=0x7f5d88007ef0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 shutdown_connections 2023-10-06T03:17:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5d80066f30 0x7f5d800693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5da013fee0 0x7f5da00c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5da00c80d0 0x7f5da0131010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 --2- 172.21.15.82:0/427249632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da013fb10 0x7f5da00c2220 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 >> 172.21.15.82:0/427249632 conn(0x7f5da006e760 msgr2=0x7f5da013ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 shutdown_connections 2023-10-06T03:17:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:12.995+0000 7f5da58f3700 1 -- 172.21.15.82:0/427249632 wait complete. 2023-10-06T03:17:13.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:17:13.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.123+0000 7f74aede2700 1 Processor -- start 2023-10-06T03:17:13.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.123+0000 7f74aede2700 1 -- start start 2023-10-06T03:17:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.124+0000 7f74aede2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a815dab0 0x7f74a80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.124+0000 7f74aede2700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80b1110 con 0x7f74a81598d0 2023-10-06T03:17:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.124+0000 7f74aede2700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80b13b0 con 0x7f74a8159500 2023-10-06T03:17:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.124+0000 7f74aede2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80b1690 con 0x7f74a815dab0 2023-10-06T03:17:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.124+0000 7f749ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f74a81598d0 0x7f74a815d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43204/0 (socket says 172.21.15.82:43204) 2023-10-06T03:17:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.124+0000 7f749ffff700 1 -- 172.21.15.82:0/2872161455 learned_addr learned my addr 172.21.15.82:0/2872161455 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:13.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.124+0000 7f74ad37f700 1 --2- 172.21.15.82:0/2872161455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a815dab0 0x7f74a80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f749f7fe700 1 -- 172.21.15.82:0/2872161455 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409278866 0 0) 0x7f74a80b1110 con 0x7f74a81598d0 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f749f7fe700 1 -- 172.21.15.82:0/2872161455 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7490003570 con 0x7f74a81598d0 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f749f7fe700 1 -- 172.21.15.82:0/2872161455 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310366202 0 0) 0x7f74a80b13b0 con 0x7f74a8159500 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f74ad37f700 1 -- 172.21.15.82:0/2872161455 >> v1:172.21.15.134:6789/0 conn(0x7f74a8159500 legacy=0x7f74a80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f74ad37f700 1 -- 172.21.15.82:0/2872161455 >> v1:172.21.15.82:6789/0 conn(0x7f74a81598d0 legacy=0x7f74a815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f74ad37f700 1 -- 172.21.15.82:0/2872161455 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80b1970 con 0x7f74a815dab0 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f74ad37f700 1 --2- 172.21.15.82:0/2872161455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a815dab0 0x7f74a80cf6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009910 tx=0x7f74a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f38cf9b78a8e6b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f749f7fe700 1 -- 172.21.15.82:0/2872161455 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000b680 con 0x7f74a815dab0 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f749f7fe700 1 -- 172.21.15.82:0/2872161455 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000b7e0 con 0x7f74a815dab0 2023-10-06T03:17:13.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.125+0000 7f749f7fe700 1 -- 172.21.15.82:0/2872161455 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000bb60 con 0x7f74a815dab0 2023-10-06T03:17:13.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.126+0000 7f74aede2700 1 -- 172.21.15.82:0/2872161455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a815dab0 msgr2=0x7f74a80cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.126+0000 7f74aede2700 1 --2- 172.21.15.82:0/2872161455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a815dab0 0x7f74a80cf6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009910 tx=0x7f74a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.126+0000 7f74aede2700 1 -- 172.21.15.82:0/2872161455 shutdown_connections 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.126+0000 7f74aede2700 1 --2- 172.21.15.82:0/2872161455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a815dab0 0x7f74a80cf6c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.126+0000 7f74aede2700 1 -- 172.21.15.82:0/2872161455 >> 172.21.15.82:0/2872161455 conn(0x7f74a8067630 msgr2=0x7f74a8069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.126+0000 7f74aede2700 1 -- 172.21.15.82:0/2872161455 shutdown_connections 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.126+0000 7f74aede2700 1 -- 172.21.15.82:0/2872161455 wait complete. 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.127+0000 7f74aede2700 1 Processor -- start 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.127+0000 7f74aede2700 1 -- start start 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74aede2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a8159500 0x7f74a815cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74aede2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a81598d0 0x7f74a816d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74aede2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74a815dab0 0x7f74a813ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74aede2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8169db0 con 0x7f74a815dab0 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74aede2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a814e520 con 0x7f74a81598d0 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74aede2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a815b640 con 0x7f74a8159500 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74a815dab0 0x7f74a813ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74a815dab0 0x7f74a813ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52286/0 (socket says 172.21.15.82:52286) 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 -- 172.21.15.82:0/718579098 learned_addr learned my addr 172.21.15.82:0/718579098 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f749ffff700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a81598d0 0x7f74a816d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74acb7e700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a8159500 0x7f74a815cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 -- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a8159500 msgr2=0x7f74a815cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a8159500 0x7f74a815cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 -- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a81598d0 msgr2=0x7f74a816d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a81598d0 0x7f74a816d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 -- 172.21.15.82:0/718579098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0009420 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74ad37f700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74a815dab0 0x7f74a813ef90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f74a8088d00 tx=0x7f74a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f749cff9700 1 -- 172.21.15.82:0/718579098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a001f070 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f749cff9700 1 -- 172.21.15.82:0/718579098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0024460 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a816e290 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f749cff9700 1 -- 172.21.15.82:0/718579098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000bb60 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.128+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a816dcd0 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.129+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a8064050 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.130+0000 7f749cff9700 1 -- 172.21.15.82:0/718579098 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74a0024a30 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.130+0000 7f749cff9700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.130+0000 7f749cff9700 1 -- 172.21.15.82:0/718579098 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74a0085ca0 con 0x7f74a815dab0 2023-10-06T03:17:13.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.130+0000 7f74acb7e700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.131+0000 7f74acb7e700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7494066f30 0x7f74940693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f74a4001560 tx=0x7f74a40016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.134+0000 7f749cff9700 1 -- 172.21.15.82:0/718579098 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74a0052e70 con 0x7f74a815dab0 2023-10-06T03:17:13.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.315+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74a814e660 con 0x7f74a815dab0 2023-10-06T03:17:13.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.315+0000 7f749cff9700 1 -- 172.21.15.82:0/718579098 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74a0056490 con 0x7f74a815dab0 2023-10-06T03:17:13.316 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:17:13.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7494066f30 msgr2=0x7f74940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7494066f30 0x7f74940693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f74a4001560 tx=0x7f74a40016f0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74a815dab0 msgr2=0x7f74a813ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74a815dab0 0x7f74a813ef90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f74a8088d00 tx=0x7f74a0017000 comp rx=0 tx=0).stop 2023-10-06T03:17:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 shutdown_connections 2023-10-06T03:17:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74a815dab0 0x7f74a813ef90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74a8159500 0x7f74a815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 --2- 172.21.15.82:0/718579098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a81598d0 0x7f74a816d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 >> 172.21.15.82:0/718579098 conn(0x7f74a8067630 msgr2=0x7f74a8158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 shutdown_connections 2023-10-06T03:17:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.317+0000 7f74aede2700 1 -- 172.21.15.82:0/718579098 wait complete. 2023-10-06T03:17:13.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:17:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.448+0000 7f5821dc8700 1 Processor -- start 2023-10-06T03:17:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.448+0000 7f5821dc8700 1 -- start start 2023-10-06T03:17:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f5821dc8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f581c1598d0 0x7f581c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f5821dc8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581c15dd20 con 0x7f581c159500 2023-10-06T03:17:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f5821dc8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581c0b1110 con 0x7f581c15d8e0 2023-10-06T03:17:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f5821dc8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581c0b13b0 con 0x7f581c1598d0 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f581c159500 0x7f581c0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43216/0 (socket says 172.21.15.82:43216) 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581b7fe700 1 -- 172.21.15.82:0/3426174681 learned_addr learned my addr 172.21.15.82:0/3426174681 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148692631 0 0) 0x7f581c15dd20 con 0x7f581c159500 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581affd700 1 --2- 172.21.15.82:0/3426174681 >> v2:172.21.15.134:3300/0 conn(0x7f581c1598d0 0x7f581c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5804003570 con 0x7f581c159500 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3169791767 0 0) 0x7f5804003570 con 0x7f581c159500 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 >> v2:172.21.15.134:3300/0 conn(0x7f581c1598d0 msgr2=0x7f581c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 --2- 172.21.15.82:0/3426174681 >> v2:172.21.15.134:3300/0 conn(0x7f581c1598d0 0x7f581c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 >> v1:172.21.15.134:6789/0 conn(0x7f581c15d8e0 legacy=0x7f581c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c0b1690 con 0x7f581c159500 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f580c001470 con 0x7f581c159500 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 >> v1:172.21.15.82:6789/0 conn(0x7f581c159500 legacy=0x7f581c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5804003a60 0x7f5804003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5804004810 0x7f5804004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58040051c0 0x7f580400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c0b13b0 con 0x7f5804003a60 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580400c0d0 con 0x7f5804004810 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580400c290 con 0x7f58040051c0 2023-10-06T03:17:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.449+0000 7f581b7fe700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5804003a60 0x7f5804003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581affd700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5804004810 0x7f5804004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581bfff700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58040051c0 0x7f580400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581affd700 1 -- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58040051c0 msgr2=0x7f580400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581affd700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f58040051c0 0x7f580400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581affd700 1 -- 172.21.15.82:0/3426174681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5804003a60 msgr2=0x7f5804003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581affd700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5804003a60 0x7f5804003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581affd700 1 -- 172.21.15.82:0/3426174681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804003570 con 0x7f5804004810 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581bfff700 1 -- 172.21.15.82:0/3426174681 reap_dead start 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581affd700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5804004810 0x7f5804004c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5810009c00 tx=0x7f58100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ad84dcbb257a739 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581000e710 con 0x7f5804004810 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581000e870 con 0x7f5804004810 2023-10-06T03:17:13.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.450+0000 7f581a7fc700 1 -- 172.21.15.82:0/3426174681 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581000ec30 con 0x7f5804004810 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.451+0000 7f5821dc8700 1 -- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5804004810 msgr2=0x7f5804004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.451+0000 7f5821dc8700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5804004810 0x7f5804004c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5810009c00 tx=0x7f58100091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.451+0000 7f5821dc8700 1 -- 172.21.15.82:0/3426174681 shutdown_connections 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.451+0000 7f5821dc8700 1 --2- 172.21.15.82:0/3426174681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5804004810 0x7f5804004c80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.451+0000 7f5821dc8700 1 -- 172.21.15.82:0/3426174681 >> 172.21.15.82:0/3426174681 conn(0x7f581c067630 msgr2=0x7f581c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.451+0000 7f5821dc8700 1 -- 172.21.15.82:0/3426174681 shutdown_connections 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.451+0000 7f5821dc8700 1 -- 172.21.15.82:0/3426174681 wait complete. 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.452+0000 7f5821dc8700 1 Processor -- start 2023-10-06T03:17:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.452+0000 7f5821dc8700 1 -- start start 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f5821dc8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5804004810 0x7f581c069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f5821dc8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f581c169d20 0x7f581c151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f5821dc8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f581c150070 0x7f581c150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f5821dc8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c16ace0 con 0x7f581c169d20 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f5821dc8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c14d630 con 0x7f581c150070 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f5821dc8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c16d570 con 0x7f5804004810 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f581c169d20 0x7f581c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f581c169d20 0x7f581c151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52300/0 (socket says 172.21.15.82:52300) 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581b7fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5804004810 0x7f581c069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 -- 172.21.15.82:0/1430667190 learned_addr learned my addr 172.21.15.82:0/1430667190 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581bfff700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f581c150070 0x7f581c150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 -- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5804004810 msgr2=0x7f581c069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5804004810 0x7f581c069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 -- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f581c150070 msgr2=0x7f581c150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f581c150070 0x7f581c150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 -- 172.21.15.82:0/1430667190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c16a190 con 0x7f581c169d20 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f581affd700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f581c169d20 0x7f581c151320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f580400c260 tx=0x7f581001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f58037fe700 1 -- 172.21.15.82:0/1430667190 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810022070 con 0x7f581c169d20 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f58037fe700 1 -- 172.21.15.82:0/1430667190 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581000e9e0 con 0x7f581c169d20 2023-10-06T03:17:13.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f58037fe700 1 -- 172.21.15.82:0/1430667190 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810027470 con 0x7f581c169d20 2023-10-06T03:17:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c16a440 con 0x7f581c169d20 2023-10-06T03:17:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.453+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c16aa00 con 0x7f581c169d20 2023-10-06T03:17:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.454+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c16d340 con 0x7f581c169d20 2023-10-06T03:17:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.455+0000 7f58037fe700 1 -- 172.21.15.82:0/1430667190 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f581001c450 con 0x7f581c169d20 2023-10-06T03:17:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.455+0000 7f58037fe700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5808066f30 0x7f58080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.455+0000 7f58037fe700 1 -- 172.21.15.82:0/1430667190 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5810086220 con 0x7f581c169d20 2023-10-06T03:17:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.455+0000 7f581b7fe700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5808066f30 0x7f58080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.456+0000 7f581b7fe700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5808066f30 0x7f58080693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f581c156aa0 tx=0x7f580c001e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.460+0000 7f58037fe700 1 -- 172.21.15.82:0/1430667190 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f581c16d340 con 0x7f581c169d20 2023-10-06T03:17:13.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.640+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f581c16d340 con 0x7f581c169d20 2023-10-06T03:17:13.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.641+0000 7f58037fe700 1 -- 172.21.15.82:0/1430667190 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f581c16d340 con 0x7f581c169d20 2023-10-06T03:17:13.641 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:17:13.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5808066f30 msgr2=0x7f58080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5808066f30 0x7f58080693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f581c156aa0 tx=0x7f580c001e50 comp rx=0 tx=0).stop 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f581c169d20 msgr2=0x7f581c151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f581c169d20 0x7f581c151320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f580400c260 tx=0x7f581001a000 comp rx=0 tx=0).stop 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 shutdown_connections 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f581c150070 0x7f581c150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5808066f30 0x7f58080693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5804004810 0x7f581c069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 --2- 172.21.15.82:0/1430667190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f581c169d20 0x7f581c151320 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 >> 172.21.15.82:0/1430667190 conn(0x7f581c067630 msgr2=0x7f581c158570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 shutdown_connections 2023-10-06T03:17:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.642+0000 7f5821dc8700 1 -- 172.21.15.82:0/1430667190 wait complete. 2023-10-06T03:17:13.655 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.768+0000 7fac03e3c700 1 Processor -- start 2023-10-06T03:17:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.768+0000 7fac03e3c700 1 -- start start 2023-10-06T03:17:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.769+0000 7fac03e3c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabfc15d560 0x7fabfc0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.769+0000 7fac03e3c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fabfc15d930 0x7fabfc0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.769+0000 7fac03e3c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0b2ad0 con 0x7fabfc1591b0 2023-10-06T03:17:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.769+0000 7fac03e3c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0b4160 con 0x7fabfc15d560 2023-10-06T03:17:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.769+0000 7fac03e3c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0b1f80 con 0x7fabfc15d930 2023-10-06T03:17:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.769+0000 7fac01bd8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabfc15d560 0x7fabfc0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.769+0000 7fac01bd8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabfc15d560 0x7fabfc0d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52310/0 (socket says 172.21.15.82:52310) 2023-10-06T03:17:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.769+0000 7fac01bd8700 1 -- 172.21.15.82:0/4290065303 learned_addr learned my addr 172.21.15.82:0/4290065303 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac013d7700 1 --2- 172.21.15.82:0/4290065303 >> v2:172.21.15.134:3300/0 conn(0x7fabfc15d930 0x7fabfc0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac01bd8700 1 -- 172.21.15.82:0/4290065303 >> v2:172.21.15.134:3300/0 conn(0x7fabfc15d930 msgr2=0x7fabfc0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac01bd8700 1 --2- 172.21.15.82:0/4290065303 >> v2:172.21.15.134:3300/0 conn(0x7fabfc15d930 0x7fabfc0b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac01bd8700 1 -- 172.21.15.82:0/4290065303 >> v1:172.21.15.134:6789/0 conn(0x7fabfc1591b0 legacy=0x7fabfc159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac01bd8700 1 -- 172.21.15.82:0/4290065303 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc0b2230 con 0x7fabfc15d560 2023-10-06T03:17:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac01bd8700 1 --2- 172.21.15.82:0/4290065303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d560 0x7fabfc0d0030 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabfc15e440 tx=0x7fabf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ddfada51891151 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac00bd6700 1 -- 172.21.15.82:0/4290065303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf800b820 con 0x7fabfc15d560 2023-10-06T03:17:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac00bd6700 1 -- 172.21.15.82:0/4290065303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf800b980 con 0x7fabfc15d560 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac00bd6700 1 -- 172.21.15.82:0/4290065303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf800bd20 con 0x7fabfc15d560 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac03e3c700 1 -- 172.21.15.82:0/4290065303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d560 msgr2=0x7fabfc0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac03e3c700 1 --2- 172.21.15.82:0/4290065303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d560 0x7fabfc0d0030 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabfc15e440 tx=0x7fabf8009250 comp rx=0 tx=0).stop 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac03e3c700 1 -- 172.21.15.82:0/4290065303 shutdown_connections 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac03e3c700 1 --2- 172.21.15.82:0/4290065303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d560 0x7fabfc0d0030 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac03e3c700 1 --2- 172.21.15.82:0/4290065303 >> v2:172.21.15.134:3300/0 conn(0x7fabfc15d930 0x7fabfc0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.770+0000 7fac03e3c700 1 -- 172.21.15.82:0/4290065303 >> 172.21.15.82:0/4290065303 conn(0x7fabfc0d1180 msgr2=0x7fabfc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.771+0000 7fac03e3c700 1 -- 172.21.15.82:0/4290065303 shutdown_connections 2023-10-06T03:17:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.771+0000 7fac03e3c700 1 -- 172.21.15.82:0/4290065303 wait complete. 2023-10-06T03:17:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.772+0000 7fac03e3c700 1 Processor -- start 2023-10-06T03:17:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.772+0000 7fac03e3c700 1 -- start start 2023-10-06T03:17:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.772+0000 7fac03e3c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabfc1591b0 0x7fabfc14c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.772+0000 7fac03e3c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fabfc15d560 0x7fabfc15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.772+0000 7fac03e3c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d930 0x7fabfc15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.772+0000 7fac03e3c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc15c7b0 con 0x7fabfc15d930 2023-10-06T03:17:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.772+0000 7fac03e3c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc14f150 con 0x7fabfc1591b0 2023-10-06T03:17:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.772+0000 7fac03e3c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc14eb40 con 0x7fabfc15d560 2023-10-06T03:17:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d930 0x7fabfc15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d930 0x7fabfc15c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52314/0 (socket says 172.21.15.82:52314) 2023-10-06T03:17:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 -- 172.21.15.82:0/867376889 learned_addr learned my addr 172.21.15.82:0/867376889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac01bd8700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabfc1591b0 0x7fabfc14c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac013d7700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fabfc15d560 0x7fabfc15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 -- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fabfc15d560 msgr2=0x7fabfc15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fabfc15d560 0x7fabfc15acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 -- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabfc1591b0 msgr2=0x7fabfc14c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabfc1591b0 0x7fabfc14c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 -- 172.21.15.82:0/867376889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80094f0 con 0x7fabfc15d930 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac023d9700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d930 0x7fabfc15c270 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fabf400bc30 tx=0x7fabf4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fabf1ffb700 1 -- 172.21.15.82:0/867376889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400c840 con 0x7fabfc15d930 2023-10-06T03:17:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fabf1ffb700 1 -- 172.21.15.82:0/867376889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400c9e0 con 0x7fabfc15d930 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc15c9e0 con 0x7fabfc15d930 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fabf1ffb700 1 -- 172.21.15.82:0/867376889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400cda0 con 0x7fabfc15d930 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.773+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc15ccc0 con 0x7fabfc15d930 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.774+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc14e9a0 con 0x7fabfc15d930 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.775+0000 7fabf1ffb700 1 -- 172.21.15.82:0/867376889 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabf4014620 con 0x7fabfc15d930 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.775+0000 7fabf1ffb700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fabe0066f30 0x7fabe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.775+0000 7fabf1ffb700 1 -- 172.21.15.82:0/867376889 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fabf40845e0 con 0x7fabfc15d930 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.775+0000 7fac01bd8700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fabe0066f30 0x7fabe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.776+0000 7fac01bd8700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fabe0066f30 0x7fabe00693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fabfc15e440 tx=0x7fabf8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:13.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:13.779+0000 7fabf1ffb700 1 -- 172.21.15.82:0/867376889 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabfc14e9a0 con 0x7fabfc15d930 2023-10-06T03:17:14.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.002+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabfc14e9a0 con 0x7fabfc15d930 2023-10-06T03:17:14.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.003+0000 7fabf1ffb700 1 -- 172.21.15.82:0/867376889 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fabfc14e9a0 con 0x7fabfc15d930 2023-10-06T03:17:14.004 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:14.004 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2460851709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2460851709},{"type":"v1","addr":"172.21.15.134:6837","nonce":2460851709}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/771524024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":771524024},{"type":"v1","addr":"172.21.15.134:6836","nonce":771524024}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/3256175471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3256175471},{"type":"v1","addr":"172.21.15.82:6834","nonce":3256175471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:02.753418+0000","modified":"2023-10-06T03:17:06.382667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1910803570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1910803570},{"type":"v1","addr":"172.21.15.82:6835","nonce":1910803570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:17:14.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fabe0066f30 msgr2=0x7fabe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fabe0066f30 0x7fabe00693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fabfc15e440 tx=0x7fabf8016000 comp rx=0 tx=0).stop 2023-10-06T03:17:14.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d930 msgr2=0x7fabfc15c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d930 0x7fabfc15c270 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fabf400bc30 tx=0x7fabf4009820 comp rx=0 tx=0).stop 2023-10-06T03:17:14.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 shutdown_connections 2023-10-06T03:17:14.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabfc15d930 0x7fabfc15c270 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabfc1591b0 0x7fabfc14c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fabe0066f30 0x7fabe00693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 --2- 172.21.15.82:0/867376889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fabfc15d560 0x7fabfc15acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 >> 172.21.15.82:0/867376889 conn(0x7fabfc0d1180 msgr2=0x7fabfc14ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:14.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 shutdown_connections 2023-10-06T03:17:14.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.005+0000 7fac03e3c700 1 -- 172.21.15.82:0/867376889 wait complete. 2023-10-06T03:17:14.008 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2023-10-06T03:17:14.017 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:14.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.130+0000 7f47d1bbf700 1 Processor -- start 2023-10-06T03:17:14.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.130+0000 7f47d1bbf700 1 -- start start 2023-10-06T03:17:14.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.131+0000 7f47d1bbf700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f47cc0af6c0 0x7f47cc161480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.131+0000 7f47d1bbf700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0cad60 con 0x7f47cc156760 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.131+0000 7f47d1bbf700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0b1530 con 0x7f47cc156390 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.131+0000 7f47d1bbf700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0ca430 con 0x7f47cc0af6c0 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.131+0000 7f47caffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f47cc156760 0x7f47cc0b1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43222/0 (socket says 172.21.15.82:43222) 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.131+0000 7f47caffd700 1 -- 172.21.15.82:0/45962070 learned_addr learned my addr 172.21.15.82:0/45962070 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cbfff700 1 --2- 172.21.15.82:0/45962070 >> v2:172.21.15.134:3300/0 conn(0x7f47cc0af6c0 0x7f47cc161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376411525 0 0) 0x7f47cc0cad60 con 0x7f47cc156760 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b4003570 con 0x7f47cc156760 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 536275299 0 0) 0x7f47b4003570 con 0x7f47cc156760 2023-10-06T03:17:14.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 >> v2:172.21.15.134:3300/0 conn(0x7f47cc0af6c0 msgr2=0x7f47cc161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 --2- 172.21.15.82:0/45962070 >> v2:172.21.15.134:3300/0 conn(0x7f47cc0af6c0 0x7f47cc161480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 >> v1:172.21.15.134:6789/0 conn(0x7f47cc156390 legacy=0x7f47cc0b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0ca710 con 0x7f47cc156760 2023-10-06T03:17:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f47c0001470 con 0x7f47cc156760 2023-10-06T03:17:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 >> v1:172.21.15.82:6789/0 conn(0x7f47cc156760 legacy=0x7f47cc0b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4003a60 0x7f47b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b4004810 0x7f47b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b40051c0 0x7f47b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0ca430 con 0x7f47b4003a60 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b400c160 con 0x7f47b4004810 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b400c320 con 0x7f47b40051c0 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cb7fe700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4003a60 0x7f47b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47caffd700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b4004810 0x7f47b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cbfff700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b40051c0 0x7f47b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cb7fe700 1 -- 172.21.15.82:0/45962070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b40051c0 msgr2=0x7f47b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cb7fe700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b40051c0 0x7f47b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cb7fe700 1 -- 172.21.15.82:0/45962070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b4004810 msgr2=0x7f47b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cb7fe700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b4004810 0x7f47b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cb7fe700 1 -- 172.21.15.82:0/45962070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4003570 con 0x7f47b4003a60 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.132+0000 7f47cbfff700 1 -- 172.21.15.82:0/45962070 reap_dead start 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47cb7fe700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4003a60 0x7f47b4003e70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0018b0 tx=0x7f47bc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e87f1f4244f981 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc012420 con 0x7f47b4003a60 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc0125a0 con 0x7f47b4003a60 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47ca7fc700 1 -- 172.21.15.82:0/45962070 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc012960 con 0x7f47b4003a60 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47d1bbf700 1 -- 172.21.15.82:0/45962070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4003a60 msgr2=0x7f47b4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47d1bbf700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4003a60 0x7f47b4003e70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0018b0 tx=0x7f47bc007d30 comp rx=0 tx=0).stop 2023-10-06T03:17:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47d1bbf700 1 -- 172.21.15.82:0/45962070 shutdown_connections 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47d1bbf700 1 --2- 172.21.15.82:0/45962070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4003a60 0x7f47b4003e70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47d1bbf700 1 -- 172.21.15.82:0/45962070 >> 172.21.15.82:0/45962070 conn(0x7f47cc06e6b0 msgr2=0x7f47cc06afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47d1bbf700 1 -- 172.21.15.82:0/45962070 shutdown_connections 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.133+0000 7f47d1bbf700 1 -- 172.21.15.82:0/45962070 wait complete. 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.134+0000 7f47d1bbf700 1 Processor -- start 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.134+0000 7f47d1bbf700 1 -- start start 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47d1bbf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b4003a60 0x7f47cc0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47d1bbf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0cb8d0 0x7f47cc069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47d1bbf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06a1e0 0x7f47cc06a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47d1bbf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc06abc0 con 0x7f47cc06a1e0 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47d1bbf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0cbd70 con 0x7f47cc0cb8d0 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47d1bbf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0cc050 con 0x7f47b4003a60 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06a1e0 0x7f47cc06a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06a1e0 0x7f47cc06a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52334/0 (socket says 172.21.15.82:52334) 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47cbfff700 1 -- 172.21.15.82:0/284812524 learned_addr learned my addr 172.21.15.82:0/284812524 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47caffd700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0cb8d0 0x7f47cc069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.135+0000 7f47cb7fe700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b4003a60 0x7f47cc0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47cbfff700 1 -- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b4003a60 msgr2=0x7f47cc0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47cbfff700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b4003a60 0x7f47cc0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47cbfff700 1 -- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0cb8d0 msgr2=0x7f47cc069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47cbfff700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0cb8d0 0x7f47cc069ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47cbfff700 1 -- 172.21.15.82:0/284812524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0cc330 con 0x7f47cc06a1e0 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47cb7fe700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b4003a60 0x7f47cc0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47cbfff700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06a1e0 0x7f47cc06a680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f47cc064e00 tx=0x7f47c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47b37fe700 1 -- 172.21.15.82:0/284812524 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c400e070 con 0x7f47cc06a1e0 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47b37fe700 1 -- 172.21.15.82:0/284812524 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c4011d00 con 0x7f47cc06a1e0 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc0cc610 con 0x7f47cc06a1e0 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47b37fe700 1 -- 172.21.15.82:0/284812524 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c40166e0 con 0x7f47cc06a1e0 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.136+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc147d30 con 0x7f47cc06a1e0 2023-10-06T03:17:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.137+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc064050 con 0x7f47cc06a1e0 2023-10-06T03:17:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.137+0000 7f47b37fe700 1 -- 172.21.15.82:0/284812524 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47c4016ad0 con 0x7f47cc06a1e0 2023-10-06T03:17:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.137+0000 7f47b37fe700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47b8066f30 0x7f47b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.138+0000 7f47b37fe700 1 -- 172.21.15.82:0/284812524 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47c4085030 con 0x7f47cc06a1e0 2023-10-06T03:17:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.138+0000 7f47cb7fe700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47b8066f30 0x7f47b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.138+0000 7f47cb7fe700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47b8066f30 0x7f47b80693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47bc001690 tx=0x7f47bc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.142+0000 7f47b37fe700 1 -- 172.21.15.82:0/284812524 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47c4052200 con 0x7f47cc06a1e0 2023-10-06T03:17:14.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.324+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47cc0aecc0 con 0x7f47cc06a1e0 2023-10-06T03:17:14.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.325+0000 7f47b37fe700 1 -- 172.21.15.82:0/284812524 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f47c4009780 con 0x7f47cc06a1e0 2023-10-06T03:17:14.326 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:14.326 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":43,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:04.321808+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:00.394566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:01.721357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:14.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47b8066f30 msgr2=0x7f47b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47b8066f30 0x7f47b80693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47bc001690 tx=0x7f47bc015000 comp rx=0 tx=0).stop 2023-10-06T03:17:14.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06a1e0 msgr2=0x7f47cc06a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06a1e0 0x7f47cc06a680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f47cc064e00 tx=0x7f47c400b040 comp rx=0 tx=0).stop 2023-10-06T03:17:14.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 shutdown_connections 2023-10-06T03:17:14.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06a1e0 0x7f47cc06a680 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f47b8066f30 0x7f47b80693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b4003a60 0x7f47cc0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 --2- 172.21.15.82:0/284812524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0cb8d0 0x7f47cc069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 >> 172.21.15.82:0/284812524 conn(0x7f47cc06e6b0 msgr2=0x7f47cc0c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:14.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 shutdown_connections 2023-10-06T03:17:14.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.327+0000 7f47d1bbf700 1 -- 172.21.15.82:0/284812524 wait complete. 2023-10-06T03:17:14.340 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:17:14.340 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:14.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.454+0000 7fd75d74a700 1 Processor -- start 2023-10-06T03:17:14.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.454+0000 7fd75d74a700 1 -- start start 2023-10-06T03:17:14.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.455+0000 7fd75d74a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d560 0x7fd7580d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.455+0000 7fd75d74a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7580b2ad0 con 0x7fd7581591b0 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.455+0000 7fd75d74a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7580b4160 con 0x7fd75815d930 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.455+0000 7fd75d74a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580b2230 con 0x7fd75815d560 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.455+0000 7fd7577fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd7581591b0 0x7fd758159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43224/0 (socket says 172.21.15.82:43224) 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.455+0000 7fd7577fe700 1 -- 172.21.15.82:0/4242456950 learned_addr learned my addr 172.21.15.82:0/4242456950 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd756ffd700 1 --2- 172.21.15.82:0/4242456950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d560 0x7fd7580d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd755ffb700 1 -- 172.21.15.82:0/4242456950 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975636819 0 0) 0x7fd7580b2ad0 con 0x7fd7581591b0 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd755ffb700 1 -- 172.21.15.82:0/4242456950 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd740003570 con 0x7fd7581591b0 2023-10-06T03:17:14.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd755ffb700 1 -- 172.21.15.82:0/4242456950 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857436486 0 0) 0x7fd7580b4160 con 0x7fd75815d930 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd755ffb700 1 -- 172.21.15.82:0/4242456950 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7580b2ad0 con 0x7fd75815d930 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd756ffd700 1 -- 172.21.15.82:0/4242456950 >> v1:172.21.15.134:6789/0 conn(0x7fd75815d930 legacy=0x7fd7580b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd756ffd700 1 -- 172.21.15.82:0/4242456950 >> v1:172.21.15.82:6789/0 conn(0x7fd7581591b0 legacy=0x7fd758159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd756ffd700 1 -- 172.21.15.82:0/4242456950 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580b2510 con 0x7fd75815d560 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd756ffd700 1 --2- 172.21.15.82:0/4242456950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d560 0x7fd7580d0030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd750009e90 tx=0x7fd750009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=108a724da0830585 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd755ffb700 1 -- 172.21.15.82:0/4242456950 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75000e070 con 0x7fd75815d560 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd755ffb700 1 -- 172.21.15.82:0/4242456950 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75000bb80 con 0x7fd75815d560 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.456+0000 7fd755ffb700 1 -- 172.21.15.82:0/4242456950 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750012430 con 0x7fd75815d560 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.457+0000 7fd75d74a700 1 -- 172.21.15.82:0/4242456950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d560 msgr2=0x7fd7580d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.457+0000 7fd75d74a700 1 --2- 172.21.15.82:0/4242456950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d560 0x7fd7580d0030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd750009e90 tx=0x7fd750009780 comp rx=0 tx=0).stop 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.457+0000 7fd75d74a700 1 -- 172.21.15.82:0/4242456950 shutdown_connections 2023-10-06T03:17:14.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.457+0000 7fd75d74a700 1 --2- 172.21.15.82:0/4242456950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d560 0x7fd7580d0030 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.457+0000 7fd75d74a700 1 -- 172.21.15.82:0/4242456950 >> 172.21.15.82:0/4242456950 conn(0x7fd7580d1180 msgr2=0x7fd758069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:14.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.457+0000 7fd75d74a700 1 -- 172.21.15.82:0/4242456950 shutdown_connections 2023-10-06T03:17:14.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.457+0000 7fd75d74a700 1 -- 172.21.15.82:0/4242456950 wait complete. 2023-10-06T03:17:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.458+0000 7fd75d74a700 1 Processor -- start 2023-10-06T03:17:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.458+0000 7fd75d74a700 1 -- start start 2023-10-06T03:17:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd75d74a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7581591b0 0x7fd758152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd75d74a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd75815d560 0x7fd758169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd75d74a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d930 0x7fd75814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd75d74a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75816d390 con 0x7fd7581591b0 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd75d74a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75816d670 con 0x7fd75815d560 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd75d74a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75816a2d0 con 0x7fd75815d930 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7581591b0 0x7fd758152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7581591b0 0x7fd758152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52342/0 (socket says 172.21.15.82:52342) 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 -- 172.21.15.82:0/976447856 learned_addr learned my addr 172.21.15.82:0/976447856 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd7567fc700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd75815d560 0x7fd758169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd7577fe700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d930 0x7fd75814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 -- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d930 msgr2=0x7fd75814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d930 0x7fd75814ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 -- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd75815d560 msgr2=0x7fd758169d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd75815d560 0x7fd758169d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 -- 172.21.15.82:0/976447856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009a20 con 0x7fd7581591b0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd7567fc700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd75815d560 0x7fd758169d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.459+0000 7fd756ffd700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7581591b0 0x7fd758152300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd758064a20 tx=0x7fd750019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.460+0000 7fd73effd700 1 -- 172.21.15.82:0/976447856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750012e00 con 0x7fd7581591b0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.460+0000 7fd73effd700 1 -- 172.21.15.82:0/976447856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75001b630 con 0x7fd7581591b0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.460+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75816a570 con 0x7fd7581591b0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.460+0000 7fd73effd700 1 -- 172.21.15.82:0/976447856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75001b9f0 con 0x7fd7581591b0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.460+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75816ab30 con 0x7fd7581591b0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.461+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd758064050 con 0x7fd7581591b0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.461+0000 7fd73effd700 1 -- 172.21.15.82:0/976447856 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd75001c400 con 0x7fd7581591b0 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.461+0000 7fd73effd700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd744066fb0 0x7fd744069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.461+0000 7fd73effd700 1 -- 172.21.15.82:0/976447856 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd7500862f0 con 0x7fd7581591b0 2023-10-06T03:17:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.462+0000 7fd7567fc700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd744066fb0 0x7fd744069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.462+0000 7fd7567fc700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd744066fb0 0x7fd744069460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd75815c9b0 tx=0x7fd74c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.466+0000 7fd73effd700 1 -- 172.21.15.82:0/976447856 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd750053410 con 0x7fd7581591b0 2023-10-06T03:17:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.689+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7580b27f0 con 0x7fd7581591b0 2023-10-06T03:17:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.690+0000 7fd73effd700 1 -- 172.21.15.82:0/976447856 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fd750056a30 con 0x7fd7581591b0 2023-10-06T03:17:14.690 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:14.691 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2460851709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2460851709},{"type":"v1","addr":"172.21.15.134:6837","nonce":2460851709}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/771524024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":771524024},{"type":"v1","addr":"172.21.15.134:6836","nonce":771524024}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/3256175471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3256175471},{"type":"v1","addr":"172.21.15.82:6834","nonce":3256175471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:02.753418+0000","modified":"2023-10-06T03:17:06.382667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1910803570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1910803570},{"type":"v1","addr":"172.21.15.82:6835","nonce":1910803570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:17:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd744066fb0 msgr2=0x7fd744069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd744066fb0 0x7fd744069460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd75815c9b0 tx=0x7fd74c009040 comp rx=0 tx=0).stop 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7581591b0 msgr2=0x7fd758152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7581591b0 0x7fd758152300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd758064a20 tx=0x7fd750019000 comp rx=0 tx=0).stop 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 shutdown_connections 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd744066fb0 0x7fd744069460 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd75815d930 0x7fd75814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7581591b0 0x7fd758152300 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 --2- 172.21.15.82:0/976447856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd75815d560 0x7fd758169d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 >> 172.21.15.82:0/976447856 conn(0x7fd7580d1180 msgr2=0x7fd75814cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 shutdown_connections 2023-10-06T03:17:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.692+0000 7fd75d74a700 1 -- 172.21.15.82:0/976447856 wait complete. 2023-10-06T03:17:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2023-10-06T03:17:14.704 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.817+0000 7fc399566700 1 Processor -- start 2023-10-06T03:17:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.817+0000 7fc399566700 1 -- start start 2023-10-06T03:17:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc399566700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3940cd6d0 0x7fc3940cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc399566700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc3940b2190 0x7fc3940b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc399566700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940cc390 con 0x7fc394157b70 2023-10-06T03:17:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc399566700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940cc630 con 0x7fc3940cd6d0 2023-10-06T03:17:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc399566700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940cc910 con 0x7fc3940b2190 2023-10-06T03:17:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc3937fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3940cd6d0 0x7fc3940cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc3937fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3940cd6d0 0x7fc3940cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52356/0 (socket says 172.21.15.82:52356) 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc3937fe700 1 -- 172.21.15.82:0/1507409505 learned_addr learned my addr 172.21.15.82:0/1507409505 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc3937fe700 1 -- 172.21.15.82:0/1507409505 >> v2:172.21.15.134:3300/0 conn(0x7fc3940b2190 msgr2=0x7fc3940b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc398d65700 1 --2- 172.21.15.82:0/1507409505 >> v2:172.21.15.134:3300/0 conn(0x7fc3940b2190 0x7fc3940b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc3937fe700 1 --2- 172.21.15.82:0/1507409505 >> v2:172.21.15.134:3300/0 conn(0x7fc3940b2190 0x7fc3940b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc3937fe700 1 -- 172.21.15.82:0/1507409505 >> v1:172.21.15.134:6789/0 conn(0x7fc394157b70 legacy=0x7fc394158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc3937fe700 1 -- 172.21.15.82:0/1507409505 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940ccbf0 con 0x7fc3940cd6d0 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.818+0000 7fc398d65700 1 --2- 172.21.15.82:0/1507409505 >> v2:172.21.15.134:3300/0 conn(0x7fc3940b2190 0x7fc3940b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc3937fe700 1 --2- 172.21.15.82:0/1507409505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940cdb50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc394068110 tx=0x7fc388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784038fd9fbc3704 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc392ffd700 1 -- 172.21.15.82:0/1507409505 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800b820 con 0x7fc3940cd6d0 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc392ffd700 1 -- 172.21.15.82:0/1507409505 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38800b980 con 0x7fc3940cd6d0 2023-10-06T03:17:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc392ffd700 1 -- 172.21.15.82:0/1507409505 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800bd20 con 0x7fc3940cd6d0 2023-10-06T03:17:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc399566700 1 -- 172.21.15.82:0/1507409505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 msgr2=0x7fc3940cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc399566700 1 --2- 172.21.15.82:0/1507409505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940cdb50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc394068110 tx=0x7fc388009250 comp rx=0 tx=0).stop 2023-10-06T03:17:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc399566700 1 -- 172.21.15.82:0/1507409505 shutdown_connections 2023-10-06T03:17:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc399566700 1 --2- 172.21.15.82:0/1507409505 >> v2:172.21.15.134:3300/0 conn(0x7fc3940b2190 0x7fc3940b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc399566700 1 --2- 172.21.15.82:0/1507409505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940cdb50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc399566700 1 -- 172.21.15.82:0/1507409505 >> 172.21.15.82:0/1507409505 conn(0x7fc39406d5f0 msgr2=0x7fc39406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc399566700 1 -- 172.21.15.82:0/1507409505 shutdown_connections 2023-10-06T03:17:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.819+0000 7fc399566700 1 -- 172.21.15.82:0/1507409505 wait complete. 2023-10-06T03:17:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.820+0000 7fc399566700 1 Processor -- start 2023-10-06T03:17:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc399566700 1 -- start start 2023-10-06T03:17:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc399566700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3940b2190 0x7fc3940aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc399566700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc399566700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394157b70 0x7fc39406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc399566700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940ae8b0 con 0x7fc3940cd6d0 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc399566700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940afc70 con 0x7fc394157b70 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc399566700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940aff50 con 0x7fc3940b2190 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52360/0 (socket says 172.21.15.82:52360) 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.821+0000 7fc3937fe700 1 -- 172.21.15.82:0/893660928 learned_addr learned my addr 172.21.15.82:0/893660928 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc398d65700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394157b70 0x7fc39406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc393fff700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3940b2190 0x7fc3940aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc3937fe700 1 -- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3940b2190 msgr2=0x7fc3940aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc3937fe700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3940b2190 0x7fc3940aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc3937fe700 1 -- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394157b70 msgr2=0x7fc39406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc3937fe700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394157b70 0x7fc39406ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc3937fe700 1 -- 172.21.15.82:0/893660928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880094f0 con 0x7fc3940cd6d0 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc398d65700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394157b70 0x7fc39406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc393fff700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3940b2190 0x7fc3940aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc3937fe700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940af590 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc3880030c0 tx=0x7fc388016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc37bfff700 1 -- 172.21.15.82:0/893660928 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011e60 con 0x7fc3940cd6d0 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc37bfff700 1 -- 172.21.15.82:0/893660928 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388020070 con 0x7fc3940cd6d0 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940ae260 con 0x7fc3940cd6d0 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc37bfff700 1 -- 172.21.15.82:0/893660928 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38801b6a0 con 0x7fc3940cd6d0 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.822+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39414ee50 con 0x7fc3940cd6d0 2023-10-06T03:17:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.823+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39404c3c0 con 0x7fc3940cd6d0 2023-10-06T03:17:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.823+0000 7fc37bfff700 1 -- 172.21.15.82:0/893660928 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc388022030 con 0x7fc3940cd6d0 2023-10-06T03:17:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.824+0000 7fc37bfff700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc380066f30 0x7fc3800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.824+0000 7fc37bfff700 1 -- 172.21.15.82:0/893660928 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc388086660 con 0x7fc3940cd6d0 2023-10-06T03:17:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.824+0000 7fc393fff700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc380066f30 0x7fc3800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.825+0000 7fc393fff700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc380066f30 0x7fc3800693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc384006fd0 tx=0x7fc384008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:14.828+0000 7fc37bfff700 1 -- 172.21.15.82:0/893660928 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc388053770 con 0x7fc3940cd6d0 2023-10-06T03:17:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.050+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc39404c3c0 con 0x7fc3940cd6d0 2023-10-06T03:17:15.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.051+0000 7fc37bfff700 1 -- 172.21.15.82:0/893660928 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fc388056d90 con 0x7fc3940cd6d0 2023-10-06T03:17:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:15.052 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2460851709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2460851709},{"type":"v1","addr":"172.21.15.134:6837","nonce":2460851709}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/771524024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":771524024},{"type":"v1","addr":"172.21.15.134:6836","nonce":771524024}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/3256175471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3256175471},{"type":"v1","addr":"172.21.15.82:6834","nonce":3256175471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:02.753418+0000","modified":"2023-10-06T03:17:06.382667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/1910803570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1910803570},{"type":"v1","addr":"172.21.15.82:6835","nonce":1910803570}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:17:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc380066f30 msgr2=0x7fc3800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc380066f30 0x7fc3800693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc384006fd0 tx=0x7fc384008040 comp rx=0 tx=0).stop 2023-10-06T03:17:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 msgr2=0x7fc3940af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940af590 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc3880030c0 tx=0x7fc388016000 comp rx=0 tx=0).stop 2023-10-06T03:17:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 shutdown_connections 2023-10-06T03:17:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394157b70 0x7fc39406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc380066f30 0x7fc3800693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3940b2190 0x7fc3940aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 --2- 172.21.15.82:0/893660928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3940cd6d0 0x7fc3940af590 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 >> 172.21.15.82:0/893660928 conn(0x7fc39406d5f0 msgr2=0x7fc39415a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 shutdown_connections 2023-10-06T03:17:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.053+0000 7fc399566700 1 -- 172.21.15.82:0/893660928 wait complete. 2023-10-06T03:17:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2023-10-06T03:17:15.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:15.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.179+0000 7fdf3a205700 1 Processor -- start 2023-10-06T03:17:15.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.179+0000 7fdf3a205700 1 -- start start 2023-10-06T03:17:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf3a205700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf3415d560 0x7fdf340d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf3a205700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf341591b0 0x7fdf34159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf3a205700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340b2ad0 con 0x7fdf3415d930 2023-10-06T03:17:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf3a205700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf340b4160 con 0x7fdf341591b0 2023-10-06T03:17:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf3a205700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf340b2230 con 0x7fdf3415d560 2023-10-06T03:17:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf33fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf341591b0 0x7fdf34159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf33fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf341591b0 0x7fdf34159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52362/0 (socket says 172.21.15.82:52362) 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf33fff700 1 -- 172.21.15.82:0/1777397327 learned_addr learned my addr 172.21.15.82:0/1777397327 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf33fff700 1 -- 172.21.15.82:0/1777397327 >> v2:172.21.15.134:3300/0 conn(0x7fdf3415d560 msgr2=0x7fdf340d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf33fff700 1 --2- 172.21.15.82:0/1777397327 >> v2:172.21.15.134:3300/0 conn(0x7fdf3415d560 0x7fdf340d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf33fff700 1 -- 172.21.15.82:0/1777397327 >> v1:172.21.15.134:6789/0 conn(0x7fdf3415d930 legacy=0x7fdf340b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.180+0000 7fdf33fff700 1 -- 172.21.15.82:0/1777397327 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf340b2510 con 0x7fdf341591b0 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf33fff700 1 --2- 172.21.15.82:0/1777397327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf341591b0 0x7fdf34159600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdf34071410 tx=0x7fdf2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e04307bb207936a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf327fc700 1 -- 172.21.15.82:0/1777397327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00b820 con 0x7fdf341591b0 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf327fc700 1 -- 172.21.15.82:0/1777397327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c00b980 con 0x7fdf341591b0 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf327fc700 1 -- 172.21.15.82:0/1777397327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00bd20 con 0x7fdf341591b0 2023-10-06T03:17:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf3a205700 1 -- 172.21.15.82:0/1777397327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf341591b0 msgr2=0x7fdf34159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf3a205700 1 --2- 172.21.15.82:0/1777397327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf341591b0 0x7fdf34159600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdf34071410 tx=0x7fdf2c009250 comp rx=0 tx=0).stop 2023-10-06T03:17:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf3a205700 1 -- 172.21.15.82:0/1777397327 shutdown_connections 2023-10-06T03:17:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf3a205700 1 --2- 172.21.15.82:0/1777397327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf341591b0 0x7fdf34159600 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf3a205700 1 --2- 172.21.15.82:0/1777397327 >> v2:172.21.15.134:3300/0 conn(0x7fdf3415d560 0x7fdf340d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf3a205700 1 -- 172.21.15.82:0/1777397327 >> 172.21.15.82:0/1777397327 conn(0x7fdf340d1180 msgr2=0x7fdf34069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf3a205700 1 -- 172.21.15.82:0/1777397327 shutdown_connections 2023-10-06T03:17:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.181+0000 7fdf3a205700 1 -- 172.21.15.82:0/1777397327 wait complete. 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.182+0000 7fdf3a205700 1 Processor -- start 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf3a205700 1 -- start start 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf3a205700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf341591b0 0x7fdf3414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf3a205700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf3415d560 0x7fdf3414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf3a205700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3415d930 0x7fdf3415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf3a205700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3414e320 con 0x7fdf3415d930 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf3a205700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3414d750 con 0x7fdf341591b0 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf3a205700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3414d9f0 con 0x7fdf3415d560 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3415d930 0x7fdf3415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3415d930 0x7fdf3415c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52374/0 (socket says 172.21.15.82:52374) 2023-10-06T03:17:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.183+0000 7fdf33fff700 1 -- 172.21.15.82:0/777156294 learned_addr learned my addr 172.21.15.82:0/777156294 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf337fe700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf341591b0 0x7fdf3414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf33fff700 1 -- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf3415d560 msgr2=0x7fdf3414e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf32ffd700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf3415d560 0x7fdf3414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf33fff700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf3415d560 0x7fdf3414e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf33fff700 1 -- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf341591b0 msgr2=0x7fdf3414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf33fff700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf341591b0 0x7fdf3414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf33fff700 1 -- 172.21.15.82:0/777156294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0094f0 con 0x7fdf3415d930 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf337fe700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf341591b0 0x7fdf3414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf33fff700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3415d930 0x7fdf3415c100 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009290 tx=0x7fdf2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf1b7fe700 1 -- 172.21.15.82:0/777156294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c01a670 con 0x7fdf3415d930 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf1b7fe700 1 -- 172.21.15.82:0/777156294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c01a7f0 con 0x7fdf3415d930 2023-10-06T03:17:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3414dcd0 con 0x7fdf3415d930 2023-10-06T03:17:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf1b7fe700 1 -- 172.21.15.82:0/777156294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c01abb0 con 0x7fdf3415d930 2023-10-06T03:17:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.184+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3414fef0 con 0x7fdf3415d930 2023-10-06T03:17:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.185+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf340af470 con 0x7fdf3415d930 2023-10-06T03:17:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.185+0000 7fdf1b7fe700 1 -- 172.21.15.82:0/777156294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf2c01b440 con 0x7fdf3415d930 2023-10-06T03:17:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.186+0000 7fdf1b7fe700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf20066f30 0x7fdf200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.186+0000 7fdf1b7fe700 1 -- 172.21.15.82:0/777156294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf2c0862a0 con 0x7fdf3415d930 2023-10-06T03:17:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.186+0000 7fdf337fe700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf20066f30 0x7fdf200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.186+0000 7fdf337fe700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf20066f30 0x7fdf200693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdf341521c0 tx=0x7fdf24007510 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.190+0000 7fdf1b7fe700 1 -- 172.21.15.82:0/777156294 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf2c053310 con 0x7fdf3415d930 2023-10-06T03:17:15.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.371+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf34064050 con 0x7fdf3415d930 2023-10-06T03:17:15.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.372+0000 7fdf1b7fe700 1 -- 172.21.15.82:0/777156294 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fdf2c056930 con 0x7fdf3415d930 2023-10-06T03:17:15.373 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:15.373 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":43,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:04.321808+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:00.394566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:01.721357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:15.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf20066f30 msgr2=0x7fdf200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf20066f30 0x7fdf200693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdf341521c0 tx=0x7fdf24007510 comp rx=0 tx=0).stop 2023-10-06T03:17:15.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3415d930 msgr2=0x7fdf3415c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3415d930 0x7fdf3415c100 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009290 tx=0x7fdf2c016000 comp rx=0 tx=0).stop 2023-10-06T03:17:15.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 shutdown_connections 2023-10-06T03:17:15.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3415d930 0x7fdf3415c100 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf341591b0 0x7fdf3414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf20066f30 0x7fdf200693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 --2- 172.21.15.82:0/777156294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf3415d560 0x7fdf3414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 >> 172.21.15.82:0/777156294 conn(0x7fdf340d1180 msgr2=0x7fdf34067bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:15.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 shutdown_connections 2023-10-06T03:17:15.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.374+0000 7fdf3a205700 1 -- 172.21.15.82:0/777156294 wait complete. 2023-10-06T03:17:15.387 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:17:15.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.502+0000 7f9f84c12700 1 Processor -- start 2023-10-06T03:17:15.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.502+0000 7f9f84c12700 1 -- start start 2023-10-06T03:17:15.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.503+0000 7f9f84c12700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8015dab0 0x7f9f800cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.503+0000 7f9f84c12700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f800b1110 con 0x7f9f801598d0 2023-10-06T03:17:15.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.503+0000 7f9f84c12700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f800b13b0 con 0x7f9f80159500 2023-10-06T03:17:15.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.503+0000 7f9f84c12700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800b1690 con 0x7f9f8015dab0 2023-10-06T03:17:15.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.503+0000 7f9f75d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9f801598d0 0x7f9f8015d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43232/0 (socket says 172.21.15.82:43232) 2023-10-06T03:17:15.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.503+0000 7f9f75d9b700 1 -- 172.21.15.82:0/952095302 learned_addr learned my addr 172.21.15.82:0/952095302 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:15.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.503+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212010339 0 0) 0x7f9f800b1110 con 0x7f9f801598d0 2023-10-06T03:17:15.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.503+0000 7f9f7ed9d700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8015dab0 0x7f9f800cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f6c003570 con 0x7f9f801598d0 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 959806194 0 0) 0x7f9f6c003570 con 0x7f9f801598d0 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8015dab0 msgr2=0x7f9f800cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8015dab0 0x7f9f800cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 >> v1:172.21.15.134:6789/0 conn(0x7f9f80159500 legacy=0x7f9f800b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f800b1970 con 0x7f9f801598d0 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f9f68001470 con 0x7f9f801598d0 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 >> v1:172.21.15.82:6789/0 conn(0x7f9f801598d0 legacy=0x7f9f8015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6c003a90 0x7f9f6c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8015dab0 0x7f9f6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6c004d50 0x7f9f6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800b1690 con 0x7f9f6c004d50 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c00bb70 con 0x7f9f6c003a90 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c00bd30 con 0x7f9f8015dab0 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7ed9d700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6c004d50 0x7f9f6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7e59c700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6c003a90 0x7f9f6c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f75d9b700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8015dab0 0x7f9f6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7ed9d700 1 -- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8015dab0 msgr2=0x7f9f6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7ed9d700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8015dab0 0x7f9f6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7ed9d700 1 -- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6c003a90 msgr2=0x7f9f6c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:15.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7ed9d700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f6c003a90 0x7f9f6c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7ed9d700 1 -- 172.21.15.82:0/952095302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c003570 con 0x7f9f6c004d50 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.504+0000 7f9f7ed9d700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6c004d50 0x7f9f6c0051c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9f8015deb0 tx=0x7f9f7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3350f1fd43a9c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800ea90 con 0x7f9f6c004d50 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7800f040 con 0x7f9f6c004d50 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f7dd9b700 1 -- 172.21.15.82:0/952095302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800ee40 con 0x7f9f6c004d50 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f84c12700 1 -- 172.21.15.82:0/952095302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6c004d50 msgr2=0x7f9f6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f84c12700 1 --2- 172.21.15.82:0/952095302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6c004d50 0x7f9f6c0051c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9f8015deb0 tx=0x7f9f7800b040 comp rx=0 tx=0).stop 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f7ed9d700 1 -- 172.21.15.82:0/952095302 reap_dead start 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f84c12700 1 -- 172.21.15.82:0/952095302 shutdown_connections 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f84c12700 1 -- 172.21.15.82:0/952095302 >> 172.21.15.82:0/952095302 conn(0x7f9f80067630 msgr2=0x7f9f80069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:15.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f84c12700 1 -- 172.21.15.82:0/952095302 shutdown_connections 2023-10-06T03:17:15.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.505+0000 7f9f84c12700 1 -- 172.21.15.82:0/952095302 wait complete. 2023-10-06T03:17:15.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.506+0000 7f9f84c12700 1 Processor -- start 2023-10-06T03:17:15.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.506+0000 7f9f84c12700 1 -- start start 2023-10-06T03:17:15.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f84c12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f80149ad0 0x7f9f800b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f84c12700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f80149ea0 0x7f9f80068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f84c12700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f80068c80 0x7f9f800b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f84c12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8014ce10 con 0x7f9f80149ad0 2023-10-06T03:17:15.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f84c12700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800690e0 con 0x7f9f80068c80 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f84c12700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800b4510 con 0x7f9f80149ea0 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f7e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f80149ad0 0x7f9f800b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f7e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f80149ad0 0x7f9f800b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52398/0 (socket says 172.21.15.82:52398) 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f7e59c700 1 -- 172.21.15.82:0/2445662200 learned_addr learned my addr 172.21.15.82:0/2445662200 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f7ed9d700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f80068c80 0x7f9f800b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f75d9b700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f80149ea0 0x7f9f80068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f7e59c700 1 -- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f80149ea0 msgr2=0x7f9f80068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f7e59c700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f80149ea0 0x7f9f80068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.507+0000 7f9f7e59c700 1 -- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f80068c80 msgr2=0x7f9f800b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f7e59c700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f80068c80 0x7f9f800b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f7e59c700 1 -- 172.21.15.82:0/2445662200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8014c240 con 0x7f9f80149ad0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f75d9b700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f80149ea0 0x7f9f80068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f7e59c700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f80149ad0 0x7f9f800b3fd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9f70002950 tx=0x7f9f70007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f76ffd700 1 -- 172.21.15.82:0/2445662200 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70002e90 con 0x7f9f80149ad0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f76ffd700 1 -- 172.21.15.82:0/2445662200 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7000f8d0 con 0x7f9f80149ad0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8014c4e0 con 0x7f9f80149ad0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f76ffd700 1 -- 172.21.15.82:0/2445662200 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000fc90 con 0x7f9f80149ad0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.508+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8014caa0 con 0x7f9f80149ad0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.509+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f80064050 con 0x7f9f80149ad0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.509+0000 7f9f76ffd700 1 -- 172.21.15.82:0/2445662200 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f70013600 con 0x7f9f80149ad0 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.509+0000 7f9f76ffd700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9f60066f30 0x7f9f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.510+0000 7f9f76ffd700 1 -- 172.21.15.82:0/2445662200 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f70084510 con 0x7f9f80149ad0 2023-10-06T03:17:15.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.510+0000 7f9f75d9b700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9f60066f30 0x7f9f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.510+0000 7f9f75d9b700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9f60066f30 0x7f9f600693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9f680015a0 tx=0x7f9f68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.514+0000 7f9f76ffd700 1 -- 172.21.15.82:0/2445662200 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f70051620 con 0x7f9f80149ad0 2023-10-06T03:17:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.744+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9f800d0420 con 0x7f9f80149ad0 2023-10-06T03:17:15.745 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-10-06T03:17:15.745+0000 7fbfe891d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:17:15.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.748+0000 7f9f76ffd700 1 -- 172.21.15.82:0/2445662200 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9f7000fdf0 con 0x7f9f80149ad0 2023-10-06T03:17:15.750 INFO:tasks.ceph.mds.c.smithi082.stderr: -1656> 2023-10-06T03:17:07.665+0000 7fecade25700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:17:15.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9f60066f30 msgr2=0x7f9f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9f60066f30 0x7f9f600693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9f680015a0 tx=0x7f9f68009040 comp rx=0 tx=0).stop 2023-10-06T03:17:15.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f80149ad0 msgr2=0x7f9f800b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f80149ad0 0x7f9f800b3fd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9f70002950 tx=0x7f9f70007d30 comp rx=0 tx=0).stop 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 shutdown_connections 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f80068c80 0x7f9f800b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f80149ad0 0x7f9f800b3fd0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9f60066f30 0x7f9f600693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.750+0000 7f9f84c12700 1 --2- 172.21.15.82:0/2445662200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f80149ea0 0x7f9f80068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.751+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 >> 172.21.15.82:0/2445662200 conn(0x7f9f80067630 msgr2=0x7f9f80067ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.751+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 shutdown_connections 2023-10-06T03:17:15.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.751+0000 7f9f84c12700 1 -- 172.21.15.82:0/2445662200 wait complete. 2023-10-06T03:17:15.753 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:17:15.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:17:15.773 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-10-06T03:17:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.880+0000 7f15fb355700 1 Processor -- start 2023-10-06T03:17:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.880+0000 7f15fb355700 1 -- start start 2023-10-06T03:17:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15fb355700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f15f40cc090 0x7f15f4158750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15fb355700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15f4068ed0 0x7f15f4069330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15fb355700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f4069870 con 0x7f15f41553f0 2023-10-06T03:17:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15fb355700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f40af520 con 0x7f15f4068ed0 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15fb355700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f41582c0 con 0x7f15f40cc090 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15f90f1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f15f41553f0 0x7f15f415b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43258/0 (socket says 172.21.15.82:43258) 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15f90f1700 1 -- 172.21.15.82:0/250378653 learned_addr learned my addr 172.21.15.82:0/250378653 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15f98f2700 1 --2- 172.21.15.82:0/250378653 >> v2:172.21.15.82:3300/0 conn(0x7f15f4068ed0 0x7f15f4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15f88f0700 1 --2- 172.21.15.82:0/250378653 >> v2:172.21.15.134:3300/0 conn(0x7f15f40cc090 0x7f15f4158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15ebfff700 1 -- 172.21.15.82:0/250378653 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493279813 0 0) 0x7f15f0001110 con 0x7f15f41553f0 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.881+0000 7f15ebfff700 1 -- 172.21.15.82:0/250378653 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e0003570 con 0x7f15f41553f0 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15f98f2700 1 -- 172.21.15.82:0/250378653 >> v2:172.21.15.134:3300/0 conn(0x7f15f40cc090 msgr2=0x7f15f4158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15f98f2700 1 --2- 172.21.15.82:0/250378653 >> v2:172.21.15.134:3300/0 conn(0x7f15f40cc090 0x7f15f4158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15f98f2700 1 -- 172.21.15.82:0/250378653 >> v1:172.21.15.82:6789/0 conn(0x7f15f41553f0 legacy=0x7f15f415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15f98f2700 1 -- 172.21.15.82:0/250378653 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4157fc0 con 0x7f15f4068ed0 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15f98f2700 1 --2- 172.21.15.82:0/250378653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f4068ed0 0x7f15f4069330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f15f40ca6a0 tx=0x7f15ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1577594f4733d727 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15ebfff700 1 -- 172.21.15.82:0/250378653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00e070 con 0x7f15f4068ed0 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15ebfff700 1 -- 172.21.15.82:0/250378653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec00bab0 con 0x7f15f4068ed0 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15ebfff700 1 -- 172.21.15.82:0/250378653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00be70 con 0x7f15f4068ed0 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15fb355700 1 -- 172.21.15.82:0/250378653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f4068ed0 msgr2=0x7f15f4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15fb355700 1 --2- 172.21.15.82:0/250378653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f4068ed0 0x7f15f4069330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f15f40ca6a0 tx=0x7f15ec009780 comp rx=0 tx=0).stop 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15fb355700 1 -- 172.21.15.82:0/250378653 shutdown_connections 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15fb355700 1 --2- 172.21.15.82:0/250378653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f4068ed0 0x7f15f4069330 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15fb355700 1 --2- 172.21.15.82:0/250378653 >> v2:172.21.15.134:3300/0 conn(0x7f15f40cc090 0x7f15f4158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15fb355700 1 -- 172.21.15.82:0/250378653 >> 172.21.15.82:0/250378653 conn(0x7f15f406e910 msgr2=0x7f15f406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.882+0000 7f15fb355700 1 -- 172.21.15.82:0/250378653 shutdown_connections 2023-10-06T03:17:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.883+0000 7f15fb355700 1 -- 172.21.15.82:0/250378653 wait complete. 2023-10-06T03:17:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.884+0000 7f15fb355700 1 Processor -- start 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.884+0000 7f15fb355700 1 -- start start 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.884+0000 7f15fb355700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15f4068ed0 0x7f15f41549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.884+0000 7f15fb355700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40cc090 0x7f15f40b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.884+0000 7f15fb355700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f41553f0 0x7f15f40affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.884+0000 7f15fb355700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40afb10 con 0x7f15f41553f0 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.884+0000 7f15fb355700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f415add0 con 0x7f15f40cc090 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.884+0000 7f15fb355700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f415a530 con 0x7f15f4068ed0 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f41553f0 0x7f15f40affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f41553f0 0x7f15f40affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52436/0 (socket says 172.21.15.82:52436) 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 -- 172.21.15.82:0/361290156 learned_addr learned my addr 172.21.15.82:0/361290156 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f88f0700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40cc090 0x7f15f40b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f90f1700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15f4068ed0 0x7f15f41549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 -- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15f4068ed0 msgr2=0x7f15f41549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15f4068ed0 0x7f15f41549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 -- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40cc090 msgr2=0x7f15f40b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40cc090 0x7f15f40b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 -- 172.21.15.82:0/361290156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec009a20 con 0x7f15f41553f0 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f88f0700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40cc090 0x7f15f40b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15f98f2700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f41553f0 0x7f15f40affa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f15f4071090 tx=0x7f15ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15e97fa700 1 -- 172.21.15.82:0/361290156 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec027470 con 0x7f15f41553f0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15e97fa700 1 -- 172.21.15.82:0/361290156 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec0275d0 con 0x7f15f41553f0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f415a810 con 0x7f15f41553f0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15e97fa700 1 -- 172.21.15.82:0/361290156 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec027990 con 0x7f15f41553f0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.885+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f4154f10 con 0x7f15f41553f0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.886+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f40afcc0 con 0x7f15f41553f0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.886+0000 7f15e97fa700 1 -- 172.21.15.82:0/361290156 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15ec024070 con 0x7f15f41553f0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.887+0000 7f15e97fa700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f15d8066f30 0x7f15d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.887+0000 7f15e97fa700 1 -- 172.21.15.82:0/361290156 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f15ec0870e0 con 0x7f15f41553f0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.887+0000 7f15f90f1700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f15d8066f30 0x7f15d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.887+0000 7f15f90f1700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f15d8066f30 0x7f15d80693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f15f40abfb0 tx=0x7f15f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:15.891+0000 7f15e97fa700 1 -- 172.21.15.82:0/361290156 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15f40afcc0 con 0x7f15f41553f0 2023-10-06T03:17:16.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.116+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f15f4064050 con 0x7f15f41553f0 2023-10-06T03:17:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.749+0000 7f15e97fa700 1 -- 172.21.15.82:0/361290156 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15ec0541a0 con 0x7f15f41553f0 2023-10-06T03:17:16.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.751+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f15d8066f30 msgr2=0x7f15d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:16.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.751+0000 7f15fb355700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f15d8066f30 0x7f15d80693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f15f40abfb0 tx=0x7f15f0009040 comp rx=0 tx=0).stop 2023-10-06T03:17:16.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.751+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f41553f0 msgr2=0x7f15f40affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.751+0000 7f15fb355700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f41553f0 0x7f15f40affa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f15f4071090 tx=0x7f15ec019000 comp rx=0 tx=0).stop 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.751+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 shutdown_connections 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.751+0000 7f15fb355700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f41553f0 0x7f15f40affa0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.752+0000 7f15fb355700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f15d8066f30 0x7f15d80693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.752+0000 7f15fb355700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15f4068ed0 0x7f15f41549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.752+0000 7f15fb355700 1 --2- 172.21.15.82:0/361290156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40cc090 0x7f15f40b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.752+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 >> 172.21.15.82:0/361290156 conn(0x7f15f406e910 msgr2=0x7f15f40adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.752+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 shutdown_connections 2023-10-06T03:17:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.752+0000 7f15fb355700 1 -- 172.21.15.82:0/361290156 wait complete. 2023-10-06T03:17:16.764 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:17:16.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.921+0000 7f1a3445a700 1 Processor -- start 2023-10-06T03:17:16.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.921+0000 7f1a3445a700 1 -- start start 2023-10-06T03:17:16.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.922+0000 7f1a3445a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a2c0b55b0 0x7f1a2c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:16.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.922+0000 7f1a3445a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 0x7f1a2c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.922+0000 7f1a3445a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c0cbed0 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.922+0000 7f1a3445a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c159d40 con 0x7f1a2c0b55b0 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.922+0000 7f1a3445a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0cc750 con 0x7f1a2c0cf800 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.922+0000 7f1a321f6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a2c0b55b0 0x7f1a2c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a321f6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a2c0b55b0 0x7f1a2c0ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52448/0 (socket says 172.21.15.82:52448) 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a321f6700 1 -- 172.21.15.82:0/322747679 learned_addr learned my addr 172.21.15.82:0/322747679 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a319f5700 1 --2- 172.21.15.82:0/322747679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 0x7f1a2c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a321f6700 1 -- 172.21.15.82:0/322747679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 msgr2=0x7f1a2c0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a321f6700 1 --2- 172.21.15.82:0/322747679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 0x7f1a2c0b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a321f6700 1 -- 172.21.15.82:0/322747679 >> v1:172.21.15.134:6789/0 conn(0x7f1a2c0d0f00 legacy=0x7f1a2c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a321f6700 1 -- 172.21.15.82:0/322747679 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0b5ec0 con 0x7f1a2c0b55b0 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a321f6700 1 --2- 172.21.15.82:0/322747679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0b55b0 0x7f1a2c0ccbe0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009f70 tx=0x7f1a28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460edbf25ad9b869 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a311f4700 1 -- 172.21.15.82:0/322747679 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2800e070 con 0x7f1a2c0b55b0 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a311f4700 1 -- 172.21.15.82:0/322747679 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2800ba90 con 0x7f1a2c0b55b0 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.923+0000 7f1a311f4700 1 -- 172.21.15.82:0/322747679 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a280092e0 con 0x7f1a2c0b55b0 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.924+0000 7f1a3445a700 1 -- 172.21.15.82:0/322747679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0b55b0 msgr2=0x7f1a2c0ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.924+0000 7f1a3445a700 1 --2- 172.21.15.82:0/322747679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0b55b0 0x7f1a2c0ccbe0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009f70 tx=0x7f1a28009840 comp rx=0 tx=0).stop 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.924+0000 7f1a3445a700 1 -- 172.21.15.82:0/322747679 shutdown_connections 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.924+0000 7f1a3445a700 1 --2- 172.21.15.82:0/322747679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0b55b0 0x7f1a2c0ccbe0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.924+0000 7f1a3445a700 1 --2- 172.21.15.82:0/322747679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 0x7f1a2c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.924+0000 7f1a3445a700 1 -- 172.21.15.82:0/322747679 >> 172.21.15.82:0/322747679 conn(0x7f1a2c08a050 msgr2=0x7f1a2c099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.924+0000 7f1a3445a700 1 -- 172.21.15.82:0/322747679 shutdown_connections 2023-10-06T03:17:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.924+0000 7f1a3445a700 1 -- 172.21.15.82:0/322747679 wait complete. 2023-10-06T03:17:16.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.925+0000 7f1a3445a700 1 Processor -- start 2023-10-06T03:17:16.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.925+0000 7f1a3445a700 1 -- start start 2023-10-06T03:17:16.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a3445a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a2c0b55b0 0x7f1a2c069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:16.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a3445a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 0x7f1a2c0c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:16.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a3445a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0d0f00 0x7f1a2c0c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:16.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a3445a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0c7fa0 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a3445a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0c8840 con 0x7f1a2c0b55b0 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a3445a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c06a2f0 con 0x7f1a2c0cf800 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0d0f00 0x7f1a2c0c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0d0f00 0x7f1a2c0c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52456/0 (socket says 172.21.15.82:52456) 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 -- 172.21.15.82:0/3006519308 learned_addr learned my addr 172.21.15.82:0/3006519308 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a321f6700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a2c0b55b0 0x7f1a2c069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a319f5700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 0x7f1a2c0c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 -- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 msgr2=0x7f1a2c0c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 0x7f1a2c0c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 -- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a2c0b55b0 msgr2=0x7f1a2c069a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a2c0b55b0 0x7f1a2c069a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 -- 172.21.15.82:0/3006519308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28009ae0 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a329f7700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0d0f00 0x7f1a2c0c6950 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400b510 tx=0x7f1a24006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a227fc700 1 -- 172.21.15.82:0/3006519308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400be80 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a227fc700 1 -- 172.21.15.82:0/3006519308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2400f510 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c0c81f0 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a227fc700 1 -- 172.21.15.82:0/3006519308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400f8b0 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.926+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c069f70 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.927+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c0c89d0 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.928+0000 7f1a227fc700 1 -- 172.21.15.82:0/3006519308 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a2400fce0 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.928+0000 7f1a227fc700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a10066f30 0x7f1a100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:16.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.928+0000 7f1a227fc700 1 -- 172.21.15.82:0/3006519308 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f1a24084000 con 0x7f1a2c0d0f00 2023-10-06T03:17:16.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.928+0000 7f1a321f6700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a10066f30 0x7f1a100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:16.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.929+0000 7f1a321f6700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a10066f30 0x7f1a100693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c16d0e0 tx=0x7f1a28017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:16.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:16.932+0000 7f1a227fc700 1 -- 172.21.15.82:0/3006519308 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a24051140 con 0x7f1a2c0d0f00 2023-10-06T03:17:17.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.112+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a2c0717c0 con 0x7f1a2c0d0f00 2023-10-06T03:17:17.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.756+0000 7f1a227fc700 1 -- 172.21.15.82:0/3006519308 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1a24054760 con 0x7f1a2c0d0f00 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a10066f30 msgr2=0x7f1a100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a10066f30 0x7f1a100693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c16d0e0 tx=0x7f1a28017000 comp rx=0 tx=0).stop 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0d0f00 msgr2=0x7f1a2c0c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0d0f00 0x7f1a2c0c6950 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400b510 tx=0x7f1a24006f90 comp rx=0 tx=0).stop 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 shutdown_connections 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c0d0f00 0x7f1a2c0c6950 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a2c0b55b0 0x7f1a2c069a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1a10066f30 0x7f1a100693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 --2- 172.21.15.82:0/3006519308 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a2c0cf800 0x7f1a2c0c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 >> 172.21.15.82:0/3006519308 conn(0x7f1a2c08a050 msgr2=0x7f1a2c0cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:17.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 shutdown_connections 2023-10-06T03:17:17.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.759+0000 7f1a3445a700 1 -- 172.21.15.82:0/3006519308 wait complete. 2023-10-06T03:17:17.761 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:17:17.772 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:17:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.891+0000 7fae3a8e5700 1 Processor -- start 2023-10-06T03:17:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.891+0000 7fae3a8e5700 1 -- start start 2023-10-06T03:17:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae3a8e5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae340cf440 0x7fae340cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae3a8e5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf810 0x7fae340cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae3a8e5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340cb670 con 0x7fae340cc680 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae3a8e5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340cce90 con 0x7fae340cf440 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae3a8e5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae340cad80 con 0x7fae340cf810 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae390e2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf810 0x7fae340cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae398e3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae340cf440 0x7fae340cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae3a0e4700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fae340cc680 0x7fae3415d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:36690/0 (socket says 172.21.15.82:36690) 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae3a0e4700 1 -- 172.21.15.82:0/2471882350 learned_addr learned my addr 172.21.15.82:0/2471882350 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae390e2700 1 -- 172.21.15.82:0/2471882350 >> v2:172.21.15.134:3300/0 conn(0x7fae340cf440 msgr2=0x7fae340cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae390e2700 1 --2- 172.21.15.82:0/2471882350 >> v2:172.21.15.134:3300/0 conn(0x7fae340cf440 0x7fae340cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.892+0000 7fae390e2700 1 -- 172.21.15.82:0/2471882350 >> v1:172.21.15.134:6789/0 conn(0x7fae340cc680 legacy=0x7fae3415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.893+0000 7fae390e2700 1 -- 172.21.15.82:0/2471882350 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340cb020 con 0x7fae340cf810 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.893+0000 7fae398e3700 1 --2- 172.21.15.82:0/2471882350 >> v2:172.21.15.134:3300/0 conn(0x7fae340cf440 0x7fae340cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.893+0000 7fae390e2700 1 --2- 172.21.15.82:0/2471882350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf810 0x7fae340cc140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae240098e0 tx=0x7fae240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f24b3406055fe667 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.893+0000 7fae388e1700 1 -- 172.21.15.82:0/2471882350 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2400b640 con 0x7fae340cf810 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.893+0000 7fae388e1700 1 -- 172.21.15.82:0/2471882350 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2400b7a0 con 0x7fae340cf810 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.893+0000 7fae388e1700 1 -- 172.21.15.82:0/2471882350 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2400bb40 con 0x7fae340cf810 2023-10-06T03:17:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.893+0000 7fae3a8e5700 1 -- 172.21.15.82:0/2471882350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf810 msgr2=0x7fae340cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.893+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/2471882350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf810 0x7fae340cc140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae240098e0 tx=0x7fae240091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.894+0000 7fae3a8e5700 1 -- 172.21.15.82:0/2471882350 shutdown_connections 2023-10-06T03:17:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.894+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/2471882350 >> v2:172.21.15.134:3300/0 conn(0x7fae340cf440 0x7fae340cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.894+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/2471882350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf810 0x7fae340cc140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.894+0000 7fae3a8e5700 1 -- 172.21.15.82:0/2471882350 >> 172.21.15.82:0/2471882350 conn(0x7fae340cd080 msgr2=0x7fae340cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.894+0000 7fae3a8e5700 1 -- 172.21.15.82:0/2471882350 shutdown_connections 2023-10-06T03:17:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.894+0000 7fae3a8e5700 1 -- 172.21.15.82:0/2471882350 wait complete. 2023-10-06T03:17:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.895+0000 7fae3a8e5700 1 Processor -- start 2023-10-06T03:17:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.895+0000 7fae3a8e5700 1 -- start start 2023-10-06T03:17:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.895+0000 7fae3a8e5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340cc680 0x7fae3414f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.895+0000 7fae3a8e5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf440 0x7fae340b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.895+0000 7fae3a8e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae340cf810 0x7fae340b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.895+0000 7fae3a8e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae340b5180 con 0x7fae340cf810 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.895+0000 7fae3a8e5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341500a0 con 0x7fae340cc680 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.895+0000 7fae3a8e5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3414fd90 con 0x7fae340cf440 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae340cf810 0x7fae340b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae340cf810 0x7fae340b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53920/0 (socket says 172.21.15.82:53920) 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 -- 172.21.15.82:0/452536302 learned_addr learned my addr 172.21.15.82:0/452536302 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae390e2700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf440 0x7fae340b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae398e3700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340cc680 0x7fae3414f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 -- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf440 msgr2=0x7fae340b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf440 0x7fae340b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 -- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340cc680 msgr2=0x7fae3414f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340cc680 0x7fae3414f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 -- 172.21.15.82:0/452536302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae30009420 con 0x7fae340cf810 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a0e4700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae340cf810 0x7fae340b10c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00cc70 tx=0x7fae2c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae29ffb700 1 -- 172.21.15.82:0/452536302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00ce80 con 0x7fae340cf810 2023-10-06T03:17:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae29ffb700 1 -- 172.21.15.82:0/452536302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c00ab30 con 0x7fae340cf810 2023-10-06T03:17:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae24009420 con 0x7fae340cf810 2023-10-06T03:17:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae29ffb700 1 -- 172.21.15.82:0/452536302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c0070f0 con 0x7fae340cf810 2023-10-06T03:17:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.896+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae340c8f90 con 0x7fae340cf810 2023-10-06T03:17:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.897+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae34064050 con 0x7fae340cf810 2023-10-06T03:17:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.897+0000 7fae29ffb700 1 -- 172.21.15.82:0/452536302 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae2c0074e0 con 0x7fae340cf810 2023-10-06T03:17:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.898+0000 7fae29ffb700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae18066f30 0x7fae180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.898+0000 7fae29ffb700 1 -- 172.21.15.82:0/452536302 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fae2c084930 con 0x7fae340cf810 2023-10-06T03:17:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.898+0000 7fae398e3700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae18066f30 0x7fae180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:17.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.899+0000 7fae398e3700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae18066f30 0x7fae180693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae300093f0 tx=0x7fae30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:17.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:17.902+0000 7fae29ffb700 1 -- 172.21.15.82:0/452536302 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae2c051c20 con 0x7fae340cf810 2023-10-06T03:17:18.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.093+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae340cff30 con 0x7fae340cf810 2023-10-06T03:17:18.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.759+0000 7fae29ffb700 1 -- 172.21.15.82:0/452536302 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae2c055240 con 0x7fae340cf810 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae18066f30 msgr2=0x7fae180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae18066f30 0x7fae180693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae300093f0 tx=0x7fae30008040 comp rx=0 tx=0).stop 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae340cf810 msgr2=0x7fae340b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae340cf810 0x7fae340b10c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00cc70 tx=0x7fae2c001a50 comp rx=0 tx=0).stop 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 shutdown_connections 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae340cf810 0x7fae340b10c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340cc680 0x7fae3414f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fae18066f30 0x7fae180693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 --2- 172.21.15.82:0/452536302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340cf440 0x7fae340b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 >> 172.21.15.82:0/452536302 conn(0x7fae340cd080 msgr2=0x7fae34156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 shutdown_connections 2023-10-06T03:17:18.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.763+0000 7fae3a8e5700 1 -- 172.21.15.82:0/452536302 wait complete. 2023-10-06T03:17:18.765 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-10-06T03:17:18.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:17:18.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.893+0000 7f4f164b7700 1 Processor -- start 2023-10-06T03:17:18.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.893+0000 7f4f164b7700 1 -- start start 2023-10-06T03:17:18.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f164b7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4f101598d0 0x7f4f1015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:18.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f164b7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f1015d8e0 0x7f4f100cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:18.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f164b7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1015dd20 con 0x7f4f10159500 2023-10-06T03:17:18.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f164b7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f100b1110 con 0x7f4f101598d0 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f164b7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f100b13b0 con 0x7f4f1015d8e0 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4f101598d0 0x7f4f1015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4f10159500 0x7f4f100b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44316/0 (socket says 172.21.15.82:44316) 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0ffff700 1 -- 172.21.15.82:0/2694709159 learned_addr learned my addr 172.21.15.82:0/2694709159 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0f7fe700 1 -- 172.21.15.82:0/2694709159 >> v2:172.21.15.134:3300/0 conn(0x7f4f1015d8e0 msgr2=0x7f4f100cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0f7fe700 1 --2- 172.21.15.82:0/2694709159 >> v2:172.21.15.134:3300/0 conn(0x7f4f1015d8e0 0x7f4f100cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0f7fe700 1 -- 172.21.15.82:0/2694709159 >> v1:172.21.15.82:6789/0 conn(0x7f4f10159500 legacy=0x7f4f100b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0f7fe700 1 -- 172.21.15.82:0/2694709159 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f100b1690 con 0x7f4f101598d0 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0effd700 1 -- 172.21.15.82:0/2694709159 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921367037 0 0) 0x7f4f1015dd20 con 0x7f4f10159500 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.894+0000 7f4f0f7fe700 1 --2- 172.21.15.82:0/2694709159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1015d3a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4f1006a270 tx=0x7f4f040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915e6c4b56b850fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:18.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f0effd700 1 -- 172.21.15.82:0/2694709159 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400b6b0 con 0x7f4f101598d0 2023-10-06T03:17:18.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f0effd700 1 -- 172.21.15.82:0/2694709159 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400b810 con 0x7f4f101598d0 2023-10-06T03:17:18.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f0effd700 1 -- 172.21.15.82:0/2694709159 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400bbb0 con 0x7f4f101598d0 2023-10-06T03:17:18.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f164b7700 1 -- 172.21.15.82:0/2694709159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 msgr2=0x7f4f1015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:18.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f164b7700 1 --2- 172.21.15.82:0/2694709159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1015d3a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4f1006a270 tx=0x7f4f040091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f164b7700 1 -- 172.21.15.82:0/2694709159 shutdown_connections 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f164b7700 1 --2- 172.21.15.82:0/2694709159 >> v2:172.21.15.134:3300/0 conn(0x7f4f1015d8e0 0x7f4f100cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f164b7700 1 --2- 172.21.15.82:0/2694709159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1015d3a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f164b7700 1 -- 172.21.15.82:0/2694709159 >> 172.21.15.82:0/2694709159 conn(0x7f4f10067630 msgr2=0x7f4f10069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f164b7700 1 -- 172.21.15.82:0/2694709159 shutdown_connections 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.895+0000 7f4f164b7700 1 -- 172.21.15.82:0/2694709159 wait complete. 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.896+0000 7f4f164b7700 1 Processor -- start 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.896+0000 7f4f164b7700 1 -- start start 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f164b7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10159500 0x7f4f1014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f164b7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1013dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f164b7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f1015d8e0 0x7f4f1013e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f164b7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f10150110 con 0x7f4f101598d0 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f164b7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1014d7f0 con 0x7f4f10159500 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f164b7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1014dad0 con 0x7f4f1015d8e0 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f0f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f0f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1013dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53934/0 (socket says 172.21.15.82:53934) 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.897+0000 7f4f0f7fe700 1 -- 172.21.15.82:0/3810645511 learned_addr learned my addr 172.21.15.82:0/3810645511 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f0f7fe700 1 -- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f1015d8e0 msgr2=0x7f4f1013e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f0ffff700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10159500 0x7f4f1014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f14a54700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f1015d8e0 0x7f4f1013e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f0f7fe700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f1015d8e0 0x7f4f1013e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f0f7fe700 1 -- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10159500 msgr2=0x7f4f1014e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f0f7fe700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10159500 0x7f4f1014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f0f7fe700 1 -- 172.21.15.82:0/3810645511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04009420 con 0x7f4f101598d0 2023-10-06T03:17:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f0f7fe700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1013dc20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4f040093f0 tx=0x7f4f04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4ef7fff700 1 -- 172.21.15.82:0/3810645511 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04011420 con 0x7f4f101598d0 2023-10-06T03:17:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4ef7fff700 1 -- 172.21.15.82:0/3810645511 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f04011580 con 0x7f4f101598d0 2023-10-06T03:17:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f10150380 con 0x7f4f101598d0 2023-10-06T03:17:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4ef7fff700 1 -- 172.21.15.82:0/3810645511 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04011920 con 0x7f4f101598d0 2023-10-06T03:17:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.898+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1014ebb0 con 0x7f4f101598d0 2023-10-06T03:17:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.899+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1014eda0 con 0x7f4f101598d0 2023-10-06T03:17:18.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.899+0000 7f4ef7fff700 1 -- 172.21.15.82:0/3810645511 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f04011cd0 con 0x7f4f101598d0 2023-10-06T03:17:18.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.900+0000 7f4ef7fff700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4efc066f30 0x7f4efc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:18.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.900+0000 7f4ef7fff700 1 -- 172.21.15.82:0/3810645511 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4f04085f50 con 0x7f4f101598d0 2023-10-06T03:17:18.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.900+0000 7f4f0ffff700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4efc066f30 0x7f4efc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:18.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.900+0000 7f4f0ffff700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4efc066f30 0x7f4efc0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f00007fd0 tx=0x7f4f00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:18.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:18.904+0000 7f4ef7fff700 1 -- 172.21.15.82:0/3810645511 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f040532c0 con 0x7f4f101598d0 2023-10-06T03:17:19.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.086+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4f10150570 con 0x7f4f101598d0 2023-10-06T03:17:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.090+0000 7f4ef7fff700 1 -- 172.21.15.82:0/3810645511 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f040568e0 con 0x7f4f101598d0 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4efc066f30 msgr2=0x7f4efc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4efc066f30 0x7f4efc0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f00007fd0 tx=0x7f4f00009040 comp rx=0 tx=0).stop 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 msgr2=0x7f4f1013dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1013dc20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4f040093f0 tx=0x7f4f04017000 comp rx=0 tx=0).stop 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 shutdown_connections 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4efc066f30 0x7f4efc0693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f1015d8e0 0x7f4f1013e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f10159500 0x7f4f1014e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 --2- 172.21.15.82:0/3810645511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f101598d0 0x7f4f1013dc20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 >> 172.21.15.82:0/3810645511 conn(0x7f4f10067630 msgr2=0x7f4f100b5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 shutdown_connections 2023-10-06T03:17:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.092+0000 7f4f164b7700 1 -- 172.21.15.82:0/3810645511 wait complete. 2023-10-06T03:17:19.104 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr' 2023-10-06T03:17:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.218+0000 7fd25e925700 1 Processor -- start 2023-10-06T03:17:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.218+0000 7fd25e925700 1 -- start start 2023-10-06T03:17:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd25e925700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd25815d930 0x7fd2580d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd25e925700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2580b2ad0 con 0x7fd25815d560 2023-10-06T03:17:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd25e925700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2580b4160 con 0x7fd2581591b0 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd25e925700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2580b2230 con 0x7fd25815d930 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd257fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd25815d560 0x7fd2580b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44330/0 (socket says 172.21.15.82:44330) 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd257fff700 1 -- 172.21.15.82:0/1523306465 learned_addr learned my addr 172.21.15.82:0/1523306465 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd2577fe700 1 --2- 172.21.15.82:0/1523306465 >> v2:172.21.15.134:3300/0 conn(0x7fd25815d930 0x7fd2580d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460785179 0 0) 0x7fd2580b2ad0 con 0x7fd25815d560 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd240003570 con 0x7fd25815d560 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3623106403 0 0) 0x7fd240003570 con 0x7fd25815d560 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 >> v2:172.21.15.134:3300/0 conn(0x7fd25815d930 msgr2=0x7fd2580d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd256ffd700 1 --2- 172.21.15.82:0/1523306465 >> v2:172.21.15.134:3300/0 conn(0x7fd25815d930 0x7fd2580d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 >> v1:172.21.15.134:6789/0 conn(0x7fd2581591b0 legacy=0x7fd258159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580b2510 con 0x7fd25815d560 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.219+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fd248001470 con 0x7fd25815d560 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 >> v1:172.21.15.82:6789/0 conn(0x7fd25815d560 legacy=0x7fd2580b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd240003a60 0x7fd240003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd240004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2400051c0 0x7fd24000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580b2230 con 0x7fd240004810 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24000c160 con 0x7fd240003a60 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24000c320 con 0x7fd2400051c0 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd2577fe700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd240004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd257fff700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd240003a60 0x7fd240003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd25cec2700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2400051c0 0x7fd24000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd2577fe700 1 -- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2400051c0 msgr2=0x7fd24000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd2577fe700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2400051c0 0x7fd24000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd2577fe700 1 -- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd240003a60 msgr2=0x7fd240003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd2577fe700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd240003a60 0x7fd240003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd2577fe700 1 -- 172.21.15.82:0/1523306465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd240003570 con 0x7fd240004810 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd25cec2700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2400051c0 0x7fd24000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd25cec2700 1 -- 172.21.15.82:0/1523306465 reap_dead start 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd2577fe700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd240004c80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009c00 tx=0x7fd24c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6af376bd805c655 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c00e710 con 0x7fd240004810 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c00e870 con 0x7fd240004810 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.220+0000 7fd256ffd700 1 -- 172.21.15.82:0/1523306465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c00ec30 con 0x7fd240004810 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.221+0000 7fd25e925700 1 -- 172.21.15.82:0/1523306465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 msgr2=0x7fd240004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.221+0000 7fd25e925700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd240004c80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009c00 tx=0x7fd24c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.221+0000 7fd25e925700 1 -- 172.21.15.82:0/1523306465 shutdown_connections 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.221+0000 7fd25e925700 1 --2- 172.21.15.82:0/1523306465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd240004c80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.221+0000 7fd25e925700 1 -- 172.21.15.82:0/1523306465 >> 172.21.15.82:0/1523306465 conn(0x7fd2580d1180 msgr2=0x7fd258069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.221+0000 7fd25e925700 1 -- 172.21.15.82:0/1523306465 shutdown_connections 2023-10-06T03:17:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.221+0000 7fd25e925700 1 -- 172.21.15.82:0/1523306465 wait complete. 2023-10-06T03:17:19.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.222+0000 7fd25e925700 1 Processor -- start 2023-10-06T03:17:19.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.222+0000 7fd25e925700 1 -- start start 2023-10-06T03:17:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25e925700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd25814a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25e925700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd25815b760 0x7fd25815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25e925700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2580aa750 0x7fd2580aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25e925700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25815c110 con 0x7fd240004810 2023-10-06T03:17:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25e925700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580ab100 con 0x7fd2580aa750 2023-10-06T03:17:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25e925700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581553e0 con 0x7fd25815b760 2023-10-06T03:17:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd25814a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd25814a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53946/0 (socket says 172.21.15.82:53946) 2023-10-06T03:17:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 -- 172.21.15.82:0/3719546658 learned_addr learned my addr 172.21.15.82:0/3719546658 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd2577fe700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd25815b760 0x7fd25815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25cec2700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2580aa750 0x7fd2580aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 -- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd25815b760 msgr2=0x7fd25815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd25815b760 0x7fd25815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 -- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2580aa750 msgr2=0x7fd2580aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2580aa750 0x7fd2580aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 -- 172.21.15.82:0/3719546658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580a86e0 con 0x7fd240004810 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd2577fe700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd25815b760 0x7fd25815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25cec2700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2580aa750 0x7fd2580aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd257fff700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd25814a100 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd24800eb90 tx=0x7fd248001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd23ffff700 1 -- 172.21.15.82:0/3719546658 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800c7e0 con 0x7fd240004810 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd23ffff700 1 -- 172.21.15.82:0/3719546658 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24800c940 con 0x7fd240004810 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25814a640 con 0x7fd240004810 2023-10-06T03:17:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd23ffff700 1 -- 172.21.15.82:0/3719546658 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800cd00 con 0x7fd240004810 2023-10-06T03:17:19.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.223+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2580a8090 con 0x7fd240004810 2023-10-06T03:17:19.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.224+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd258064050 con 0x7fd240004810 2023-10-06T03:17:19.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.225+0000 7fd23ffff700 1 -- 172.21.15.82:0/3719546658 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd248013630 con 0x7fd240004810 2023-10-06T03:17:19.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.225+0000 7fd23ffff700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd244066f30 0x7fd2440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.225+0000 7fd23ffff700 1 -- 172.21.15.82:0/3719546658 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd248084480 con 0x7fd240004810 2023-10-06T03:17:19.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.225+0000 7fd2577fe700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd244066f30 0x7fd2440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.226+0000 7fd2577fe700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd244066f30 0x7fd2440693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0091e0 tx=0x7fd24c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:19.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.229+0000 7fd23ffff700 1 -- 172.21.15.82:0/3719546658 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd248051890 con 0x7fd240004810 2023-10-06T03:17:19.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.485+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]} v 0) v1 -- 0x7fd2580b27f0 con 0x7fd240004810 2023-10-06T03:17:19.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.760+0000 7fd23ffff700 1 -- 172.21.15.82:0/3719546658 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]}]=0 v104) v1 ==== 140+0+0 (secure 0 0 0) 0x7fd24800ce60 con 0x7fd240004810 2023-10-06T03:17:19.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd244066f30 msgr2=0x7fd2440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd244066f30 0x7fd2440693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0091e0 tx=0x7fd24c01a000 comp rx=0 tx=0).stop 2023-10-06T03:17:19.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 msgr2=0x7fd25814a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd25814a100 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd24800eb90 tx=0x7fd248001c70 comp rx=0 tx=0).stop 2023-10-06T03:17:19.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 shutdown_connections 2023-10-06T03:17:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2580aa750 0x7fd2580aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd240004810 0x7fd25814a100 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd244066f30 0x7fd2440693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 --2- 172.21.15.82:0/3719546658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd25815b760 0x7fd25815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 >> 172.21.15.82:0/3719546658 conn(0x7fd2580d1180 msgr2=0x7fd258155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 shutdown_connections 2023-10-06T03:17:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.762+0000 7fd25e925700 1 -- 172.21.15.82:0/3719546658 wait complete. 2023-10-06T03:17:19.775 INFO:tasks.cephfs_test_runner:That quota changes made from one client are visible to another ... ok 2023-10-06T03:17:19.775 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_write (tasks.cephfs.test_quota.TestQuota) That when a client modifies the quota on a directory used 2023-10-06T03:17:19.775 INFO:tasks.cephfs_test_runner:test_remote_update_write (tasks.cephfs.test_quota.TestQuota) 2023-10-06T03:17:19.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write' 2023-10-06T03:17:19.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.888+0000 7f10108cd700 1 Processor -- start 2023-10-06T03:17:19.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.888+0000 7f10108cd700 1 -- start start 2023-10-06T03:17:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f10108cd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f100c15d480 0x7f100c069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f10108cd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f100c0b0a20 0x7f100c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f10108cd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c0687c0 con 0x7f100c069da0 2023-10-06T03:17:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f10108cd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c068aa0 con 0x7f100c15d480 2023-10-06T03:17:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f10108cd700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c068d80 con 0x7f100c0b0a20 2023-10-06T03:17:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f100c15d480 0x7f100c069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f100c15d480 0x7f100c069860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53950/0 (socket says 172.21.15.82:53950) 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100b7fe700 1 -- 172.21.15.82:0/2816306143 learned_addr learned my addr 172.21.15.82:0/2816306143 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100bfff700 1 --2- 172.21.15.82:0/2816306143 >> v2:172.21.15.134:3300/0 conn(0x7f100c0b0a20 0x7f100c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100b7fe700 1 -- 172.21.15.82:0/2816306143 >> v2:172.21.15.134:3300/0 conn(0x7f100c0b0a20 msgr2=0x7f100c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100b7fe700 1 --2- 172.21.15.82:0/2816306143 >> v2:172.21.15.134:3300/0 conn(0x7f100c0b0a20 0x7f100c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100b7fe700 1 -- 172.21.15.82:0/2816306143 >> v1:172.21.15.134:6789/0 conn(0x7f100c069da0 legacy=0x7f100c0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100b7fe700 1 -- 172.21.15.82:0/2816306143 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c069060 con 0x7f100c15d480 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.889+0000 7f100b7fe700 1 --2- 172.21.15.82:0/2816306143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c069860 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f100c0b3c10 tx=0x7f0ffc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0a3dffc4f231 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f100a7fc700 1 -- 172.21.15.82:0/2816306143 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00b860 con 0x7f100c15d480 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f100a7fc700 1 -- 172.21.15.82:0/2816306143 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00b9c0 con 0x7f100c15d480 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f100a7fc700 1 -- 172.21.15.82:0/2816306143 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00bd60 con 0x7f100c15d480 2023-10-06T03:17:19.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f10108cd700 1 -- 172.21.15.82:0/2816306143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 msgr2=0x7f100c069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f10108cd700 1 --2- 172.21.15.82:0/2816306143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c069860 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f100c0b3c10 tx=0x7f0ffc009250 comp rx=0 tx=0).stop 2023-10-06T03:17:19.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f10108cd700 1 -- 172.21.15.82:0/2816306143 shutdown_connections 2023-10-06T03:17:19.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f10108cd700 1 --2- 172.21.15.82:0/2816306143 >> v2:172.21.15.134:3300/0 conn(0x7f100c0b0a20 0x7f100c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f10108cd700 1 --2- 172.21.15.82:0/2816306143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c069860 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f10108cd700 1 -- 172.21.15.82:0/2816306143 >> 172.21.15.82:0/2816306143 conn(0x7f100c0ccf80 msgr2=0x7f100c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:19.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f10108cd700 1 -- 172.21.15.82:0/2816306143 shutdown_connections 2023-10-06T03:17:19.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.890+0000 7f10108cd700 1 -- 172.21.15.82:0/2816306143 wait complete. 2023-10-06T03:17:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.891+0000 7f10108cd700 1 Processor -- start 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.891+0000 7f10108cd700 1 -- start start 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f10108cd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f100c069da0 0x7f100c159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f10108cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f100c0b0a20 0x7f100c0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f10108cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f10108cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c16b000 con 0x7f100c15d480 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f10108cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0c71e0 con 0x7f100c0b0a20 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f10108cd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0c74c0 con 0x7f100c069da0 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f100bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f100bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c0cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53952/0 (socket says 172.21.15.82:53952) 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f100bfff700 1 -- 172.21.15.82:0/54359470 learned_addr learned my addr 172.21.15.82:0/54359470 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:19.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.892+0000 7f100affd700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f100c0b0a20 0x7f100c0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f100bfff700 1 -- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f100c069da0 msgr2=0x7f100c159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f100bfff700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f100c069da0 0x7f100c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f100bfff700 1 -- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f100c0b0a20 msgr2=0x7f100c0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f100bfff700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f100c0b0a20 0x7f100c0cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f100bfff700 1 -- 172.21.15.82:0/54359470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0094f0 con 0x7f100c15d480 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f100affd700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f100c0b0a20 0x7f100c0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f100bfff700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c0cbee0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1004007f30 tx=0x7f10040098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f0ff37fe700 1 -- 172.21.15.82:0/54359470 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400ecf0 con 0x7f100c15d480 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f0ff37fe700 1 -- 172.21.15.82:0/54359470 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400ee50 con 0x7f100c15d480 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c0c77a0 con 0x7f100c15d480 2023-10-06T03:17:19.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f0ff37fe700 1 -- 172.21.15.82:0/54359470 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004014670 con 0x7f100c15d480 2023-10-06T03:17:19.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.893+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c159750 con 0x7f100c15d480 2023-10-06T03:17:19.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.894+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c16b1b0 con 0x7f100c15d480 2023-10-06T03:17:19.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.894+0000 7f0ff37fe700 1 -- 172.21.15.82:0/54359470 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10040149e0 con 0x7f100c15d480 2023-10-06T03:17:19.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.895+0000 7f0ff37fe700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0ff8066f30 0x7f0ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:19.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.895+0000 7f0ff37fe700 1 -- 172.21.15.82:0/54359470 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1004084bc0 con 0x7f100c15d480 2023-10-06T03:17:19.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.895+0000 7f100b7fe700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0ff8066f30 0x7f0ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:19.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.895+0000 7f100b7fe700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0ff8066f30 0x7f0ff80693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f100c0b3c10 tx=0x7f0ffc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:19.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:19.899+0000 7f0ff37fe700 1 -- 172.21.15.82:0/54359470 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f100c16b1b0 con 0x7f100c15d480 2023-10-06T03:17:20.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.158+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]} v 0) v1 -- 0x7f100c04c3c0 con 0x7f100c15d480 2023-10-06T03:17:20.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.760+0000 7f0ff37fe700 1 -- 172.21.15.82:0/54359470 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]}]=0 v105) v1 ==== 140+0+0 (secure 0 0 0) 0x7f1004051f30 con 0x7f100c15d480 2023-10-06T03:17:20.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0ff8066f30 msgr2=0x7f0ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:20.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0ff8066f30 0x7f0ff80693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f100c0b3c10 tx=0x7f0ffc017000 comp rx=0 tx=0).stop 2023-10-06T03:17:20.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 msgr2=0x7f100c0cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:20.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c0cbee0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1004007f30 tx=0x7f10040098e0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 shutdown_connections 2023-10-06T03:17:20.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c15d480 0x7f100c0cbee0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0ff8066f30 0x7f0ff80693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f100c069da0 0x7f100c159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 --2- 172.21.15.82:0/54359470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f100c0b0a20 0x7f100c0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 >> 172.21.15.82:0/54359470 conn(0x7f100c0ccf80 msgr2=0x7f100c15c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:20.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 shutdown_connections 2023-10-06T03:17:20.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.762+0000 7f10108cd700 1 -- 172.21.15.82:0/54359470 wait complete. 2023-10-06T03:17:20.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:17:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.897+0000 7fae07b55700 1 Processor -- start 2023-10-06T03:17:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.897+0000 7fae07b55700 1 -- start start 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.898+0000 7fae07b55700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae00157b50 0x7fae000cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.898+0000 7fae07b55700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae00158630 0x7fae00161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.898+0000 7fae07b55700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae00159a60 con 0x7fae000cdb30 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.898+0000 7fae07b55700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae000cdfa0 con 0x7fae00158630 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.898+0000 7fae07b55700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae00158e50 con 0x7fae00157b50 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.898+0000 7fae050f0700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fae000cdb30 0x7fae00157f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44334/0 (socket says 172.21.15.82:44334) 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.898+0000 7fae050f0700 1 -- 172.21.15.82:0/651409786 learned_addr learned my addr 172.21.15.82:0/651409786 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae060f2700 1 --2- 172.21.15.82:0/651409786 >> v2:172.21.15.134:3300/0 conn(0x7fae00158630 0x7fae00161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae058f1700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae00157b50 0x7fae000cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393168935 0 0) 0x7fae00159a60 con 0x7fae000cdb30 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadec003570 con 0x7fae000cdb30 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3480374750 0 0) 0x7fadec003570 con 0x7fae000cdb30 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae00157b50 msgr2=0x7fae000cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae00157b50 0x7fae000cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 >> v2:172.21.15.134:3300/0 conn(0x7fae00158630 msgr2=0x7fae00161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 --2- 172.21.15.82:0/651409786 >> v2:172.21.15.134:3300/0 conn(0x7fae00158630 0x7fae00161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00159130 con 0x7fae000cdb30 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fadf0001470 con 0x7fae000cdb30 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 >> v1:172.21.15.82:6789/0 conn(0x7fae000cdb30 legacy=0x7fae00157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadec003a60 0x7fadec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae00157b50 0x7fadec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadec004d50 0x7fadec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae000cdfa0 con 0x7fadec004d50 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae00158e50 con 0x7fadec003a60 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec00ba60 con 0x7fae00157b50 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae060f2700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadec004d50 0x7fadec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae058f1700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadec003a60 0x7fadec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae050f0700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae00157b50 0x7fadec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae060f2700 1 -- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae00157b50 msgr2=0x7fadec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae060f2700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae00157b50 0x7fadec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae060f2700 1 -- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadec003a60 msgr2=0x7fadec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae060f2700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadec003a60 0x7fadec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.899+0000 7fae060f2700 1 -- 172.21.15.82:0/651409786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec003570 con 0x7fadec004d50 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae060f2700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadec004d50 0x7fadec0051c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009c00 tx=0x7fadf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8da2d05b447ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800e6b0 con 0x7fadec004d50 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf800e810 con 0x7fadec004d50 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae048ef700 1 -- 172.21.15.82:0/651409786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800ebd0 con 0x7fadec004d50 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae07b55700 1 -- 172.21.15.82:0/651409786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadec004d50 msgr2=0x7fadec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae07b55700 1 --2- 172.21.15.82:0/651409786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadec004d50 0x7fadec0051c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009c00 tx=0x7fadf80091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae060f2700 1 -- 172.21.15.82:0/651409786 reap_dead start 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae07b55700 1 -- 172.21.15.82:0/651409786 shutdown_connections 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae07b55700 1 -- 172.21.15.82:0/651409786 >> 172.21.15.82:0/651409786 conn(0x7fae0006d890 msgr2=0x7fae0006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae07b55700 1 -- 172.21.15.82:0/651409786 shutdown_connections 2023-10-06T03:17:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.900+0000 7fae07b55700 1 -- 172.21.15.82:0/651409786 wait complete. 2023-10-06T03:17:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.901+0000 7fae07b55700 1 Processor -- start 2023-10-06T03:17:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.901+0000 7fae07b55700 1 -- start start 2023-10-06T03:17:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae07b55700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae0014ed10 0x7fae00156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae07b55700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae0014f0e0 0x7fae00153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae07b55700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0015d170 0x7fae0015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae07b55700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae00167a50 con 0x7fae0014ed10 2023-10-06T03:17:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae07b55700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0015db00 con 0x7fae0015d170 2023-10-06T03:17:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae07b55700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae00154f20 con 0x7fae0014f0e0 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae058f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae0014ed10 0x7fae00156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae058f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae0014ed10 0x7fae00156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53974/0 (socket says 172.21.15.82:53974) 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae058f1700 1 -- 172.21.15.82:0/1450570278 learned_addr learned my addr 172.21.15.82:0/1450570278 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae060f2700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0015d170 0x7fae0015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae058f1700 1 -- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae0014f0e0 msgr2=0x7fae00153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae058f1700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae0014f0e0 0x7fae00153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae058f1700 1 -- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0015d170 msgr2=0x7fae0015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae058f1700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0015d170 0x7fae0015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae058f1700 1 -- 172.21.15.82:0/1450570278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00154680 con 0x7fae0014ed10 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.902+0000 7fae060f2700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0015d170 0x7fae0015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.903+0000 7fae058f1700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae0014ed10 0x7fae00156570 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fadfc011f60 tx=0x7fadfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.903+0000 7fadf5ffb700 1 -- 172.21.15.82:0/1450570278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00e040 con 0x7fae0014ed10 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.903+0000 7fadf5ffb700 1 -- 172.21.15.82:0/1450570278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc00f040 con 0x7fae0014ed10 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.903+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae00154960 con 0x7fae0014ed10 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.903+0000 7fadf5ffb700 1 -- 172.21.15.82:0/1450570278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc015430 con 0x7fae0014ed10 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.903+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae001542b0 con 0x7fae0014ed10 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.904+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae00064050 con 0x7fae0014ed10 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.904+0000 7fadf5ffb700 1 -- 172.21.15.82:0/1450570278 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadfc015820 con 0x7fae0014ed10 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.905+0000 7fadf5ffb700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fade4066f60 0x7fade4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.905+0000 7fadf5ffb700 1 -- 172.21.15.82:0/1450570278 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fadfc0850f0 con 0x7fae0014ed10 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.905+0000 7fae050f0700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fade4066f60 0x7fade4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.905+0000 7fae050f0700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fade4066f60 0x7fade4069410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf0000e10 tx=0x7fadf0001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:20.909+0000 7fadf5ffb700 1 -- 172.21.15.82:0/1450570278 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadfc055f90 con 0x7fae0014ed10 2023-10-06T03:17:21.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.091+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fae000cb050 con 0x7fae0014ed10 2023-10-06T03:17:21.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.094+0000 7fadf5ffb700 1 -- 172.21.15.82:0/1450570278 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fadfc055b20 con 0x7fae0014ed10 2023-10-06T03:17:21.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fade4066f60 msgr2=0x7fade4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fade4066f60 0x7fade4069410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf0000e10 tx=0x7fadf0001e90 comp rx=0 tx=0).stop 2023-10-06T03:17:21.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae0014ed10 msgr2=0x7fae00156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae0014ed10 0x7fae00156570 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fadfc011f60 tx=0x7fadfc00b040 comp rx=0 tx=0).stop 2023-10-06T03:17:21.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 shutdown_connections 2023-10-06T03:17:21.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0015d170 0x7fae0015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae0014ed10 0x7fae00156570 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fade4066f60 0x7fade4069410 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 --2- 172.21.15.82:0/1450570278 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae0014f0e0 0x7fae00153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 >> 172.21.15.82:0/1450570278 conn(0x7fae0006d890 msgr2=0x7fae0006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:21.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 shutdown_connections 2023-10-06T03:17:21.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.096+0000 7fae07b55700 1 -- 172.21.15.82:0/1450570278 wait complete. 2023-10-06T03:17:21.109 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:17:21.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:17:21.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:17:21.197 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:17:21.198 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:17:21.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:21.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.312+0000 7f96d073f700 1 Processor -- start 2023-10-06T03:17:21.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.312+0000 7f96d073f700 1 -- start start 2023-10-06T03:17:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.313+0000 7f96d073f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f96c81596c0 0x7f96c815d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.313+0000 7f96d073f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96c80b09a0 0x7f96c80c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.313+0000 7f96d073f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c815e3a0 con 0x7f96c815d960 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.313+0000 7f96d073f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c80cc470 con 0x7f96c81596c0 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.313+0000 7f96d073f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c815dde0 con 0x7f96c80b09a0 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.313+0000 7f96ce4db700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f96c81596c0 0x7f96c815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96ce4db700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f96c81596c0 0x7f96c815d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53976/0 (socket says 172.21.15.82:53976) 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96ce4db700 1 -- 172.21.15.82:0/1308804253 learned_addr learned my addr 172.21.15.82:0/1308804253 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96cdcda700 1 --2- 172.21.15.82:0/1308804253 >> v2:172.21.15.134:3300/0 conn(0x7f96c80b09a0 0x7f96c80c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96ce4db700 1 -- 172.21.15.82:0/1308804253 >> v2:172.21.15.134:3300/0 conn(0x7f96c80b09a0 msgr2=0x7f96c80c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96ce4db700 1 --2- 172.21.15.82:0/1308804253 >> v2:172.21.15.134:3300/0 conn(0x7f96c80b09a0 0x7f96c80c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96ce4db700 1 -- 172.21.15.82:0/1308804253 >> v1:172.21.15.134:6789/0 conn(0x7f96c815d960 legacy=0x7f96c8068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96ce4db700 1 -- 172.21.15.82:0/1308804253 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c815e0c0 con 0x7f96c81596c0 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96ce4db700 1 --2- 172.21.15.82:0/1308804253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c81596c0 0x7f96c815d420 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f96c80c1c70 tx=0x7f96c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8035457f51f862c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96cd4d9700 1 -- 172.21.15.82:0/1308804253 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400e070 con 0x7f96c81596c0 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96cd4d9700 1 -- 172.21.15.82:0/1308804253 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c400ba50 con 0x7f96c81596c0 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.314+0000 7f96cd4d9700 1 -- 172.21.15.82:0/1308804253 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40092e0 con 0x7f96c81596c0 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.315+0000 7f96d073f700 1 -- 172.21.15.82:0/1308804253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c81596c0 msgr2=0x7f96c815d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.315+0000 7f96d073f700 1 --2- 172.21.15.82:0/1308804253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c81596c0 0x7f96c815d420 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f96c80c1c70 tx=0x7f96c4009840 comp rx=0 tx=0).stop 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.315+0000 7f96d073f700 1 -- 172.21.15.82:0/1308804253 shutdown_connections 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.315+0000 7f96d073f700 1 --2- 172.21.15.82:0/1308804253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c81596c0 0x7f96c815d420 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.315+0000 7f96d073f700 1 --2- 172.21.15.82:0/1308804253 >> v2:172.21.15.134:3300/0 conn(0x7f96c80b09a0 0x7f96c80c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.315+0000 7f96d073f700 1 -- 172.21.15.82:0/1308804253 >> 172.21.15.82:0/1308804253 conn(0x7f96c8067630 msgr2=0x7f96c8067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.315+0000 7f96d073f700 1 -- 172.21.15.82:0/1308804253 shutdown_connections 2023-10-06T03:17:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.315+0000 7f96d073f700 1 -- 172.21.15.82:0/1308804253 wait complete. 2023-10-06T03:17:21.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.316+0000 7f96d073f700 1 Processor -- start 2023-10-06T03:17:21.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.316+0000 7f96d073f700 1 -- start start 2023-10-06T03:17:21.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.316+0000 7f96d073f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c81596c0 0x7f96c81579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.316+0000 7f96d073f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c8159a90 0x7f96c815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.316+0000 7f96d073f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c815c8c0 0x7f96c80c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.316+0000 7f96d073f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c80c58c0 con 0x7f96c815c8c0 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.316+0000 7f96d073f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815cdd0 con 0x7f96c81596c0 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.316+0000 7f96d073f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815d0b0 con 0x7f96c8159a90 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c815c8c0 0x7f96c80c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c815c8c0 0x7f96c80c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53990/0 (socket says 172.21.15.82:53990) 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 -- 172.21.15.82:0/1647300658 learned_addr learned my addr 172.21.15.82:0/1647300658 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96ce4db700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c81596c0 0x7f96c81579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cdcda700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c8159a90 0x7f96c815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 -- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c8159a90 msgr2=0x7f96c815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c8159a90 0x7f96c815c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 -- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c81596c0 msgr2=0x7f96c81579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c81596c0 0x7f96c81579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 -- 172.21.15.82:0/1647300658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009ae0 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cdcda700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c8159a90 0x7f96c815c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96cecdc700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c815c8c0 0x7f96c80c5d50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c4c0 tx=0x7f96c0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96be7fc700 1 -- 172.21.15.82:0/1647300658 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0011590 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96be7fc700 1 -- 172.21.15.82:0/1647300658 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c0011710 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c815d390 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96be7fc700 1 -- 172.21.15.82:0/1647300658 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0011ad0 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.317+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c80afa80 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.318+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c80c5a30 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.318+0000 7f96be7fc700 1 -- 172.21.15.82:0/1647300658 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96c001b3b0 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.319+0000 7f96be7fc700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96ac066f30 0x7f96ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.319+0000 7f96be7fc700 1 -- 172.21.15.82:0/1647300658 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f96c0083660 con 0x7f96c815c8c0 2023-10-06T03:17:21.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.319+0000 7f96ce4db700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96ac066f30 0x7f96ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.319+0000 7f96ce4db700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96ac066f30 0x7f96ac0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009880 tx=0x7f96c4018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:21.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.323+0000 7f96be7fc700 1 -- 172.21.15.82:0/1647300658 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96c0050a70 con 0x7f96c815c8c0 2023-10-06T03:17:21.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.550+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96c8064050 con 0x7f96c815c8c0 2023-10-06T03:17:21.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.551+0000 7f96be7fc700 1 -- 172.21.15.82:0/1647300658 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f96c0017090 con 0x7f96c815c8c0 2023-10-06T03:17:21.552 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:21.552 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2460851709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":2460851709},{"type":"v1","addr":"172.21.15.134:6837","nonce":2460851709}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/771524024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":771524024},{"type":"v1","addr":"172.21.15.134:6836","nonce":771524024}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/3256175471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3256175471},{"type":"v1","addr":"172.21.15.82:6834","nonce":3256175471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1498717447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":1498717447},{"type":"v1","addr":"172.21.15.82:6835","nonce":1498717447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-10-06T03:17:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96ac066f30 msgr2=0x7f96ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96ac066f30 0x7f96ac0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009880 tx=0x7f96c4018000 comp rx=0 tx=0).stop 2023-10-06T03:17:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c815c8c0 msgr2=0x7f96c80c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c815c8c0 0x7f96c80c5d50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c4c0 tx=0x7f96c0007f50 comp rx=0 tx=0).stop 2023-10-06T03:17:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 shutdown_connections 2023-10-06T03:17:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96c815c8c0 0x7f96c80c5d50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c81596c0 0x7f96c81579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f96ac066f30 0x7f96ac0693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 --2- 172.21.15.82:0/1647300658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c8159a90 0x7f96c815c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 >> 172.21.15.82:0/1647300658 conn(0x7f96c8067630 msgr2=0x7f96c8158990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 shutdown_connections 2023-10-06T03:17:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.553+0000 7f96d073f700 1 -- 172.21.15.82:0/1647300658 wait complete. 2023-10-06T03:17:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2023-10-06T03:17:21.565 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:17:21.566 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:17:21.566 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:17:21.566 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:17:21.566 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:17:21.566 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:17:21.566 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:17:21.567 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:17:21.567 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:17:21.567 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:17:21.567 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:17:21.567 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:17:21.567 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:17:21.567 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:17:21.568 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:17:21.568 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:17:21.575 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:17:21.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:17:21.576 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:17:21.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:17:21.579 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:17:21.579 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:17:21.580 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:17:21.580 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:17:21.618 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:17:21.619 DEBUG:teuthology.parallel:result is None 2023-10-06T03:17:21.619 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:17:21.620 DEBUG:teuthology.parallel:result is None 2023-10-06T03:17:21.622 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:17:21.622 DEBUG:teuthology.parallel:result is None 2023-10-06T03:17:21.622 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:17:21.623 DEBUG:teuthology.parallel:result is None 2023-10-06T03:17:21.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:17:21.691 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-10-06T03:17:21.692 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-10-06T03:17:21.704 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-10-06T03:17:21.704 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-10-06T03:17:21.705 INFO:tasks.ceph.mds.d.smithi134.stderr:2023-10-06T03:17:21.704+0000 7f4a8c8d3700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T03:17:21.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.743+0000 7f05fa753700 1 Processor -- start 2023-10-06T03:17:21.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.743+0000 7f05fa753700 1 -- start start 2023-10-06T03:17:21.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05fa753700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f4159500 0x7f05f41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05fa753700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f05f415dab0 0x7f05f40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05fa753700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f40b1110 con 0x7f05f40b3fd0 2023-10-06T03:17:21.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05fa753700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f40b13b0 con 0x7f05f415dab0 2023-10-06T03:17:21.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05fa753700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f40b1690 con 0x7f05f4159500 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05f8cf0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f05f415dab0 0x7f05f40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05f37fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f05f40b3fd0 0x7f05f415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44350/0 (socket says 172.21.15.82:44350) 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05f37fe700 1 -- 172.21.15.82:0/3800266113 learned_addr learned my addr 172.21.15.82:0/3800266113 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.744+0000 7f05f3fff700 1 --2- 172.21.15.82:0/3800266113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f4159500 0x7f05f41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f8cf0700 1 -- 172.21.15.82:0/3800266113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f4159500 msgr2=0x7f05f41598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f8cf0700 1 --2- 172.21.15.82:0/3800266113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f4159500 0x7f05f41598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f8cf0700 1 -- 172.21.15.82:0/3800266113 >> v1:172.21.15.82:6789/0 conn(0x7f05f40b3fd0 legacy=0x7f05f415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f8cf0700 1 -- 172.21.15.82:0/3800266113 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f40b1970 con 0x7f05f415dab0 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f2ffd700 1 -- 172.21.15.82:0/3800266113 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753141974 0 0) 0x7f05f40b1110 con 0x7f05f40b3fd0 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f3fff700 1 --2- 172.21.15.82:0/3800266113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f4159500 0x7f05f41598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f8cf0700 1 --2- 172.21.15.82:0/3800266113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f415dab0 0x7f05f40cf6c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009e60 tx=0x7f05ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0173eafcbcff749 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:21.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f2ffd700 1 -- 172.21.15.82:0/3800266113 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00e070 con 0x7f05f415dab0 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f2ffd700 1 -- 172.21.15.82:0/3800266113 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec00bc30 con 0x7f05f415dab0 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05f2ffd700 1 -- 172.21.15.82:0/3800266113 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec012430 con 0x7f05f415dab0 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05fa753700 1 -- 172.21.15.82:0/3800266113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f415dab0 msgr2=0x7f05f40cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05fa753700 1 --2- 172.21.15.82:0/3800266113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f415dab0 0x7f05f40cf6c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009e60 tx=0x7f05ec009780 comp rx=0 tx=0).stop 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05fa753700 1 -- 172.21.15.82:0/3800266113 shutdown_connections 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05fa753700 1 --2- 172.21.15.82:0/3800266113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f415dab0 0x7f05f40cf6c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05fa753700 1 --2- 172.21.15.82:0/3800266113 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f4159500 0x7f05f41598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05fa753700 1 -- 172.21.15.82:0/3800266113 >> 172.21.15.82:0/3800266113 conn(0x7f05f4067630 msgr2=0x7f05f4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05fa753700 1 -- 172.21.15.82:0/3800266113 shutdown_connections 2023-10-06T03:17:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.745+0000 7f05fa753700 1 -- 172.21.15.82:0/3800266113 wait complete. 2023-10-06T03:17:21.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.746+0000 7f05fa753700 1 Processor -- start 2023-10-06T03:17:21.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05fa753700 1 -- start start 2023-10-06T03:17:21.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05fa753700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f40b3fd0 0x7f05f4135990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05fa753700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f4159500 0x7f05f4150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05fa753700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f415dab0 0x7f05f4158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05fa753700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f41509e0 con 0x7f05f4159500 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05fa753700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f40688a0 con 0x7f05f415dab0 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05fa753700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f4067f70 con 0x7f05f40b3fd0 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f4159500 0x7f05f4150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f4159500 0x7f05f4150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54038/0 (socket says 172.21.15.82:54038) 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05f37fe700 1 -- 172.21.15.82:0/968502879 learned_addr learned my addr 172.21.15.82:0/968502879 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.747+0000 7f05f3fff700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f40b3fd0 0x7f05f4135990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05f8cf0700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f415dab0 0x7f05f4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05f37fe700 1 -- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f40b3fd0 msgr2=0x7f05f4135990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05f37fe700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f40b3fd0 0x7f05f4135990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05f37fe700 1 -- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f415dab0 msgr2=0x7f05f4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05f37fe700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f415dab0 0x7f05f4158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05f37fe700 1 -- 172.21.15.82:0/968502879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec009a20 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05f8cf0700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f415dab0 0x7f05f4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05f37fe700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f4159500 0x7f05f4150070 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c7e0 tx=0x7f05e8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05dbfff700 1 -- 172.21.15.82:0/968502879 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8005b30 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05dbfff700 1 -- 172.21.15.82:0/968502879 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8005c90 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f4068250 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05dbfff700 1 -- 172.21.15.82:0/968502879 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8007300 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.748+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f4135ed0 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.749+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f4068a50 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.749+0000 7f05dbfff700 1 -- 172.21.15.82:0/968502879 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05e80076b0 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.750+0000 7f05dbfff700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f05e0066f30 0x7f05e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.750+0000 7f05dbfff700 1 -- 172.21.15.82:0/968502879 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f05e80838f0 con 0x7f05f4159500 2023-10-06T03:17:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.750+0000 7f05f3fff700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f05e0066f30 0x7f05e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:21.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.750+0000 7f05f3fff700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f05e0066f30 0x7f05e00693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f05e4006f00 tx=0x7f05e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:21.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.754+0000 7f05dbfff700 1 -- 172.21.15.82:0/968502879 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05f4068a50 con 0x7f05f4159500 2023-10-06T03:17:21.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:21.954+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f05f4088300 con 0x7f05f4159500 2023-10-06T03:17:22.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.783+0000 7f05dbfff700 1 -- 172.21.15.82:0/968502879 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7f05e8017080 con 0x7f05f4159500 2023-10-06T03:17:22.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f05e0066f30 msgr2=0x7f05e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:22.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f05e0066f30 0x7f05e00693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f05e4006f00 tx=0x7f05e4008040 comp rx=0 tx=0).stop 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f4159500 msgr2=0x7f05f4150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f4159500 0x7f05f4150070 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c7e0 tx=0x7f05e8007df0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 shutdown_connections 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05f415dab0 0x7f05f4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f05e0066f30 0x7f05e00693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05f40b3fd0 0x7f05f4135990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.785+0000 7f05fa753700 1 --2- 172.21.15.82:0/968502879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05f4159500 0x7f05f4150070 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.786+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 >> 172.21.15.82:0/968502879 conn(0x7f05f4067630 msgr2=0x7f05f414a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.786+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 shutdown_connections 2023-10-06T03:17:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.786+0000 7f05fa753700 1 -- 172.21.15.82:0/968502879 wait complete. 2023-10-06T03:17:22.789 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-10-06T03:17:22.800 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:17:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.912+0000 7f3e2b1fa700 1 Processor -- start 2023-10-06T03:17:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.912+0000 7f3e2b1fa700 1 -- start start 2023-10-06T03:17:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.912+0000 7f3e2b1fa700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3e2415b170 0x7f3e240cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.912+0000 7f3e2b1fa700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e24158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.912+0000 7f3e2b1fa700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240cad80 con 0x7f3e240c8d60 2023-10-06T03:17:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.912+0000 7f3e2b1fa700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240cd580 con 0x7f3e2415b170 2023-10-06T03:17:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.912+0000 7f3e2b1fa700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240cc970 con 0x7f3e240c9130 2023-10-06T03:17:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3e2415b170 0x7f3e240cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e29797700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e24158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e28f96700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3e240c8d60 0x7f3e240c3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:36730/0 (socket says 172.21.15.82:36730) 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e28f96700 1 -- 172.21.15.82:0/2815032375 learned_addr learned my addr 172.21.15.82:0/2815032375 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1bfff700 1 -- 172.21.15.82:0/2815032375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 msgr2=0x7f3e24158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1bfff700 1 --2- 172.21.15.82:0/2815032375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e24158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1bfff700 1 -- 172.21.15.82:0/2815032375 >> v1:172.21.15.134:6789/0 conn(0x7f3e240c8d60 legacy=0x7f3e240c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1bfff700 1 -- 172.21.15.82:0/2815032375 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240ccc50 con 0x7f3e2415b170 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e29797700 1 --2- 172.21.15.82:0/2815032375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e24158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1bfff700 1 --2- 172.21.15.82:0/2815032375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 0x7f3e240cc2b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3e140098e0 tx=0x7f3e140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8150535d7d49c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1b7fe700 1 -- 172.21.15.82:0/2815032375 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400b640 con 0x7f3e2415b170 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1b7fe700 1 -- 172.21.15.82:0/2815032375 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1400b7a0 con 0x7f3e2415b170 2023-10-06T03:17:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.913+0000 7f3e1b7fe700 1 -- 172.21.15.82:0/2815032375 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400bb40 con 0x7f3e2415b170 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.914+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/2815032375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 msgr2=0x7f3e240cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.914+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/2815032375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 0x7f3e240cc2b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3e140098e0 tx=0x7f3e140091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.914+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/2815032375 shutdown_connections 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.914+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/2815032375 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e24158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.914+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/2815032375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 0x7f3e240cc2b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.914+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/2815032375 >> 172.21.15.82:0/2815032375 conn(0x7f3e240ce4d0 msgr2=0x7f3e240ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.914+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/2815032375 shutdown_connections 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.914+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/2815032375 wait complete. 2023-10-06T03:17:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.915+0000 7f3e2b1fa700 1 Processor -- start 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.915+0000 7f3e2b1fa700 1 -- start start 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e2b1fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e240c8d60 0x7f3e24143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e2b1fa700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e240c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e2b1fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 0x7f3e240b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e2b1fa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241594f0 con 0x7f3e240c8d60 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e2b1fa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c7eb0 con 0x7f3e2415b170 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e2b1fa700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c8190 con 0x7f3e240c9130 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e28f96700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e240c8d60 0x7f3e24143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e28f96700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e240c8d60 0x7f3e24143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54054/0 (socket says 172.21.15.82:54054) 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e28f96700 1 -- 172.21.15.82:0/1705376822 learned_addr learned my addr 172.21.15.82:0/1705376822 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e1bfff700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e240c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e29797700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 0x7f3e240b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e28f96700 1 -- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 msgr2=0x7f3e240c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e28f96700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e240c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e28f96700 1 -- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 msgr2=0x7f3e240b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e28f96700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 0x7f3e240b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.916+0000 7f3e28f96700 1 -- 172.21.15.82:0/1705376822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c009a20 con 0x7f3e240c8d60 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.917+0000 7f3e28f96700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e240c8d60 0x7f3e24143ed0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000c7c0 tx=0x7f3e20007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.917+0000 7f3e18ff9700 1 -- 172.21.15.82:0/1705376822 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20005b30 con 0x7f3e240c8d60 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.917+0000 7f3e18ff9700 1 -- 172.21.15.82:0/1705376822 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e20005cb0 con 0x7f3e240c8d60 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.917+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e14009420 con 0x7f3e240c8d60 2023-10-06T03:17:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.917+0000 7f3e18ff9700 1 -- 172.21.15.82:0/1705376822 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20004a80 con 0x7f3e240c8d60 2023-10-06T03:17:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.917+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e24144410 con 0x7f3e240c8d60 2023-10-06T03:17:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.918+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e24158fe0 con 0x7f3e240c8d60 2023-10-06T03:17:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.918+0000 7f3e18ff9700 1 -- 172.21.15.82:0/1705376822 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e200070f0 con 0x7f3e240c8d60 2023-10-06T03:17:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.918+0000 7f3e18ff9700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3e10066f30 0x7f3e100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.918+0000 7f3e18ff9700 1 -- 172.21.15.82:0/1705376822 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3e20083700 con 0x7f3e240c8d60 2023-10-06T03:17:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.919+0000 7f3e1bfff700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3e10066f30 0x7f3e100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.919+0000 7f3e1bfff700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3e10066f30 0x7f3e100693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e140093f0 tx=0x7f3e14017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:22.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:22.923+0000 7f3e18ff9700 1 -- 172.21.15.82:0/1705376822 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e24158fe0 con 0x7f3e240c8d60 2023-10-06T03:17:23.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.177+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3e24158fe0 con 0x7f3e240c8d60 2023-10-06T03:17:23.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.177+0000 7f3e18ff9700 1 -- 172.21.15.82:0/1705376822 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3e24158fe0 con 0x7f3e240c8d60 2023-10-06T03:17:23.179 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:23.179 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:23.179 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l724PDBAAKY5FzGqpcmJ9nM/VzdTluA==", 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l2iFnFxAAnxKQmAHZarx6LfCeKkON3A==", 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-10-06T03:17:23.181 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lTOzVEhAACwLXU1KFGLhLFDFKzj6g3Q==", 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9le7I7HhAArFktlgVJrQpOrrUTVk22Xw==", 2023-10-06T03:17:23.182 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC3ex9lSwhPNRAAEuYJnr5peNQ+adzmaiVfuA==", 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:17:23.183 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC6ex9lZ7t5MhAAm8vw3nhRW4ZVUaf1Ta7ytg==", 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.184 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC9ex9lZyKZMhAAmnaJ8C9oe6oQYNe9flPP/w==", 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.185 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDAex9lXgMXMRAABl0OhmR0JLg6lg2t0i34sg==", 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDGex9lsr9wLxAAQ41BKVQ/dy5Z9EOm/16qDw==", 2023-10-06T03:17:23.186 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDJex9l7He2LRAA8Xan1h5Sm60wJtAQP/FLzA==", 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:17:23.187 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDMex9ldA63KxAAenPCZN/PLtQdV14ELvSBWg==", 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQDPex9lyQ7RLRAAzKpuBd2pcmtTiku1klhAew==", 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-10-06T03:17:23.189 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lylUIIhAA6GrLOJ3Kp6n7xUJ3VoBUiQ==", 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l8UthKhAALxBTh0SRcmfHtgEIOjSuLA==", 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l5shkJxAA+IYYf2SQk8x/hSeuLH3NRQ==", 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:17:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9ljArALxAA7shG1AhpdCbRGUzZR4HHng==", 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-10-06T03:17:23.192 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQCzex9lU7IULBAABmDwAP9lztKEz35R80eZRA==", 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.193 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9lsmYMCRAA1BY9VAWL0YXlNJAmkjau9w==", 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:23.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQC0ex9l8Dr/BBAA/cTmol+xUbQ2HOUtowC/Zw==", 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-10-06T03:17:23.195 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3e10066f30 msgr2=0x7f3e100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3e10066f30 0x7f3e100693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e140093f0 tx=0x7f3e14017000 comp rx=0 tx=0).stop 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e240c8d60 msgr2=0x7f3e24143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e240c8d60 0x7f3e24143ed0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000c7c0 tx=0x7f3e20007f70 comp rx=0 tx=0).stop 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 shutdown_connections 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2415b170 0x7f3e240b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e240c8d60 0x7f3e24143ed0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3e10066f30 0x7f3e100693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 --2- 172.21.15.82:0/1705376822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e240c9130 0x7f3e240c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.179+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 >> 172.21.15.82:0/1705376822 conn(0x7f3e240ce4d0 msgr2=0x7f3e24157030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.180+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 shutdown_connections 2023-10-06T03:17:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.180+0000 7f3e2b1fa700 1 -- 172.21.15.82:0/1705376822 wait complete. 2023-10-06T03:17:23.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:23.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.311+0000 7f77c96d7700 1 Processor -- start 2023-10-06T03:17:23.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.311+0000 7f77c96d7700 1 -- start start 2023-10-06T03:17:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c96d7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c4156680 0x7f77c40ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c96d7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f77c40c8310 0x7f77c40ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c96d7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40c1110 con 0x7f77c41562b0 2023-10-06T03:17:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c96d7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c406eb90 con 0x7f77c40c8310 2023-10-06T03:17:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c96d7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c406ee60 con 0x7f77c4156680 2023-10-06T03:17:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c3fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f77c41562b0 0x7f77c406e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44352/0 (socket says 172.21.15.82:44352) 2023-10-06T03:17:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c3fff700 1 -- 172.21.15.82:0/769187365 learned_addr learned my addr 172.21.15.82:0/769187365 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408145227 0 0) 0x7f77c40c1110 con 0x7f77c41562b0 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ac003570 con 0x7f77c41562b0 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c37fe700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c4156680 0x7f77c40ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.312+0000 7f77c8ed6700 1 --2- 172.21.15.82:0/769187365 >> v2:172.21.15.134:3300/0 conn(0x7f77c40c8310 0x7f77c40ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2129904985 0 0) 0x7f77ac003570 con 0x7f77c41562b0 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c4156680 msgr2=0x7f77c40ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c4156680 0x7f77c40ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 >> v2:172.21.15.134:3300/0 conn(0x7f77c40c8310 msgr2=0x7f77c40ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 --2- 172.21.15.82:0/769187365 >> v2:172.21.15.134:3300/0 conn(0x7f77c40c8310 0x7f77c40ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c406f140 con 0x7f77c41562b0 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f77b4001470 con 0x7f77c41562b0 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 >> v1:172.21.15.82:6789/0 conn(0x7f77c41562b0 legacy=0x7f77c406e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac003a60 0x7f77ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77ac004810 0x7f77ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c4156680 0x7f77ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c406eb90 con 0x7f77ac004810 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c406ee60 con 0x7f77ac003a60 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac00ba60 con 0x7f77c4156680 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c37fe700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77ac004810 0x7f77ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c3fff700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac003a60 0x7f77ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c8ed6700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c4156680 0x7f77ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c37fe700 1 -- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c4156680 msgr2=0x7f77ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c37fe700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c4156680 0x7f77ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c37fe700 1 -- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac003a60 msgr2=0x7f77ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c37fe700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac003a60 0x7f77ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c37fe700 1 -- 172.21.15.82:0/769187365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac003570 con 0x7f77ac004810 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c3fff700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac003a60 0x7f77ac003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c37fe700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77ac004810 0x7f77ac004c80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009c30 tx=0x7f77b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d933fce663883c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800e710 con 0x7f77ac004810 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b800e870 con 0x7f77ac004810 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.313+0000 7f77c2ffd700 1 -- 172.21.15.82:0/769187365 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800ec30 con 0x7f77ac004810 2023-10-06T03:17:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.314+0000 7f77c96d7700 1 -- 172.21.15.82:0/769187365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77ac004810 msgr2=0x7f77ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.314+0000 7f77c96d7700 1 --2- 172.21.15.82:0/769187365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77ac004810 0x7f77ac004c80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009c30 tx=0x7f77b80091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.314+0000 7f77c8ed6700 1 -- 172.21.15.82:0/769187365 reap_dead start 2023-10-06T03:17:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.314+0000 7f77c96d7700 1 -- 172.21.15.82:0/769187365 shutdown_connections 2023-10-06T03:17:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.314+0000 7f77c96d7700 1 -- 172.21.15.82:0/769187365 >> 172.21.15.82:0/769187365 conn(0x7f77c40c95d0 msgr2=0x7f77c4067630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.314+0000 7f77c96d7700 1 -- 172.21.15.82:0/769187365 shutdown_connections 2023-10-06T03:17:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.314+0000 7f77c96d7700 1 -- 172.21.15.82:0/769187365 wait complete. 2023-10-06T03:17:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.315+0000 7f77c96d7700 1 Processor -- start 2023-10-06T03:17:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.315+0000 7f77c96d7700 1 -- start start 2023-10-06T03:17:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c96d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac004810 0x7f77c4149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c96d7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c413ed40 0x7f77c40c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c96d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c40ca4d0 0x7f77c41450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c96d7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40ca950 con 0x7f77c40ca4d0 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c96d7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4144c40 con 0x7f77ac004810 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c96d7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4144030 con 0x7f77c413ed40 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c40ca4d0 0x7f77c41450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c40ca4d0 0x7f77c41450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54082/0 (socket says 172.21.15.82:54082) 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 -- 172.21.15.82:0/2631830754 learned_addr learned my addr 172.21.15.82:0/2631830754 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 -- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c413ed40 msgr2=0x7f77c40c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c413ed40 0x7f77c40c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 -- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac004810 msgr2=0x7f77c4149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac004810 0x7f77c4149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 -- 172.21.15.82:0/2631830754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4144310 con 0x7f77c40ca4d0 2023-10-06T03:17:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77c8ed6700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c40ca4d0 0x7f77c41450d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f77c4071a30 tx=0x7f77bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.316+0000 7f77abfff700 1 -- 172.21.15.82:0/2631830754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00e070 con 0x7f77c40ca4d0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.317+0000 7f77abfff700 1 -- 172.21.15.82:0/2631830754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc011d00 con 0x7f77c40ca4d0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.317+0000 7f77abfff700 1 -- 172.21.15.82:0/2631830754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0166c0 con 0x7f77c40ca4d0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.317+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c41445f0 con 0x7f77c40ca4d0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.317+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c4143bf0 con 0x7f77c40ca4d0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.317+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c4143de0 con 0x7f77c40ca4d0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.318+0000 7f77abfff700 1 -- 172.21.15.82:0/2631830754 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77bc016a70 con 0x7f77c40ca4d0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.318+0000 7f77abfff700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f77b0066f30 0x7f77b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.318+0000 7f77abfff700 1 -- 172.21.15.82:0/2631830754 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f77bc084ee0 con 0x7f77c40ca4d0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.319+0000 7f77c3fff700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f77b0066f30 0x7f77b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.319+0000 7f77c3fff700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f77b0066f30 0x7f77b00693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f77b4001200 tx=0x7f77b40014c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.322+0000 7f77abfff700 1 -- 172.21.15.82:0/2631830754 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77bc055dd0 con 0x7f77c40ca4d0 2023-10-06T03:17:23.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.507+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77c4144db0 con 0x7f77c40ca4d0 2023-10-06T03:17:23.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.508+0000 7f77abfff700 1 -- 172.21.15.82:0/2631830754 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f77bc055960 con 0x7f77c40ca4d0 2023-10-06T03:17:23.510 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:23.510 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":51,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:22.782193+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:23.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f77b0066f30 msgr2=0x7f77b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f77b0066f30 0x7f77b00693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f77b4001200 tx=0x7f77b40014c0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c40ca4d0 msgr2=0x7f77c41450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c40ca4d0 0x7f77c41450d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f77c4071a30 tx=0x7f77bc00b040 comp rx=0 tx=0).stop 2023-10-06T03:17:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 shutdown_connections 2023-10-06T03:17:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c40ca4d0 0x7f77c41450d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77ac004810 0x7f77c4149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f77b0066f30 0x7f77b00693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 --2- 172.21.15.82:0/2631830754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77c413ed40 0x7f77c40c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 >> 172.21.15.82:0/2631830754 conn(0x7f77c40c95d0 msgr2=0x7f77c40cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 shutdown_connections 2023-10-06T03:17:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.510+0000 7f77c96d7700 1 -- 172.21.15.82:0/2631830754 wait complete. 2023-10-06T03:17:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:17:23.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:17:23.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.640+0000 7f60fc1a9700 1 Processor -- start 2023-10-06T03:17:23.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.640+0000 7f60fc1a9700 1 -- start start 2023-10-06T03:17:23.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60fc1a9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60f4159500 0x7f60f41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60fc1a9700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60f40b3fd0 0x7f60f415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60fc1a9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f415dd20 con 0x7f60f415d8e0 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60fc1a9700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f40b1110 con 0x7f60f4159500 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60fc1a9700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f40b13b0 con 0x7f60f40b3fd0 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60f9f45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60f4159500 0x7f60f41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60f9f45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60f4159500 0x7f60f41598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54088/0 (socket says 172.21.15.82:54088) 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60f9f45700 1 -- 172.21.15.82:0/1506824965 learned_addr learned my addr 172.21.15.82:0/1506824965 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.641+0000 7f60f9744700 1 --2- 172.21.15.82:0/1506824965 >> v2:172.21.15.134:3300/0 conn(0x7f60f40b3fd0 0x7f60f415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f9f45700 1 -- 172.21.15.82:0/1506824965 >> v2:172.21.15.134:3300/0 conn(0x7f60f40b3fd0 msgr2=0x7f60f415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f9f45700 1 --2- 172.21.15.82:0/1506824965 >> v2:172.21.15.134:3300/0 conn(0x7f60f40b3fd0 0x7f60f415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f9f45700 1 -- 172.21.15.82:0/1506824965 >> v1:172.21.15.134:6789/0 conn(0x7f60f415d8e0 legacy=0x7f60f40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f9f45700 1 -- 172.21.15.82:0/1506824965 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40b1690 con 0x7f60f4159500 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f9744700 1 --2- 172.21.15.82:0/1506824965 >> v2:172.21.15.134:3300/0 conn(0x7f60f40b3fd0 0x7f60f415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f9f45700 1 --2- 172.21.15.82:0/1506824965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f4159500 0x7f60f41598d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f60f4063430 tx=0x7f60f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3acc40bd8469b8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f8f43700 1 -- 172.21.15.82:0/1506824965 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000e070 con 0x7f60f4159500 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f8f43700 1 -- 172.21.15.82:0/1506824965 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000ba10 con 0x7f60f4159500 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60f8f43700 1 -- 172.21.15.82:0/1506824965 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00092e0 con 0x7f60f4159500 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60fc1a9700 1 -- 172.21.15.82:0/1506824965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f4159500 msgr2=0x7f60f41598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/1506824965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f4159500 0x7f60f41598d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f60f4063430 tx=0x7f60f0009840 comp rx=0 tx=0).stop 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60fc1a9700 1 -- 172.21.15.82:0/1506824965 shutdown_connections 2023-10-06T03:17:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/1506824965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f4159500 0x7f60f41598d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/1506824965 >> v2:172.21.15.134:3300/0 conn(0x7f60f40b3fd0 0x7f60f415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60fc1a9700 1 -- 172.21.15.82:0/1506824965 >> 172.21.15.82:0/1506824965 conn(0x7f60f4067630 msgr2=0x7f60f4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:23.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60fc1a9700 1 -- 172.21.15.82:0/1506824965 shutdown_connections 2023-10-06T03:17:23.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.642+0000 7f60fc1a9700 1 -- 172.21.15.82:0/1506824965 wait complete. 2023-10-06T03:17:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fc1a9700 1 Processor -- start 2023-10-06T03:17:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fc1a9700 1 -- start start 2023-10-06T03:17:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fc1a9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f40b3fd0 0x7f60f414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fc1a9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f4159500 0x7f60f41500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fc1a9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60f415d8e0 0x7f60f40b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fc1a9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f414d530 con 0x7f60f40b3fd0 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fc1a9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415a970 con 0x7f60f4159500 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fc1a9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4159d60 con 0x7f60f415d8e0 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60f9f45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f40b3fd0 0x7f60f414cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60f9f45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f40b3fd0 0x7f60f414cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54104/0 (socket says 172.21.15.82:54104) 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60f9f45700 1 -- 172.21.15.82:0/2989980269 learned_addr learned my addr 172.21.15.82:0/2989980269 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60f9744700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f4159500 0x7f60f41500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.644+0000 7f60fa746700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60f415d8e0 0x7f60f40b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60f9f45700 1 -- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60f415d8e0 msgr2=0x7f60f40b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60f9f45700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60f415d8e0 0x7f60f40b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60f9f45700 1 -- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f4159500 msgr2=0x7f60f41500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60f9f45700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f4159500 0x7f60f41500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60f9f45700 1 -- 172.21.15.82:0/2989980269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f0009ae0 con 0x7f60f40b3fd0 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60f9744700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f4159500 0x7f60f41500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60f9f45700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f40b3fd0 0x7f60f414cff0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f60f415deb0 tx=0x7f60f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60e9ffb700 1 -- 172.21.15.82:0/2989980269 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0012ac0 con 0x7f60f40b3fd0 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60e9ffb700 1 -- 172.21.15.82:0/2989980269 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0012c60 con 0x7f60f40b3fd0 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f415a040 con 0x7f60f40b3fd0 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60e9ffb700 1 -- 172.21.15.82:0/2989980269 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f001d420 con 0x7f60f40b3fd0 2023-10-06T03:17:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.645+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f415a600 con 0x7f60f40b3fd0 2023-10-06T03:17:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.646+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f4088400 con 0x7f60f40b3fd0 2023-10-06T03:17:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.647+0000 7f60e9ffb700 1 -- 172.21.15.82:0/2989980269 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60f001d7d0 con 0x7f60f40b3fd0 2023-10-06T03:17:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.647+0000 7f60e9ffb700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f60d8066f30 0x7f60d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.647+0000 7f60e9ffb700 1 -- 172.21.15.82:0/2989980269 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f60f0085b20 con 0x7f60f40b3fd0 2023-10-06T03:17:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.647+0000 7f60f9744700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f60d8066f30 0x7f60d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.648+0000 7f60f9744700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f60d8066f30 0x7f60d80693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f60f416d620 tx=0x7f60e4006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.651+0000 7f60e9ffb700 1 -- 172.21.15.82:0/2989980269 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60f0052f80 con 0x7f60f40b3fd0 2023-10-06T03:17:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.835+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f60f4064050 con 0x7f60f40b3fd0 2023-10-06T03:17:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.835+0000 7f60e9ffb700 1 -- 172.21.15.82:0/2989980269 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7f60f00565a0 con 0x7f60f40b3fd0 2023-10-06T03:17:23.837 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f60d8066f30 msgr2=0x7f60d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f60d8066f30 0x7f60d80693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f60f416d620 tx=0x7f60e4006f90 comp rx=0 tx=0).stop 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f40b3fd0 msgr2=0x7f60f414cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f40b3fd0 0x7f60f414cff0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f60f415deb0 tx=0x7f60f0017000 comp rx=0 tx=0).stop 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 shutdown_connections 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f60d8066f30 0x7f60d80693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60f415d8e0 0x7f60f40b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60f40b3fd0 0x7f60f414cff0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 --2- 172.21.15.82:0/2989980269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f4159500 0x7f60f41500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 >> 172.21.15.82:0/2989980269 conn(0x7f60f4067630 msgr2=0x7f60f415d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 shutdown_connections 2023-10-06T03:17:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.837+0000 7f60fc1a9700 1 -- 172.21.15.82:0/2989980269 wait complete. 2023-10-06T03:17:23.850 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:17:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.966+0000 7f4890cd8700 1 Processor -- start 2023-10-06T03:17:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.966+0000 7f4890cd8700 1 -- start start 2023-10-06T03:17:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.966+0000 7f4890cd8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c159500 0x7f488c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.966+0000 7f4890cd8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c0b1110 con 0x7f488c15dab0 2023-10-06T03:17:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.966+0000 7f4890cd8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c0b13b0 con 0x7f488c0b3fd0 2023-10-06T03:17:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.966+0000 7f4890cd8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0b1690 con 0x7f488c159500 2023-10-06T03:17:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f488ad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f488c15dab0 0x7f488c0cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44360/0 (socket says 172.21.15.82:44360) 2023-10-06T03:17:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f488ad9d700 1 -- 172.21.15.82:0/1021463758 learned_addr learned my addr 172.21.15.82:0/1021463758 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f488a59c700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c159500 0x7f488c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502812642 0 0) 0x7f488c0b1110 con 0x7f488c15dab0 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4878003570 con 0x7f488c15dab0 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559864375 0 0) 0x7f4878003570 con 0x7f488c15dab0 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c159500 msgr2=0x7f488c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c159500 0x7f488c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 >> v1:172.21.15.134:6789/0 conn(0x7f488c0b3fd0 legacy=0x7f488c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0b1970 con 0x7f488c15dab0 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f48840017f0 con 0x7f488c15dab0 2023-10-06T03:17:23.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 >> v1:172.21.15.82:6789/0 conn(0x7f488c15dab0 legacy=0x7f488c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878003a90 0x7f4878003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4878004810 0x7f4878004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c159500 0x7f48780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0b1690 con 0x7f4878004810 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487800bb10 con 0x7f4878003a90 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487800bcd0 con 0x7f488c159500 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f4881d9b700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4878004810 0x7f4878004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f488a59c700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878003a90 0x7f4878003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.967+0000 7f488ad9d700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c159500 0x7f48780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4881d9b700 1 -- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c159500 msgr2=0x7f48780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4881d9b700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c159500 0x7f48780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4881d9b700 1 -- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878003a90 msgr2=0x7f4878003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4881d9b700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878003a90 0x7f4878003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4881d9b700 1 -- 172.21.15.82:0/1021463758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878003570 con 0x7f4878004810 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4881d9b700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4878004810 0x7f4878004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4874001970 tx=0x7f4874007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc58215a2a99dff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400c5d0 con 0x7f4878004810 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487400c750 con 0x7f4878004810 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4889d9b700 1 -- 172.21.15.82:0/1021463758 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400cb10 con 0x7f4878004810 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4890cd8700 1 -- 172.21.15.82:0/1021463758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4878004810 msgr2=0x7f4878004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4890cd8700 1 --2- 172.21.15.82:0/1021463758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4878004810 0x7f4878004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4874001970 tx=0x7f4874007d10 comp rx=0 tx=0).stop 2023-10-06T03:17:23.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f488ad9d700 1 -- 172.21.15.82:0/1021463758 reap_dead start 2023-10-06T03:17:23.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4890cd8700 1 -- 172.21.15.82:0/1021463758 shutdown_connections 2023-10-06T03:17:23.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4890cd8700 1 -- 172.21.15.82:0/1021463758 >> 172.21.15.82:0/1021463758 conn(0x7f488c067630 msgr2=0x7f488c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:23.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4890cd8700 1 -- 172.21.15.82:0/1021463758 shutdown_connections 2023-10-06T03:17:23.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.968+0000 7f4890cd8700 1 -- 172.21.15.82:0/1021463758 wait complete. 2023-10-06T03:17:23.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4890cd8700 1 Processor -- start 2023-10-06T03:17:23.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4890cd8700 1 -- start start 2023-10-06T03:17:23.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4890cd8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878004810 0x7f488c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4890cd8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c154a80 0x7f488c15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4890cd8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c16ccf0 0x7f488c16d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4890cd8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c16d6d0 con 0x7f488c154a80 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4890cd8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0cd1a0 con 0x7f4878004810 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4890cd8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c15f370 con 0x7f488c16ccf0 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.970+0000 7f4881d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c154a80 0x7f488c15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4881d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c154a80 0x7f488c15ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54134/0 (socket says 172.21.15.82:54134) 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4881d9b700 1 -- 172.21.15.82:0/897833338 learned_addr learned my addr 172.21.15.82:0/897833338 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f488a59c700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878004810 0x7f488c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f488ad9d700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c16ccf0 0x7f488c16d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4881d9b700 1 -- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c16ccf0 msgr2=0x7f488c16d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4881d9b700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c16ccf0 0x7f488c16d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4881d9b700 1 -- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878004810 msgr2=0x7f488c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4881d9b700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878004810 0x7f488c0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4881d9b700 1 -- 172.21.15.82:0/897833338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c15f650 con 0x7f488c154a80 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f488ad9d700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c16ccf0 0x7f488c16d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4881d9b700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c154a80 0x7f488c15ea90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4874012ec0 tx=0x7f4874015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4882ffd700 1 -- 172.21.15.82:0/897833338 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400ce80 con 0x7f488c154a80 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4882ffd700 1 -- 172.21.15.82:0/897833338 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4874000f50 con 0x7f488c154a80 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4882ffd700 1 -- 172.21.15.82:0/897833338 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400cb10 con 0x7f488c154a80 2023-10-06T03:17:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c15f930 con 0x7f488c154a80 2023-10-06T03:17:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.971+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c15fef0 con 0x7f488c154a80 2023-10-06T03:17:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.972+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c160110 con 0x7f488c154a80 2023-10-06T03:17:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.972+0000 7f4882ffd700 1 -- 172.21.15.82:0/897833338 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4874019030 con 0x7f488c154a80 2023-10-06T03:17:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.973+0000 7f4882ffd700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f486c066f60 0x7f486c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.973+0000 7f4882ffd700 1 -- 172.21.15.82:0/897833338 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4874085a90 con 0x7f488c154a80 2023-10-06T03:17:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.973+0000 7f488a59c700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f486c066f60 0x7f486c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.974+0000 7f488a59c700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f486c066f60 0x7f486c069410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f487c006f00 tx=0x7f487c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:23.977+0000 7f4882ffd700 1 -- 172.21.15.82:0/897833338 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4874052ef0 con 0x7f488c154a80 2023-10-06T03:17:24.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.159+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f488c064050 con 0x7f488c154a80 2023-10-06T03:17:24.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.160+0000 7f4882ffd700 1 -- 172.21.15.82:0/897833338 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4874056510 con 0x7f488c154a80 2023-10-06T03:17:24.161 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f486c066f60 msgr2=0x7f486c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f486c066f60 0x7f486c069410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f487c006f00 tx=0x7f487c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c154a80 msgr2=0x7f488c15ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c154a80 0x7f488c15ea90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4874012ec0 tx=0x7f4874015000 comp rx=0 tx=0).stop 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 shutdown_connections 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f486c066f60 0x7f486c069410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f488c16ccf0 0x7f488c16d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878004810 0x7f488c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 --2- 172.21.15.82:0/897833338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f488c154a80 0x7f488c15ea90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 >> 172.21.15.82:0/897833338 conn(0x7f488c067630 msgr2=0x7f488c1570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:24.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 shutdown_connections 2023-10-06T03:17:24.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.162+0000 7f4890cd8700 1 -- 172.21.15.82:0/897833338 wait complete. 2023-10-06T03:17:24.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:17:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.289+0000 7f67050e0700 1 Processor -- start 2023-10-06T03:17:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.289+0000 7f67050e0700 1 -- start start 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f67050e0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f670015d850 0x7f67000b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f67050e0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 0x7f67000b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f67050e0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6700069f70 con 0x7f670015d480 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f67050e0700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67000687c0 con 0x7f670015d850 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f67050e0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6700068aa0 con 0x7f67000b6170 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f66fffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f670015d480 0x7f6700069860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44364/0 (socket says 172.21.15.82:44364) 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f66fffff700 1 -- 172.21.15.82:0/2150257450 learned_addr learned my addr 172.21.15.82:0/2150257450 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f67048df700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 0x7f67000b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841830690 0 0) 0x7f6700069f70 con 0x7f670015d480 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f66ff7fe700 1 --2- 172.21.15.82:0/2150257450 >> v2:172.21.15.134:3300/0 conn(0x7f670015d850 0x7f67000b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.290+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e8003570 con 0x7f670015d480 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1686376951 0 0) 0x7f66e8003570 con 0x7f670015d480 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 msgr2=0x7f67000b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 0x7f67000b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 >> v2:172.21.15.134:3300/0 conn(0x7f670015d850 msgr2=0x7f67000b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 --2- 172.21.15.82:0/2150257450 >> v2:172.21.15.134:3300/0 conn(0x7f670015d850 0x7f67000b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700068d80 con 0x7f670015d480 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f66f0001470 con 0x7f670015d480 2023-10-06T03:17:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 >> v1:172.21.15.82:6789/0 conn(0x7f670015d480 legacy=0x7f6700069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66e8003a60 0x7f66e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8004810 0x7f66e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 0x7f66e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67000687c0 con 0x7f66e8003a60 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6700068aa0 con 0x7f66e8004810 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e800ba60 con 0x7f67000b6170 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66fffff700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66e8003a60 0x7f66e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66ff7fe700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8004810 0x7f66e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f67048df700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 0x7f66e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66fffff700 1 -- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 msgr2=0x7f66e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66fffff700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 0x7f66e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66fffff700 1 -- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8004810 msgr2=0x7f66e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66fffff700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8004810 0x7f66e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66fffff700 1 -- 172.21.15.82:0/2150257450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8003570 con 0x7f66e8003a60 2023-10-06T03:17:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f67048df700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000b6170 0x7f66e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66ff7fe700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8004810 0x7f66e8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66fffff700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66e8003a60 0x7f66e8003e70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c3f0 tx=0x7f66f0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbbed2082af09f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000cc80 con 0x7f66e8003a60 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000ce00 con 0x7f66e8003a60 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.291+0000 7f66feffd700 1 -- 172.21.15.82:0/2150257450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0005b70 con 0x7f66e8003a60 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.292+0000 7f67050e0700 1 -- 172.21.15.82:0/2150257450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66e8003a60 msgr2=0x7f66e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.292+0000 7f67050e0700 1 --2- 172.21.15.82:0/2150257450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66e8003a60 0x7f66e8003e70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c3f0 tx=0x7f66f0001e90 comp rx=0 tx=0).stop 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.292+0000 7f67048df700 1 -- 172.21.15.82:0/2150257450 reap_dead start 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.292+0000 7f67050e0700 1 -- 172.21.15.82:0/2150257450 shutdown_connections 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.292+0000 7f67050e0700 1 -- 172.21.15.82:0/2150257450 >> 172.21.15.82:0/2150257450 conn(0x7f67000ccf80 msgr2=0x7f67000cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.292+0000 7f67050e0700 1 -- 172.21.15.82:0/2150257450 shutdown_connections 2023-10-06T03:17:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.292+0000 7f67050e0700 1 -- 172.21.15.82:0/2150257450 wait complete. 2023-10-06T03:17:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.293+0000 7f67050e0700 1 Processor -- start 2023-10-06T03:17:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.293+0000 7f67050e0700 1 -- start start 2023-10-06T03:17:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67050e0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8003a60 0x7f67000ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67050e0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000cab50 0x7f67000c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67050e0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67000c7820 0x7f67000c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67050e0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67000c7d00 con 0x7f67000c7820 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67050e0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67000c7fe0 con 0x7f66e8003a60 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67050e0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67000c82c0 con 0x7f67000cab50 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67000c7820 0x7f67000c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67000c7820 0x7f67000c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54156/0 (socket says 172.21.15.82:54156) 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 -- 172.21.15.82:0/3765542427 learned_addr learned my addr 172.21.15.82:0/3765542427 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f66ff7fe700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000cab50 0x7f67000c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f66fffff700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8003a60 0x7f67000ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 -- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000cab50 msgr2=0x7f67000c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000cab50 0x7f67000c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 -- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8003a60 msgr2=0x7f67000ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8003a60 0x7f67000ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 -- 172.21.15.82:0/3765542427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67000c85a0 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.294+0000 7f67048df700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67000c7820 0x7f67000c57f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f67000b2300 tx=0x7f66f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.295+0000 7f66e7fff700 1 -- 172.21.15.82:0/3765542427 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f801b070 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.295+0000 7f66e7fff700 1 -- 172.21.15.82:0/3765542427 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f800f040 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.295+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67000c8880 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.295+0000 7f66e7fff700 1 -- 172.21.15.82:0/3765542427 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800e050 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.295+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67000c8fe0 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.295+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670004c3c0 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.296+0000 7f66e7fff700 1 -- 172.21.15.82:0/3765542427 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66f8003020 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.296+0000 7f66e7fff700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f66ec066f30 0x7f66ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.296+0000 7f66e7fff700 1 -- 172.21.15.82:0/3765542427 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f66f8084890 con 0x7f67000c7820 2023-10-06T03:17:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.296+0000 7f66fffff700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f66ec066f30 0x7f66ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.297+0000 7f66fffff700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f66ec066f30 0x7f66ec0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c390 tx=0x7f66f0015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:24.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.300+0000 7f66e7fff700 1 -- 172.21.15.82:0/3765542427 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66f8051cf0 con 0x7f67000c7820 2023-10-06T03:17:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.485+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6700069060 con 0x7f67000c7820 2023-10-06T03:17:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.486+0000 7f66e7fff700 1 -- 172.21.15.82:0/3765542427 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+126 (secure 0 0 0) 0x7f66f8010ea0 con 0x7f67000c7820 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-10-06T03:17:24.488 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-10-06T03:17:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f66ec066f30 msgr2=0x7f66ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f66ec066f30 0x7f66ec0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c390 tx=0x7f66f0015000 comp rx=0 tx=0).stop 2023-10-06T03:17:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67000c7820 msgr2=0x7f67000c57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67000c7820 0x7f67000c57f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f67000b2300 tx=0x7f66f800b040 comp rx=0 tx=0).stop 2023-10-06T03:17:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 shutdown_connections 2023-10-06T03:17:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67000c7820 0x7f67000c57f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66e8003a60 0x7f67000ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f66ec066f30 0x7f66ec0693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 --2- 172.21.15.82:0/3765542427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67000cab50 0x7f67000c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 >> 172.21.15.82:0/3765542427 conn(0x7f67000ccf80 msgr2=0x7f6700141e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:24.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 shutdown_connections 2023-10-06T03:17:24.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.488+0000 7f67050e0700 1 -- 172.21.15.82:0/3765542427 wait complete. 2023-10-06T03:17:24.502 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:17:24.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:17:24.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.620+0000 7fdf73365700 1 Processor -- start 2023-10-06T03:17:24.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.620+0000 7fdf73365700 1 -- start start 2023-10-06T03:17:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf73365700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0b55b0 0x7fdf6c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf73365700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf6c0cf800 0x7fdf6c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf73365700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf6c0d0f00 0x7fdf6c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf73365700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c159d40 con 0x7fdf6c0d0f00 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf73365700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c0cbed0 con 0x7fdf6c0cf800 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf73365700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0cc750 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf6c0d0f00 0x7fdf6c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf6c0d0f00 0x7fdf6c0ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54162/0 (socket says 172.21.15.82:54162) 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 -- 172.21.15.82:0/3185834776 learned_addr learned my addr 172.21.15.82:0/3185834776 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf70900700 1 --2- 172.21.15.82:0/3185834776 >> v2:172.21.15.134:3300/0 conn(0x7fdf6c0cf800 0x7fdf6c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71101700 1 --2- 172.21.15.82:0/3185834776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0b55b0 0x7fdf6c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 -- 172.21.15.82:0/3185834776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0b55b0 msgr2=0x7fdf6c0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 --2- 172.21.15.82:0/3185834776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0b55b0 0x7fdf6c0ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 -- 172.21.15.82:0/3185834776 >> v2:172.21.15.134:3300/0 conn(0x7fdf6c0cf800 msgr2=0x7fdf6c0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 --2- 172.21.15.82:0/3185834776 >> v2:172.21.15.134:3300/0 conn(0x7fdf6c0cf800 0x7fdf6c0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 -- 172.21.15.82:0/3185834776 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c0b5ec0 con 0x7fdf6c0d0f00 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf70900700 1 --2- 172.21.15.82:0/3185834776 >> v2:172.21.15.134:3300/0 conn(0x7fdf6c0cf800 0x7fdf6c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.621+0000 7fdf71902700 1 --2- 172.21.15.82:0/3185834776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0d0f00 0x7fdf6c0ce270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c088f10 tx=0x7fdf5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162f29e68c136889 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf6bfff700 1 -- 172.21.15.82:0/3185834776 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00b820 con 0x7fdf6c0d0f00 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf6bfff700 1 -- 172.21.15.82:0/3185834776 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c00b980 con 0x7fdf6c0d0f00 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf6bfff700 1 -- 172.21.15.82:0/3185834776 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00bd40 con 0x7fdf6c0d0f00 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 -- 172.21.15.82:0/3185834776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0d0f00 msgr2=0x7fdf6c0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 --2- 172.21.15.82:0/3185834776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0d0f00 0x7fdf6c0ce270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c088f10 tx=0x7fdf5c009250 comp rx=0 tx=0).stop 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 -- 172.21.15.82:0/3185834776 shutdown_connections 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 --2- 172.21.15.82:0/3185834776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0d0f00 0x7fdf6c0ce270 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 --2- 172.21.15.82:0/3185834776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0b55b0 0x7fdf6c0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 --2- 172.21.15.82:0/3185834776 >> v2:172.21.15.134:3300/0 conn(0x7fdf6c0cf800 0x7fdf6c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 -- 172.21.15.82:0/3185834776 >> 172.21.15.82:0/3185834776 conn(0x7fdf6c08a050 msgr2=0x7fdf6c099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 -- 172.21.15.82:0/3185834776 shutdown_connections 2023-10-06T03:17:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.622+0000 7fdf73365700 1 -- 172.21.15.82:0/3185834776 wait complete. 2023-10-06T03:17:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.623+0000 7fdf73365700 1 Processor -- start 2023-10-06T03:17:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.623+0000 7fdf73365700 1 -- start start 2023-10-06T03:17:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf73365700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0b55b0 0x7fdf6c0b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf73365700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0cf800 0x7fdf6c09dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf73365700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6c0d0f00 0x7fdf6c157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf73365700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c067ff0 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf73365700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c157a90 con 0x7fdf6c0d0f00 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf73365700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c068b10 con 0x7fdf6c0cf800 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf71101700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0b55b0 0x7fdf6c0b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf71101700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0b55b0 0x7fdf6c0b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54168/0 (socket says 172.21.15.82:54168) 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf71101700 1 -- 172.21.15.82:0/145949371 learned_addr learned my addr 172.21.15.82:0/145949371 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf71902700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6c0d0f00 0x7fdf6c157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.624+0000 7fdf70900700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0cf800 0x7fdf6c09dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf71101700 1 -- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0cf800 msgr2=0x7fdf6c09dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf71101700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0cf800 0x7fdf6c09dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf71101700 1 -- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6c0d0f00 msgr2=0x7fdf6c157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf71101700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6c0d0f00 0x7fdf6c157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf71101700 1 -- 172.21.15.82:0/145949371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0094f0 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf70900700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0cf800 0x7fdf6c09dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf71101700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0b55b0 0x7fdf6c0b1dd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009fd0 tx=0x7fdf64009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf697fa700 1 -- 172.21.15.82:0/145949371 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400edd0 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf697fa700 1 -- 172.21.15.82:0/145949371 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf64014420 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c0681e0 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf697fa700 1 -- 172.21.15.82:0/145949371 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640147e0 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.625+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c0687a0 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.626+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c068df0 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.626+0000 7fdf697fa700 1 -- 172.21.15.82:0/145949371 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf64014b90 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.626+0000 7fdf697fa700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.627+0000 7fdf697fa700 1 -- 172.21.15.82:0/145949371 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdf64084bc0 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.627+0000 7fdf70900700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.627+0000 7fdf70900700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf58066f30 0x7fdf580693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0b5c80 tx=0x7fdf60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.631+0000 7fdf697fa700 1 -- 172.21.15.82:0/145949371 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf64052020 con 0x7fdf6c0b55b0 2023-10-06T03:17:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:24.813+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdf6c0717c0 con 0x7fdf6c0b55b0 2023-10-06T03:17:25.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.798+0000 7fdf697fa700 1 -- 172.21.15.82:0/145949371 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdf64009ab0 con 0x7fdf6c0b55b0 2023-10-06T03:17:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf58066f30 msgr2=0x7fdf580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf58066f30 0x7fdf580693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0b5c80 tx=0x7fdf60008040 comp rx=0 tx=0).stop 2023-10-06T03:17:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0b55b0 msgr2=0x7fdf6c0b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0b55b0 0x7fdf6c0b1dd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009fd0 tx=0x7fdf64009970 comp rx=0 tx=0).stop 2023-10-06T03:17:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 shutdown_connections 2023-10-06T03:17:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf6c0d0f00 0x7fdf6c157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf6c0b55b0 0x7fdf6c0b1dd0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 --2- 172.21.15.82:0/145949371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf6c0cf800 0x7fdf6c09dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.802+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 >> 172.21.15.82:0/145949371 conn(0x7fdf6c08a050 msgr2=0x7fdf6c159290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.803+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 shutdown_connections 2023-10-06T03:17:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.803+0000 7fdf73365700 1 -- 172.21.15.82:0/145949371 wait complete. 2023-10-06T03:17:25.805 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-10-06T03:17:25.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:17:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.939+0000 7ff3a719d700 1 Processor -- start 2023-10-06T03:17:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.939+0000 7ff3a719d700 1 -- start start 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff3a719d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3a00c4910 0x7ff3a00cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff3a719d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00cd720 con 0x7ff3a00c9260 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff3a719d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00c3470 con 0x7ff3a0151cb0 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff3a719d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a0152080 con 0x7ff3a00c4910 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff3a573a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3a00c4910 0x7ff3a00cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff397fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff3a00c9260 0x7ff3a00cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44380/0 (socket says 172.21.15.82:44380) 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff397fff700 1 -- 172.21.15.82:0/91933683 learned_addr learned my addr 172.21.15.82:0/91933683 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff3a573a700 1 -- 172.21.15.82:0/91933683 >> v1:172.21.15.134:6789/0 conn(0x7ff3a0151cb0 legacy=0x7ff3a00c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff3a573a700 1 -- 172.21.15.82:0/91933683 >> v1:172.21.15.82:6789/0 conn(0x7ff3a00c9260 legacy=0x7ff3a00cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a573a700 1 -- 172.21.15.82:0/91933683 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00cce80 con 0x7ff3a00c4910 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.940+0000 7ff3977fe700 1 -- 172.21.15.82:0/91933683 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450598799 0 0) 0x7ff3a00cd720 con 0x7ff3a00c9260 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a573a700 1 --2- 172.21.15.82:0/91933683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a00c4910 0x7ff3a00cc860 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff3980098e0 tx=0x7ff3980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6050e7e5be0f23e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3977fe700 1 -- 172.21.15.82:0/91933683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398009e80 con 0x7ff3a00c4910 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3977fe700 1 -- 172.21.15.82:0/91933683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800b820 con 0x7ff3a00c4910 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3977fe700 1 -- 172.21.15.82:0/91933683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800bba0 con 0x7ff3a00c4910 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a719d700 1 -- 172.21.15.82:0/91933683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a00c4910 msgr2=0x7ff3a00cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a719d700 1 --2- 172.21.15.82:0/91933683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a00c4910 0x7ff3a00cc860 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff3980098e0 tx=0x7ff3980091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a719d700 1 -- 172.21.15.82:0/91933683 shutdown_connections 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a719d700 1 --2- 172.21.15.82:0/91933683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a00c4910 0x7ff3a00cc860 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a719d700 1 -- 172.21.15.82:0/91933683 >> 172.21.15.82:0/91933683 conn(0x7ff3a00ce510 msgr2=0x7ff3a00ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a719d700 1 -- 172.21.15.82:0/91933683 shutdown_connections 2023-10-06T03:17:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.941+0000 7ff3a719d700 1 -- 172.21.15.82:0/91933683 wait complete. 2023-10-06T03:17:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.942+0000 7ff3a719d700 1 Processor -- start 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a719d700 1 -- start start 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a719d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3a00c4910 0x7ff3a0150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a719d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a00c9260 0x7ff3a015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a719d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a0151cb0 0x7ff3a015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a719d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a015ad90 con 0x7ff3a0151cb0 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a719d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0152840 con 0x7ff3a00c9260 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a719d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01553a0 con 0x7ff3a00c4910 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a573a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a0151cb0 0x7ff3a015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a573a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a0151cb0 0x7ff3a015bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54200/0 (socket says 172.21.15.82:54200) 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.943+0000 7ff3a573a700 1 -- 172.21.15.82:0/732124123 learned_addr learned my addr 172.21.15.82:0/732124123 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a4f39700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3a00c4910 0x7ff3a0150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff397fff700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a00c9260 0x7ff3a015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a573a700 1 -- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3a00c4910 msgr2=0x7ff3a0150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a573a700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3a00c4910 0x7ff3a0150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a573a700 1 -- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a00c9260 msgr2=0x7ff3a015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a573a700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a00c9260 0x7ff3a015b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a573a700 1 -- 172.21.15.82:0/732124123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398009420 con 0x7ff3a0151cb0 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a573a700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a0151cb0 0x7ff3a015bb80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0068470 tx=0x7ff398016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff394ff9700 1 -- 172.21.15.82:0/732124123 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39801c450 con 0x7ff3a0151cb0 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff394ff9700 1 -- 172.21.15.82:0/732124123 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398020070 con 0x7ff3a0151cb0 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a0159da0 con 0x7ff3a0151cb0 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff394ff9700 1 -- 172.21.15.82:0/732124123 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39801c820 con 0x7ff3a0151cb0 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.944+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a01521f0 con 0x7ff3a0151cb0 2023-10-06T03:17:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.945+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a01529f0 con 0x7ff3a0151cb0 2023-10-06T03:17:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.945+0000 7ff394ff9700 1 -- 172.21.15.82:0/732124123 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff398022030 con 0x7ff3a0151cb0 2023-10-06T03:17:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.946+0000 7ff394ff9700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff38c066f30 0x7ff38c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.946+0000 7ff394ff9700 1 -- 172.21.15.82:0/732124123 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5576+0+0 (secure 0 0 0) 0x7ff398086650 con 0x7ff3a0151cb0 2023-10-06T03:17:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.946+0000 7ff3a4f39700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff38c066f30 0x7ff38c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.946+0000 7ff3a4f39700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff38c066f30 0x7ff38c0693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff39c007f10 tx=0x7ff39c007400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:25.950+0000 7ff394ff9700 1 -- 172.21.15.82:0/732124123 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3a01529f0 con 0x7ff3a0151cb0 2023-10-06T03:17:26.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.132+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff3a01529f0 con 0x7ff3a0151cb0 2023-10-06T03:17:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.799+0000 7ff394ff9700 1 -- 172.21.15.82:0/732124123 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff3a01529f0 con 0x7ff3a0151cb0 2023-10-06T03:17:26.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff38c066f30 msgr2=0x7ff38c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:26.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff38c066f30 0x7ff38c0693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff39c007f10 tx=0x7ff39c007400 comp rx=0 tx=0).stop 2023-10-06T03:17:26.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a0151cb0 msgr2=0x7ff3a015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:26.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a0151cb0 0x7ff3a015bb80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0068470 tx=0x7ff398016000 comp rx=0 tx=0).stop 2023-10-06T03:17:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 shutdown_connections 2023-10-06T03:17:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a0151cb0 0x7ff3a015bb80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff38c066f30 0x7ff38c0693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3a00c4910 0x7ff3a0150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 --2- 172.21.15.82:0/732124123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a00c9260 0x7ff3a015b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.808+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 >> 172.21.15.82:0/732124123 conn(0x7ff3a00ce510 msgr2=0x7ff3a01510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:26.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.809+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 shutdown_connections 2023-10-06T03:17:26.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.809+0000 7ff3a719d700 1 -- 172.21.15.82:0/732124123 wait complete. 2023-10-06T03:17:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-10-06T03:17:26.829 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:17:26.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.946+0000 7f24ccc94700 1 Processor -- start 2023-10-06T03:17:26.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24ccc94700 1 -- start start 2023-10-06T03:17:26.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24ccc94700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f24c8142e90 0x7f24c8069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:26.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24ccc94700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:26.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24ccc94700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c8069380 con 0x7f24c8069d50 2023-10-06T03:17:26.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24ccc94700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c8068770 con 0x7f24c8142e90 2023-10-06T03:17:26.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24ccc94700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8068a50 con 0x7f24c815d9a0 2023-10-06T03:17:26.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24c77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f24c8142e90 0x7f24c8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:26.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24bffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f24c8069d50 0x7f24c815d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44382/0 (socket says 172.21.15.82:44382) 2023-10-06T03:17:26.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.947+0000 7f24bffff700 1 -- 172.21.15.82:0/1552332548 learned_addr learned my addr 172.21.15.82:0/1552332548 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c77fe700 1 -- 172.21.15.82:0/1552332548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 msgr2=0x7f24c80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c7fff700 1 --2- 172.21.15.82:0/1552332548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c77fe700 1 --2- 172.21.15.82:0/1552332548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c77fe700 1 -- 172.21.15.82:0/1552332548 >> v1:172.21.15.82:6789/0 conn(0x7f24c8069d50 legacy=0x7f24c815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c6ffd700 1 -- 172.21.15.82:0/1552332548 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635518997 0 0) 0x7f24c8069380 con 0x7f24c8069d50 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c77fe700 1 -- 172.21.15.82:0/1552332548 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8068d30 con 0x7f24c8142e90 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c77fe700 1 --2- 172.21.15.82:0/1552332548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c8069810 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f24b80098e0 tx=0x7f24b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781f7816538dfd77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c6ffd700 1 -- 172.21.15.82:0/1552332548 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8009e80 con 0x7f24c8142e90 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c6ffd700 1 -- 172.21.15.82:0/1552332548 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800b860 con 0x7f24c8142e90 2023-10-06T03:17:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.948+0000 7f24c6ffd700 1 -- 172.21.15.82:0/1552332548 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b800bbe0 con 0x7f24c8142e90 2023-10-06T03:17:26.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.949+0000 7f24ccc94700 1 -- 172.21.15.82:0/1552332548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 msgr2=0x7f24c8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:26.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.949+0000 7f24ccc94700 1 --2- 172.21.15.82:0/1552332548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c8069810 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f24b80098e0 tx=0x7f24b80091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.949+0000 7f24ccc94700 1 -- 172.21.15.82:0/1552332548 shutdown_connections 2023-10-06T03:17:26.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.949+0000 7f24ccc94700 1 --2- 172.21.15.82:0/1552332548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c8069810 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.949+0000 7f24ccc94700 1 --2- 172.21.15.82:0/1552332548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.949+0000 7f24ccc94700 1 -- 172.21.15.82:0/1552332548 >> 172.21.15.82:0/1552332548 conn(0x7f24c80ccfe0 msgr2=0x7f24c80cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:26.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.949+0000 7f24ccc94700 1 -- 172.21.15.82:0/1552332548 shutdown_connections 2023-10-06T03:17:26.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.949+0000 7f24ccc94700 1 -- 172.21.15.82:0/1552332548 wait complete. 2023-10-06T03:17:26.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.950+0000 7f24ccc94700 1 Processor -- start 2023-10-06T03:17:26.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.950+0000 7f24ccc94700 1 -- start start 2023-10-06T03:17:26.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.950+0000 7f24ccc94700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c8069d50 0x7f24c813f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:26.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.950+0000 7f24ccc94700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c815f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:26.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.950+0000 7f24ccc94700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:26.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.950+0000 7f24ccc94700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c813f550 con 0x7f24c8142e90 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.950+0000 7f24ccc94700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c816a400 con 0x7f24c8069d50 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.950+0000 7f24ccc94700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8159170 con 0x7f24c815d9a0 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c815f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54210/0 (socket says 172.21.15.82:54210) 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 -- 172.21.15.82:0/3332346913 learned_addr learned my addr 172.21.15.82:0/3332346913 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24c77fe700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c8069d50 0x7f24c813f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24c7fff700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 -- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 msgr2=0x7f24c80b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 -- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c8069d50 msgr2=0x7f24c813f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c8069d50 0x7f24c813f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 -- 172.21.15.82:0/3332346913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b8009420 con 0x7f24c8142e90 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24c7fff700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bffff700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c815f360 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f24b000c7e0 tx=0x7f24b0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bf7fe700 1 -- 172.21.15.82:0/3332346913 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0005c00 con 0x7f24c8142e90 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bf7fe700 1 -- 172.21.15.82:0/3332346913 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b0005d60 con 0x7f24c8142e90 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c815fe20 con 0x7f24c8142e90 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24bf7fe700 1 -- 172.21.15.82:0/3332346913 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b00072e0 con 0x7f24c8142e90 2023-10-06T03:17:26.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.951+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c8169db0 con 0x7f24c8142e90 2023-10-06T03:17:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.952+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c804c3c0 con 0x7f24c8142e90 2023-10-06T03:17:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.953+0000 7f24bf7fe700 1 -- 172.21.15.82:0/3332346913 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24b001b3b0 con 0x7f24c8142e90 2023-10-06T03:17:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.953+0000 7f24bf7fe700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f24a8066f30 0x7f24a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.953+0000 7f24bf7fe700 1 -- 172.21.15.82:0/3332346913 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f24b0083a20 con 0x7f24c8142e90 2023-10-06T03:17:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.953+0000 7f24c77fe700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f24a8066f30 0x7f24a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.954+0000 7f24c77fe700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f24a8066f30 0x7f24a80693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24b80091e0 tx=0x7f24b8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:26.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:26.957+0000 7f24bf7fe700 1 -- 172.21.15.82:0/3332346913 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24b004b5a0 con 0x7f24c8142e90 2023-10-06T03:17:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.185+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f24c816a540 con 0x7f24c8142e90 2023-10-06T03:17:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.822+0000 7f24bf7fe700 1 -- 172.21.15.82:0/3332346913 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7f24b0017020 con 0x7f24c8142e90 2023-10-06T03:17:27.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f24a8066f30 msgr2=0x7f24a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:27.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f24a8066f30 0x7f24a80693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24b80091e0 tx=0x7f24b8017000 comp rx=0 tx=0).stop 2023-10-06T03:17:27.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 msgr2=0x7f24c815f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:27.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c815f360 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f24b000c7e0 tx=0x7f24b0007d90 comp rx=0 tx=0).stop 2023-10-06T03:17:27.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 shutdown_connections 2023-10-06T03:17:27.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f24a8066f30 0x7f24a80693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24c815d9a0 0x7f24c80b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c8069d50 0x7f24c813f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 --2- 172.21.15.82:0/3332346913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24c8142e90 0x7f24c815f360 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 >> 172.21.15.82:0/3332346913 conn(0x7f24c80ccfe0 msgr2=0x7f24c80b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:27.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.830+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 shutdown_connections 2023-10-06T03:17:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.831+0000 7f24ccc94700 1 -- 172.21.15.82:0/3332346913 wait complete. 2023-10-06T03:17:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 9 and data pool 10 2023-10-06T03:17:27.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:27.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:17:27.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:17:27.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.963+0000 7f1b8cbda700 1 Processor -- start 2023-10-06T03:17:27.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.963+0000 7f1b8cbda700 1 -- start start 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.964+0000 7f1b8cbda700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b88153ff0 0x7f1b88068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.964+0000 7f1b8cbda700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88157650 0x7f1b88069410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.964+0000 7f1b8cbda700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880c93a0 con 0x7f1b88159ff0 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.964+0000 7f1b8cbda700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8806ee90 con 0x7f1b88153ff0 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.964+0000 7f1b8cbda700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b881571c0 con 0x7f1b88157650 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b8659c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b88153ff0 0x7f1b88068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b7dd9b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88157650 0x7f1b88069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b86d9d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1b88159ff0 0x7f1b880cb7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:43192/0 (socket says 172.21.15.82:43192) 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b86d9d700 1 -- 172.21.15.82:0/1523854717 learned_addr learned my addr 172.21.15.82:0/1523854717 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b85d9b700 1 -- 172.21.15.82:0/1523854717 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446244765 0 0) 0x7f1b880c93a0 con 0x7f1b88159ff0 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b85d9b700 1 -- 172.21.15.82:0/1523854717 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b74003570 con 0x7f1b88159ff0 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b8659c700 1 -- 172.21.15.82:0/1523854717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88157650 msgr2=0x7f1b88069410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b8659c700 1 --2- 172.21.15.82:0/1523854717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88157650 0x7f1b88069410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b8659c700 1 -- 172.21.15.82:0/1523854717 >> v1:172.21.15.134:6789/0 conn(0x7f1b88159ff0 legacy=0x7f1b880cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b8659c700 1 -- 172.21.15.82:0/1523854717 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8815ac00 con 0x7f1b88153ff0 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b7dd9b700 1 --2- 172.21.15.82:0/1523854717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88157650 0x7f1b88069410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b8659c700 1 --2- 172.21.15.82:0/1523854717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 0x7f1b88068ed0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b780098e0 tx=0x7f1b780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6dad6cf573215d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b85d9b700 1 -- 172.21.15.82:0/1523854717 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78011630 con 0x7f1b88153ff0 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b85d9b700 1 -- 172.21.15.82:0/1523854717 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b78011790 con 0x7f1b88153ff0 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.965+0000 7f1b85d9b700 1 -- 172.21.15.82:0/1523854717 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78011b30 con 0x7f1b88153ff0 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.966+0000 7f1b8cbda700 1 -- 172.21.15.82:0/1523854717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 msgr2=0x7f1b88068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.966+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/1523854717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 0x7f1b88068ed0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b780098e0 tx=0x7f1b780091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.966+0000 7f1b8cbda700 1 -- 172.21.15.82:0/1523854717 shutdown_connections 2023-10-06T03:17:27.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.966+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/1523854717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 0x7f1b88068ed0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.966+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/1523854717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88157650 0x7f1b88069410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.966+0000 7f1b8cbda700 1 -- 172.21.15.82:0/1523854717 >> 172.21.15.82:0/1523854717 conn(0x7f1b880c9fc0 msgr2=0x7f1b8806de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:27.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.966+0000 7f1b8cbda700 1 -- 172.21.15.82:0/1523854717 shutdown_connections 2023-10-06T03:17:27.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.966+0000 7f1b8cbda700 1 -- 172.21.15.82:0/1523854717 wait complete. 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.967+0000 7f1b8cbda700 1 Processor -- start 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.967+0000 7f1b8cbda700 1 -- start start 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b8cbda700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 0x7f1b88155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b8cbda700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b88157650 0x7f1b88150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b8cbda700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88159ff0 0x7f1b880c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b8cbda700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880b27c0 con 0x7f1b88157650 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b8cbda700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88154e90 con 0x7f1b88153ff0 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b8cbda700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b881505c0 con 0x7f1b88159ff0 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b7dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b88157650 0x7f1b88150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b7dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b88157650 0x7f1b88150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50850/0 (socket says 172.21.15.82:50850) 2023-10-06T03:17:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b7dd9b700 1 -- 172.21.15.82:0/2470444176 learned_addr learned my addr 172.21.15.82:0/2470444176 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b8659c700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 0x7f1b88155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b86d9d700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88159ff0 0x7f1b880c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b7dd9b700 1 -- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88159ff0 msgr2=0x7f1b880c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b7dd9b700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88159ff0 0x7f1b880c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b7dd9b700 1 -- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 msgr2=0x7f1b88155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b7dd9b700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 0x7f1b88155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.968+0000 7f1b7dd9b700 1 -- 172.21.15.82:0/2470444176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70009420 con 0x7f1b88157650 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.969+0000 7f1b7dd9b700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b88157650 0x7f1b88150080 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000ecb0 tx=0x7f1b700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.969+0000 7f1b7effd700 1 -- 172.21.15.82:0/2470444176 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000c920 con 0x7f1b88157650 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.969+0000 7f1b7effd700 1 -- 172.21.15.82:0/2470444176 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7000ca80 con 0x7f1b88157650 2023-10-06T03:17:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.969+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b78009420 con 0x7f1b88157650 2023-10-06T03:17:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.969+0000 7f1b7effd700 1 -- 172.21.15.82:0/2470444176 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000ce00 con 0x7f1b88157650 2023-10-06T03:17:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.969+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88154560 con 0x7f1b88157650 2023-10-06T03:17:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.970+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b88155040 con 0x7f1b88157650 2023-10-06T03:17:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.970+0000 7f1b7effd700 1 -- 172.21.15.82:0/2470444176 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b70013680 con 0x7f1b88157650 2023-10-06T03:17:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.970+0000 7f1b7effd700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1b68066f30 0x7f1b680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.970+0000 7f1b7effd700 1 -- 172.21.15.82:0/2470444176 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1b70084910 con 0x7f1b88157650 2023-10-06T03:17:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.971+0000 7f1b8659c700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1b68066f30 0x7f1b680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.971+0000 7f1b8659c700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1b68066f30 0x7f1b680693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1b780091e0 tx=0x7f1b78017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:27.974+0000 7f1b7effd700 1 -- 172.21.15.82:0/2470444176 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b88155040 con 0x7f1b88157650 2023-10-06T03:17:28.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.157+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b88155040 con 0x7f1b88157650 2023-10-06T03:17:28.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.158+0000 7f1b7effd700 1 -- 172.21.15.82:0/2470444176 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16881 (secure 0 0 0) 0x7f1b88155040 con 0x7f1b88157650 2023-10-06T03:17:28.160 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:28.160 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":54,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:27.187350+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:24.832103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:26.150387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1b68066f30 msgr2=0x7f1b680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1b68066f30 0x7f1b680693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1b780091e0 tx=0x7f1b78017000 comp rx=0 tx=0).stop 2023-10-06T03:17:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b88157650 msgr2=0x7f1b88150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b88157650 0x7f1b88150080 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000ecb0 tx=0x7f1b700091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 shutdown_connections 2023-10-06T03:17:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f1b68066f30 0x7f1b680693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b88159ff0 0x7f1b880c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b88153ff0 0x7f1b88155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 --2- 172.21.15.82:0/2470444176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b88157650 0x7f1b88150080 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 >> 172.21.15.82:0/2470444176 conn(0x7f1b880c9fc0 msgr2=0x7f1b88151e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 shutdown_connections 2023-10-06T03:17:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.160+0000 7f1b8cbda700 1 -- 172.21.15.82:0/2470444176 wait complete. 2023-10-06T03:17:28.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:28.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.326+0000 7f7db7634700 1 Processor -- start 2023-10-06T03:17:28.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.326+0000 7f7db7634700 1 -- start start 2023-10-06T03:17:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db7634700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7db0157570 0x7f7db00b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db7634700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db015b210 0x7f7db0158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db7634700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7db00add70 0x7f7db00ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db7634700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db01580d0 con 0x7f7db0157570 2023-10-06T03:17:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db7634700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db00ae6d0 con 0x7f7db00add70 2023-10-06T03:17:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db7634700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db015ba40 con 0x7f7db015b210 2023-10-06T03:17:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db53d0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7db0157570 0x7f7db00b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db53d0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7db0157570 0x7f7db00b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50866/0 (socket says 172.21.15.82:50866) 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db53d0700 1 -- 172.21.15.82:0/2588169987 learned_addr learned my addr 172.21.15.82:0/2588169987 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db5bd1700 1 --2- 172.21.15.82:0/2588169987 >> v2:172.21.15.134:3300/0 conn(0x7f7db00add70 0x7f7db00ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db4bcf700 1 --2- 172.21.15.82:0/2588169987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db015b210 0x7f7db0158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db53d0700 1 -- 172.21.15.82:0/2588169987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db015b210 msgr2=0x7f7db0158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db53d0700 1 --2- 172.21.15.82:0/2588169987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db015b210 0x7f7db0158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db53d0700 1 -- 172.21.15.82:0/2588169987 >> v2:172.21.15.134:3300/0 conn(0x7f7db00add70 msgr2=0x7f7db00ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db53d0700 1 --2- 172.21.15.82:0/2588169987 >> v2:172.21.15.134:3300/0 conn(0x7f7db00add70 0x7f7db00ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.327+0000 7f7db53d0700 1 -- 172.21.15.82:0/2588169987 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db015bd20 con 0x7f7db0157570 2023-10-06T03:17:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.328+0000 7f7db53d0700 1 --2- 172.21.15.82:0/2588169987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db0157570 0x7f7db00b4060 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7db00cbaa0 tx=0x7f7dac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948e33acb58edaef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.328+0000 7f7da7fff700 1 -- 172.21.15.82:0/2588169987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00b640 con 0x7f7db0157570 2023-10-06T03:17:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.328+0000 7f7da7fff700 1 -- 172.21.15.82:0/2588169987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00b7a0 con 0x7f7db0157570 2023-10-06T03:17:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.328+0000 7f7da7fff700 1 -- 172.21.15.82:0/2588169987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00bb60 con 0x7f7db0157570 2023-10-06T03:17:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 -- 172.21.15.82:0/2588169987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db0157570 msgr2=0x7f7db00b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 --2- 172.21.15.82:0/2588169987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db0157570 0x7f7db00b4060 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7db00cbaa0 tx=0x7f7dac009250 comp rx=0 tx=0).stop 2023-10-06T03:17:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 -- 172.21.15.82:0/2588169987 shutdown_connections 2023-10-06T03:17:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 --2- 172.21.15.82:0/2588169987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db0157570 0x7f7db00b4060 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 --2- 172.21.15.82:0/2588169987 >> v2:172.21.15.134:3300/0 conn(0x7f7db00add70 0x7f7db00ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 --2- 172.21.15.82:0/2588169987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db015b210 0x7f7db0158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 -- 172.21.15.82:0/2588169987 >> 172.21.15.82:0/2588169987 conn(0x7f7db0067630 msgr2=0x7f7db0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 -- 172.21.15.82:0/2588169987 shutdown_connections 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.329+0000 7f7db7634700 1 -- 172.21.15.82:0/2588169987 wait complete. 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.330+0000 7f7db7634700 1 Processor -- start 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.330+0000 7f7db7634700 1 -- start start 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db7634700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7db00add70 0x7f7db00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db7634700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db0157570 0x7f7db0155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db7634700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db015b210 0x7f7db00b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db7634700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c6a90 con 0x7f7db015b210 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db7634700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c54b0 con 0x7f7db00add70 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db7634700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c5790 con 0x7f7db0157570 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db015b210 0x7f7db00b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db015b210 0x7f7db00b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50880/0 (socket says 172.21.15.82:50880) 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 -- 172.21.15.82:0/1360243438 learned_addr learned my addr 172.21.15.82:0/1360243438 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db4bcf700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db0157570 0x7f7db0155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db53d0700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7db00add70 0x7f7db00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 -- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db0157570 msgr2=0x7f7db0155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db0157570 0x7f7db0155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 -- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7db00add70 msgr2=0x7f7db00c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7db00add70 0x7f7db00c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 -- 172.21.15.82:0/1360243438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0094f0 con 0x7f7db015b210 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db53d0700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7db00add70 0x7f7db00c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.331+0000 7f7db5bd1700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db015b210 0x7f7db00b38c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009e90 tx=0x7f7da800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.332+0000 7f7da57fa700 1 -- 172.21.15.82:0/1360243438 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da800cc20 con 0x7f7db015b210 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.332+0000 7f7da57fa700 1 -- 172.21.15.82:0/1360243438 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da800f040 con 0x7f7db015b210 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.332+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db00c5a70 con 0x7f7db015b210 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.332+0000 7f7da57fa700 1 -- 172.21.15.82:0/1360243438 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8014480 con 0x7f7db015b210 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.332+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db00c6030 con 0x7f7db015b210 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.333+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db00cd1b0 con 0x7f7db015b210 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.333+0000 7f7da57fa700 1 -- 172.21.15.82:0/1360243438 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7da8014830 con 0x7f7db015b210 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.333+0000 7f7da57fa700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d94066f30 0x7f7d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.333+0000 7f7da57fa700 1 -- 172.21.15.82:0/1360243438 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7da8085380 con 0x7f7db015b210 2023-10-06T03:17:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.334+0000 7f7db53d0700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d94066f30 0x7f7d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.334+0000 7f7db53d0700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d94066f30 0x7f7d940693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7db00cbaa0 tx=0x7f7dac017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.338+0000 7f7da57fa700 1 -- 172.21.15.82:0/1360243438 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7da8055f20 con 0x7f7db015b210 2023-10-06T03:17:28.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.520+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7db00cd940 con 0x7f7db015b210 2023-10-06T03:17:28.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.521+0000 7f7da57fa700 1 -- 172.21.15.82:0/1360243438 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16881 (secure 0 0 0) 0x7f7da8055ab0 con 0x7f7db015b210 2023-10-06T03:17:28.523 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":54,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:27.187350+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:24.832103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:26.150387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d94066f30 msgr2=0x7f7d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d94066f30 0x7f7d940693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7db00cbaa0 tx=0x7f7dac017000 comp rx=0 tx=0).stop 2023-10-06T03:17:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db015b210 msgr2=0x7f7db00b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db015b210 0x7f7db00b38c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009e90 tx=0x7f7da800b040 comp rx=0 tx=0).stop 2023-10-06T03:17:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 shutdown_connections 2023-10-06T03:17:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7db015b210 0x7f7db00b38c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7db00add70 0x7f7db00c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7d94066f30 0x7f7d940693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 --2- 172.21.15.82:0/1360243438 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7db0157570 0x7f7db0155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 >> 172.21.15.82:0/1360243438 conn(0x7f7db0067630 msgr2=0x7f7db006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 shutdown_connections 2023-10-06T03:17:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.523+0000 7f7db7634700 1 -- 172.21.15.82:0/1360243438 wait complete. 2023-10-06T03:17:28.537 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:17:28.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.652+0000 7f4c560f0700 1 Processor -- start 2023-10-06T03:17:28.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.652+0000 7f4c560f0700 1 -- start start 2023-10-06T03:17:28.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c560f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c50159500 0x7f4c501598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c560f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500b1110 con 0x7f4c500b3fd0 2023-10-06T03:17:28.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c560f0700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500b13b0 con 0x7f4c5015dab0 2023-10-06T03:17:28.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c560f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500b1690 con 0x7f4c50159500 2023-10-06T03:17:28.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c4f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c50159500 0x7f4c501598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c4effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4c500b3fd0 0x7f4c5015d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34640/0 (socket says 172.21.15.82:34640) 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c4effd700 1 -- 172.21.15.82:0/569253425 learned_addr learned my addr 172.21.15.82:0/569253425 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c4f7fe700 1 -- 172.21.15.82:0/569253425 >> v1:172.21.15.134:6789/0 conn(0x7f4c5015dab0 legacy=0x7f4c500cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c4f7fe700 1 -- 172.21.15.82:0/569253425 >> v1:172.21.15.82:6789/0 conn(0x7f4c500b3fd0 legacy=0x7f4c5015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c4f7fe700 1 -- 172.21.15.82:0/569253425 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500b1970 con 0x7f4c50159500 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.653+0000 7f4c4e7fc700 1 -- 172.21.15.82:0/569253425 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416343232 0 0) 0x7f4c500b1110 con 0x7f4c500b3fd0 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c4f7fe700 1 --2- 172.21.15.82:0/569253425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50159500 0x7f4c501598d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098e0 tx=0x7f4c400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df84b92d872c3f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c4e7fc700 1 -- 172.21.15.82:0/569253425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40009e80 con 0x7f4c50159500 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c4e7fc700 1 -- 172.21.15.82:0/569253425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000b860 con 0x7f4c50159500 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c4e7fc700 1 -- 172.21.15.82:0/569253425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000bbe0 con 0x7f4c50159500 2023-10-06T03:17:28.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c560f0700 1 -- 172.21.15.82:0/569253425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50159500 msgr2=0x7f4c501598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c560f0700 1 --2- 172.21.15.82:0/569253425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50159500 0x7f4c501598d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098e0 tx=0x7f4c400091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c560f0700 1 -- 172.21.15.82:0/569253425 shutdown_connections 2023-10-06T03:17:28.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c560f0700 1 --2- 172.21.15.82:0/569253425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c50159500 0x7f4c501598d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c560f0700 1 -- 172.21.15.82:0/569253425 >> 172.21.15.82:0/569253425 conn(0x7f4c50067630 msgr2=0x7f4c50069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:28.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c560f0700 1 -- 172.21.15.82:0/569253425 shutdown_connections 2023-10-06T03:17:28.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.654+0000 7f4c560f0700 1 -- 172.21.15.82:0/569253425 wait complete. 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c560f0700 1 Processor -- start 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c560f0700 1 -- start start 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c560f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c500b3fd0 0x7f4c5013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c560f0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50159500 0x7f4c5014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c560f0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c5015dab0 0x7f4c5014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c560f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5015d1c0 con 0x7f4c500b3fd0 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c560f0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5015c5b0 con 0x7f4c50159500 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c560f0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5015c890 con 0x7f4c5015dab0 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c4f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c500b3fd0 0x7f4c5013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c4f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c500b3fd0 0x7f4c5013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50900/0 (socket says 172.21.15.82:50900) 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.656+0000 7f4c4f7fe700 1 -- 172.21.15.82:0/2879636460 learned_addr learned my addr 172.21.15.82:0/2879636460 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4effd700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50159500 0x7f4c5014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4ffff700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c5015dab0 0x7f4c5014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4f7fe700 1 -- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c5015dab0 msgr2=0x7f4c5014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4f7fe700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c5015dab0 0x7f4c5014f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4f7fe700 1 -- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50159500 msgr2=0x7f4c5014f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4f7fe700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50159500 0x7f4c5014f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4f7fe700 1 -- 172.21.15.82:0/2879636460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40009420 con 0x7f4c500b3fd0 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4ffff700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c5015dab0 0x7f4c5014f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c4f7fe700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c500b3fd0 0x7f4c5013ac10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4c50088d00 tx=0x7f4c40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:28.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c377fe700 1 -- 172.21.15.82:0/2879636460 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000bbe0 con 0x7f4c500b3fd0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c377fe700 1 -- 172.21.15.82:0/2879636460 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40011420 con 0x7f4c500b3fd0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5015cb70 con 0x7f4c500b3fd0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c377fe700 1 -- 172.21.15.82:0/2879636460 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400117e0 con 0x7f4c500b3fd0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.657+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5015d650 con 0x7f4c500b3fd0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.658+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c50064050 con 0x7f4c500b3fd0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.658+0000 7f4c377fe700 1 -- 172.21.15.82:0/2879636460 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c40011bd0 con 0x7f4c500b3fd0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.659+0000 7f4c377fe700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c3c066f30 0x7f4c3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.659+0000 7f4c377fe700 1 -- 172.21.15.82:0/2879636460 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4c400861b0 con 0x7f4c500b3fd0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.659+0000 7f4c4effd700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c3c066f30 0x7f4c3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:28.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.659+0000 7f4c4effd700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c3c066f30 0x7f4c3c0693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c50151750 tx=0x7f4c44007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:28.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.663+0000 7f4c377fe700 1 -- 172.21.15.82:0/2879636460 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c400532c0 con 0x7f4c500b3fd0 2023-10-06T03:17:28.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:28.892+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4c5015d4a0 con 0x7f4c500b3fd0 2023-10-06T03:17:29.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.826+0000 7f4c377fe700 1 -- 172.21.15.82:0/2879636460 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c400568e0 con 0x7f4c500b3fd0 2023-10-06T03:17:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c3c066f30 msgr2=0x7f4c3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c3c066f30 0x7f4c3c0693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c50151750 tx=0x7f4c44007d10 comp rx=0 tx=0).stop 2023-10-06T03:17:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c500b3fd0 msgr2=0x7f4c5013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c500b3fd0 0x7f4c5013ac10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4c50088d00 tx=0x7f4c40017000 comp rx=0 tx=0).stop 2023-10-06T03:17:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 shutdown_connections 2023-10-06T03:17:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c3c066f30 0x7f4c3c0693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c5015dab0 0x7f4c5014f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c500b3fd0 0x7f4c5013ac10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 --2- 172.21.15.82:0/2879636460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50159500 0x7f4c5014f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 >> 172.21.15.82:0/2879636460 conn(0x7f4c50067630 msgr2=0x7f4c5014d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 shutdown_connections 2023-10-06T03:17:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.828+0000 7f4c560f0700 1 -- 172.21.15.82:0/2879636460 wait complete. 2023-10-06T03:17:29.844 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:17:29.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.962+0000 7f2c1e94f700 1 Processor -- start 2023-10-06T03:17:29.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.962+0000 7f2c1e94f700 1 -- start start 2023-10-06T03:17:29.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c1e94f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2c181598d0 0x7f2c1815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:29.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c1e94f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1815dd20 con 0x7f2c18159500 2023-10-06T03:17:29.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c1e94f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c180b1110 con 0x7f2c1815d8e0 2023-10-06T03:17:29.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c1e94f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c180b13b0 con 0x7f2c181598d0 2023-10-06T03:17:29.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c17fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2c18159500 0x7f2c180b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34650/0 (socket says 172.21.15.82:34650) 2023-10-06T03:17:29.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c17fff700 1 -- 172.21.15.82:0/820572096 learned_addr learned my addr 172.21.15.82:0/820572096 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c177fe700 1 --2- 172.21.15.82:0/820572096 >> v2:172.21.15.134:3300/0 conn(0x7f2c181598d0 0x7f2c1815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c16ffd700 1 -- 172.21.15.82:0/820572096 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219600335 0 0) 0x7f2c1815dd20 con 0x7f2c18159500 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c16ffd700 1 -- 172.21.15.82:0/820572096 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c00003570 con 0x7f2c18159500 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c16ffd700 1 -- 172.21.15.82:0/820572096 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3351160602 0 0) 0x7f2c00003570 con 0x7f2c18159500 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c177fe700 1 -- 172.21.15.82:0/820572096 >> v1:172.21.15.134:6789/0 conn(0x7f2c1815d8e0 legacy=0x7f2c180cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c177fe700 1 -- 172.21.15.82:0/820572096 >> v1:172.21.15.82:6789/0 conn(0x7f2c18159500 legacy=0x7f2c180b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.963+0000 7f2c177fe700 1 -- 172.21.15.82:0/820572096 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180b1690 con 0x7f2c181598d0 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c177fe700 1 --2- 172.21.15.82:0/820572096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c181598d0 0x7f2c1815d3a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0098e0 tx=0x7f2c0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51b5a53f9215f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c16ffd700 1 -- 172.21.15.82:0/820572096 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08001470 con 0x7f2c181598d0 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c16ffd700 1 -- 172.21.15.82:0/820572096 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c011420 con 0x7f2c181598d0 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c16ffd700 1 -- 172.21.15.82:0/820572096 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0117c0 con 0x7f2c181598d0 2023-10-06T03:17:29.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c1e94f700 1 -- 172.21.15.82:0/820572096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c181598d0 msgr2=0x7f2c1815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:29.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c1e94f700 1 --2- 172.21.15.82:0/820572096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c181598d0 0x7f2c1815d3a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0098e0 tx=0x7f2c0c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:29.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c1e94f700 1 -- 172.21.15.82:0/820572096 shutdown_connections 2023-10-06T03:17:29.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c1e94f700 1 --2- 172.21.15.82:0/820572096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c181598d0 0x7f2c1815d3a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:29.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c1e94f700 1 -- 172.21.15.82:0/820572096 >> 172.21.15.82:0/820572096 conn(0x7f2c18067630 msgr2=0x7f2c18069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:29.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c1e94f700 1 -- 172.21.15.82:0/820572096 shutdown_connections 2023-10-06T03:17:29.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.964+0000 7f2c1e94f700 1 -- 172.21.15.82:0/820572096 wait complete. 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.965+0000 7f2c1e94f700 1 Processor -- start 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.965+0000 7f2c1e94f700 1 -- start start 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c1e94f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c18159500 0x7f2c180b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c1e94f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c181598d0 0x7f2c18153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c1e94f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2c1815d8e0 0x7f2c18150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c1e94f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1814b660 con 0x7f2c181598d0 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c1e94f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18152e80 con 0x7f2c18159500 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c1e94f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18152270 con 0x7f2c1815d8e0 2023-10-06T03:17:29.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c181598d0 0x7f2c18153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c181598d0 0x7f2c18153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50908/0 (socket says 172.21.15.82:50908) 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c177fe700 1 -- 172.21.15.82:0/867281093 learned_addr learned my addr 172.21.15.82:0/867281093 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c17fff700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c18159500 0x7f2c180b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.966+0000 7f2c1ceec700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2c1815d8e0 0x7f2c18150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c177fe700 1 -- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2c1815d8e0 msgr2=0x7f2c18150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c177fe700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2c1815d8e0 0x7f2c18150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c177fe700 1 -- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c18159500 msgr2=0x7f2c180b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c177fe700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c18159500 0x7f2c180b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c177fe700 1 -- 172.21.15.82:0/867281093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c009420 con 0x7f2c181598d0 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c17fff700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c18159500 0x7f2c180b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c177fe700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c181598d0 0x7f2c18153ff0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0030c0 tx=0x7f2c0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:29.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2bfffff700 1 -- 172.21.15.82:0/867281093 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c010c20 con 0x7f2c181598d0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2bfffff700 1 -- 172.21.15.82:0/867281093 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c010da0 con 0x7f2c181598d0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c18152550 con 0x7f2c181598d0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2bfffff700 1 -- 172.21.15.82:0/867281093 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c01d680 con 0x7f2c181598d0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.967+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c18152b10 con 0x7f2c181598d0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.968+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c18064050 con 0x7f2c181598d0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.968+0000 7f2bfffff700 1 -- 172.21.15.82:0/867281093 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c0c01d9f0 con 0x7f2c181598d0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.968+0000 7f2bfffff700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2c04066f30 0x7f2c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.969+0000 7f2bfffff700 1 -- 172.21.15.82:0/867281093 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2c0c086520 con 0x7f2c181598d0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.969+0000 7f2c17fff700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2c04066f30 0x7f2c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:29.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.969+0000 7f2c17fff700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2c04066f30 0x7f2c040693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2c080015a0 tx=0x7f2c08000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:29.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:29.973+0000 7f2bfffff700 1 -- 172.21.15.82:0/867281093 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c0c053630 con 0x7f2c181598d0 2023-10-06T03:17:30.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.201+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2c18152fc0 con 0x7f2c181598d0 2023-10-06T03:17:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.827+0000 7f2bfffff700 1 -- 172.21.15.82:0/867281093 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2c0c006cb0 con 0x7f2c181598d0 2023-10-06T03:17:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2c04066f30 msgr2=0x7f2c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2c04066f30 0x7f2c040693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2c080015a0 tx=0x7f2c08000bc0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c181598d0 msgr2=0x7f2c18153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c181598d0 0x7f2c18153ff0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0030c0 tx=0x7f2c0c017000 comp rx=0 tx=0).stop 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 shutdown_connections 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2c04066f30 0x7f2c040693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2c1815d8e0 0x7f2c18150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c18159500 0x7f2c180b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 --2- 172.21.15.82:0/867281093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c181598d0 0x7f2c18153ff0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 >> 172.21.15.82:0/867281093 conn(0x7f2c18067630 msgr2=0x7f2c18069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 shutdown_connections 2023-10-06T03:17:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.829+0000 7f2c1e94f700 1 -- 172.21.15.82:0/867281093 wait complete. 2023-10-06T03:17:30.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:30.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.955+0000 7fb97114b700 1 Processor -- start 2023-10-06T03:17:30.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.955+0000 7fb97114b700 1 -- start start 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb97114b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb96c15d560 0x7fb96c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb97114b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c0b2ad0 con 0x7fb96c1591b0 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb97114b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c0b4160 con 0x7fb96c15d930 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb97114b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0b2230 con 0x7fb96c15d560 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb96b59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb96c1591b0 0x7fb96c159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34666/0 (socket says 172.21.15.82:34666) 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb96b59e700 1 -- 172.21.15.82:0/2292776321 learned_addr learned my addr 172.21.15.82:0/2292776321 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb96ad9d700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb96c15d560 0x7fb96c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231090395 0 0) 0x7fb96c0b2ad0 con 0x7fb96c1591b0 2023-10-06T03:17:30.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.956+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb958003570 con 0x7fb96c1591b0 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651220473 0 0) 0x7fb96c0b4160 con 0x7fb96c15d930 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb96c0b2ad0 con 0x7fb96c15d930 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1319931225 0 0) 0x7fb958003570 con 0x7fb96c1591b0 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb96c15d560 msgr2=0x7fb96c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb96c15d560 0x7fb96c0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 >> v1:172.21.15.134:6789/0 conn(0x7fb96c15d930 legacy=0x7fb96c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c0b2510 con 0x7fb96c1591b0 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fb9640017f0 con 0x7fb96c1591b0 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 >> v1:172.21.15.82:6789/0 conn(0x7fb96c1591b0 legacy=0x7fb96c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb96c15d560 0x7fb958003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:30.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9580041d0 0x7fb958004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958004d50 0x7fb9580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0b2230 con 0x7fb9580041d0 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95800bbf0 con 0x7fb958004d50 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95800bdb0 con 0x7fb96c15d560 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96259c700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9580041d0 0x7fb958004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96ad9d700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb96c15d560 0x7fb958003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96b59e700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958004d50 0x7fb9580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96259c700 1 -- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb96c15d560 msgr2=0x7fb958003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96259c700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb96c15d560 0x7fb958003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96259c700 1 -- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958004d50 msgr2=0x7fb9580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96259c700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958004d50 0x7fb9580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96259c700 1 -- 172.21.15.82:0/2292776321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958003570 con 0x7fb9580041d0 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96259c700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9580041d0 0x7fb958004810 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb954001a10 tx=0x7fb954007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e72ab359ac39780 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400c5d0 con 0x7fb9580041d0 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95400c730 con 0x7fb9580041d0 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.957+0000 7fb96a59c700 1 -- 172.21.15.82:0/2292776321 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400cad0 con 0x7fb9580041d0 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.958+0000 7fb97114b700 1 -- 172.21.15.82:0/2292776321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9580041d0 msgr2=0x7fb958004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.958+0000 7fb97114b700 1 --2- 172.21.15.82:0/2292776321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9580041d0 0x7fb958004810 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb954001a10 tx=0x7fb954007d30 comp rx=0 tx=0).stop 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.958+0000 7fb96b59e700 1 -- 172.21.15.82:0/2292776321 reap_dead start 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.958+0000 7fb97114b700 1 -- 172.21.15.82:0/2292776321 shutdown_connections 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.958+0000 7fb97114b700 1 -- 172.21.15.82:0/2292776321 >> 172.21.15.82:0/2292776321 conn(0x7fb96c0d1180 msgr2=0x7fb96c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.958+0000 7fb97114b700 1 -- 172.21.15.82:0/2292776321 shutdown_connections 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.958+0000 7fb97114b700 1 -- 172.21.15.82:0/2292776321 wait complete. 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.959+0000 7fb97114b700 1 Processor -- start 2023-10-06T03:17:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.959+0000 7fb97114b700 1 -- start start 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb97114b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9580041d0 0x7fb96c147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb97114b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c15b4b0 0x7fb96c15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb97114b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb96c157460 0x7fb96c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb97114b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c157e40 con 0x7fb96c15b4b0 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb97114b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c154bf0 con 0x7fb96c157460 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb97114b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c15c020 con 0x7fb9580041d0 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c15b4b0 0x7fb96c15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c15b4b0 0x7fb96c15b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50918/0 (socket says 172.21.15.82:50918) 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 -- 172.21.15.82:0/2661027058 learned_addr learned my addr 172.21.15.82:0/2661027058 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96ad9d700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9580041d0 0x7fb96c147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96b59e700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb96c157460 0x7fb96c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 -- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9580041d0 msgr2=0x7fb96c147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9580041d0 0x7fb96c147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 -- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb96c157460 msgr2=0x7fb96c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb96c157460 0x7fb96c157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 -- 172.21.15.82:0/2661027058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c15c300 con 0x7fb96c15b4b0 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.960+0000 7fb96259c700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c15b4b0 0x7fb96c15b920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c3c0 tx=0x7fb954015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.961+0000 7fb9637fe700 1 -- 172.21.15.82:0/2661027058 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954023070 con 0x7fb96c15b4b0 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.961+0000 7fb9637fe700 1 -- 172.21.15.82:0/2661027058 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb954000fe0 con 0x7fb96c15b4b0 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.961+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c15c5e0 con 0x7fb96c15b4b0 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.961+0000 7fb9637fe700 1 -- 172.21.15.82:0/2661027058 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954006a70 con 0x7fb96c15b4b0 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.961+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c15cba0 con 0x7fb96c15b4b0 2023-10-06T03:17:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.962+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c0b34e0 con 0x7fb96c15b4b0 2023-10-06T03:17:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.962+0000 7fb9637fe700 1 -- 172.21.15.82:0/2661027058 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb954019070 con 0x7fb96c15b4b0 2023-10-06T03:17:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.962+0000 7fb9637fe700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb94c066f30 0x7fb94c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.962+0000 7fb9637fe700 1 -- 172.21.15.82:0/2661027058 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb9540857a0 con 0x7fb96c15b4b0 2023-10-06T03:17:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.962+0000 7fb96ad9d700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb94c066f30 0x7fb94c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.963+0000 7fb96ad9d700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb94c066f30 0x7fb94c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb95c006dc0 tx=0x7fb95c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:30.966+0000 7fb9637fe700 1 -- 172.21.15.82:0/2661027058 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9540528b0 con 0x7fb96c15b4b0 2023-10-06T03:17:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.190+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb96c064050 con 0x7fb96c15b4b0 2023-10-06T03:17:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.190+0000 7fb9637fe700 1 -- 172.21.15.82:0/2661027058 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fb954017020 con 0x7fb96c15b4b0 2023-10-06T03:17:31.192 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:31.192 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/763820094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":763820094},{"type":"v1","addr":"172.21.15.134:6837","nonce":763820094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/1309129480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1309129480},{"type":"v1","addr":"172.21.15.134:6836","nonce":1309129480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/21148295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":21148295},{"type":"v1","addr":"172.21.15.82:6834","nonce":21148295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:27.187663+0000","modified":"2023-10-06T03:17:30.826288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5706":{"gid":5706,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/598797511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":598797511},{"type":"v1","addr":"172.21.15.82:6835","nonce":598797511}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:17:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.192+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb94c066f30 msgr2=0x7fb94c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.192+0000 7fb97114b700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb94c066f30 0x7fb94c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb95c006dc0 tx=0x7fb95c008040 comp rx=0 tx=0).stop 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.192+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c15b4b0 msgr2=0x7fb96c15b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.192+0000 7fb97114b700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c15b4b0 0x7fb96c15b920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c3c0 tx=0x7fb954015000 comp rx=0 tx=0).stop 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.193+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 shutdown_connections 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.193+0000 7fb97114b700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb96c157460 0x7fb96c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.193+0000 7fb97114b700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb94c066f30 0x7fb94c0693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.193+0000 7fb97114b700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9580041d0 0x7fb96c147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.193+0000 7fb97114b700 1 --2- 172.21.15.82:0/2661027058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c15b4b0 0x7fb96c15b920 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.193+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 >> 172.21.15.82:0/2661027058 conn(0x7fb96c0d1180 msgr2=0x7fb96c0b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.193+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 shutdown_connections 2023-10-06T03:17:31.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.193+0000 7fb97114b700 1 -- 172.21.15.82:0/2661027058 wait complete. 2023-10-06T03:17:31.196 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-10-06T03:17:31.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:31.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.318+0000 7fcac1835700 1 Processor -- start 2023-10-06T03:17:31.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.318+0000 7fcac1835700 1 -- start start 2023-10-06T03:17:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.319+0000 7fcac1835700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.319+0000 7fcac1835700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcabc068ed0 0x7fcabc069310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.319+0000 7fcac1835700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc069850 con 0x7fcabc0cb220 2023-10-06T03:17:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.319+0000 7fcac1835700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcabc15a220 con 0x7fcabc068ed0 2023-10-06T03:17:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.319+0000 7fcac1835700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc15a500 con 0x7fcabc159d40 2023-10-06T03:17:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcab27fc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcabb7fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcabc068ed0 0x7fcabc069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcab27fc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc06ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:52120/0 (socket says 172.21.15.82:52120) 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcab27fc700 1 -- 172.21.15.82:0/2100705785 learned_addr learned my addr 172.21.15.82:0/2100705785 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcab27fc700 1 -- 172.21.15.82:0/2100705785 >> v2:172.21.15.134:3300/0 conn(0x7fcabc068ed0 msgr2=0x7fcabc069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcab27fc700 1 --2- 172.21.15.82:0/2100705785 >> v2:172.21.15.134:3300/0 conn(0x7fcabc068ed0 0x7fcabc069310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcab27fc700 1 -- 172.21.15.82:0/2100705785 >> v1:172.21.15.134:6789/0 conn(0x7fcabc0cb220 legacy=0x7fcabc0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcab27fc700 1 -- 172.21.15.82:0/2100705785 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc15a7e0 con 0x7fcabc159d40 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcabb7fe700 1 --2- 172.21.15.82:0/2100705785 >> v2:172.21.15.134:3300/0 conn(0x7fcabc068ed0 0x7fcabc069310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcab27fc700 1 --2- 172.21.15.82:0/2100705785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc06ea80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40099b0 tx=0x7fcaa4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba1c28e8351e928 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.320+0000 7fcaba7fc700 1 -- 172.21.15.82:0/2100705785 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4009ea0 con 0x7fcabc159d40 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcaba7fc700 1 -- 172.21.15.82:0/2100705785 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa400b860 con 0x7fcabc159d40 2023-10-06T03:17:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcaba7fc700 1 -- 172.21.15.82:0/2100705785 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa400bc00 con 0x7fcabc159d40 2023-10-06T03:17:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcac1835700 1 -- 172.21.15.82:0/2100705785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 msgr2=0x7fcabc06ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcac1835700 1 --2- 172.21.15.82:0/2100705785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc06ea80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40099b0 tx=0x7fcaa4009250 comp rx=0 tx=0).stop 2023-10-06T03:17:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcac1835700 1 -- 172.21.15.82:0/2100705785 shutdown_connections 2023-10-06T03:17:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcac1835700 1 --2- 172.21.15.82:0/2100705785 >> v2:172.21.15.134:3300/0 conn(0x7fcabc068ed0 0x7fcabc069310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcac1835700 1 --2- 172.21.15.82:0/2100705785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc06ea80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcac1835700 1 -- 172.21.15.82:0/2100705785 >> 172.21.15.82:0/2100705785 conn(0x7fcabc0ca0a0 msgr2=0x7fcabc06de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcac1835700 1 -- 172.21.15.82:0/2100705785 shutdown_connections 2023-10-06T03:17:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.321+0000 7fcac1835700 1 -- 172.21.15.82:0/2100705785 wait complete. 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.322+0000 7fcac1835700 1 Processor -- start 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcac1835700 1 -- start start 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcac1835700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcabc068ed0 0x7fcabc0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcac1835700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcabc0cb220 0x7fcabc153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcac1835700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcac1835700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0b1310 con 0x7fcabc068ed0 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcac1835700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0c8cb0 con 0x7fcabc0cb220 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcac1835700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0b09e0 con 0x7fcabc159d40 2023-10-06T03:17:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcabaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcabc068ed0 0x7fcabc0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcabaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcabc068ed0 0x7fcabc0c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50932/0 (socket says 172.21.15.82:50932) 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.323+0000 7fcabaffd700 1 -- 172.21.15.82:0/2673787292 learned_addr learned my addr 172.21.15.82:0/2673787292 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcabb7fe700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcab27fc700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcabc0cb220 0x7fcabc153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcabaffd700 1 -- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 msgr2=0x7fcabc146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcabaffd700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcabaffd700 1 -- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcabc0cb220 msgr2=0x7fcabc153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcabaffd700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcabc0cb220 0x7fcabc153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcabaffd700 1 -- 172.21.15.82:0/2673787292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4009a20 con 0x7fcabc068ed0 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcabaffd700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcabc068ed0 0x7fcabc0c3c10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00c590 tx=0x7fcaac00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcab37fe700 1 -- 172.21.15.82:0/2673787292 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac011590 con 0x7fcabc068ed0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcab37fe700 1 -- 172.21.15.82:0/2673787292 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac0116f0 con 0x7fcabc068ed0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40094f0 con 0x7fcabc068ed0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcab37fe700 1 -- 172.21.15.82:0/2673787292 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac011ab0 con 0x7fcabc068ed0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.324+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcabc0b0fa0 con 0x7fcabc068ed0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.325+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcabc064050 con 0x7fcabc068ed0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.325+0000 7fcab37fe700 1 -- 172.21.15.82:0/2673787292 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcaac01b3b0 con 0x7fcabc068ed0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.326+0000 7fcab37fe700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.326+0000 7fcab37fe700 1 -- 172.21.15.82:0/2673787292 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcaac083c10 con 0x7fcabc068ed0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.326+0000 7fcab27fc700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.326+0000 7fcab27fc700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fca9c066f30 0x7fca9c0693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40099b0 tx=0x7fcaa4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.330+0000 7fcab37fe700 1 -- 172.21.15.82:0/2673787292 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaac050d20 con 0x7fcabc068ed0 2023-10-06T03:17:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.513+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcabc15aac0 con 0x7fcabc068ed0 2023-10-06T03:17:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.514+0000 7fcab37fe700 1 -- 172.21.15.82:0/2673787292 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16868 (secure 0 0 0) 0x7fcaac017070 con 0x7fcabc068ed0 2023-10-06T03:17:31.516 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:31.516 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":55,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:28.809576+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:24.832103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:26.150387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:31.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fca9c066f30 msgr2=0x7fca9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fca9c066f30 0x7fca9c0693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40099b0 tx=0x7fcaa4017000 comp rx=0 tx=0).stop 2023-10-06T03:17:31.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcabc068ed0 msgr2=0x7fcabc0c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcabc068ed0 0x7fcabc0c3c10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00c590 tx=0x7fcaac00c950 comp rx=0 tx=0).stop 2023-10-06T03:17:31.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 shutdown_connections 2023-10-06T03:17:31.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcabc159d40 0x7fcabc146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcabc068ed0 0x7fcabc0c3c10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 --2- 172.21.15.82:0/2673787292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcabc0cb220 0x7fcabc153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 >> 172.21.15.82:0/2673787292 conn(0x7fcabc0ca0a0 msgr2=0x7fcabc152730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:31.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 shutdown_connections 2023-10-06T03:17:31.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.516+0000 7fcac1835700 1 -- 172.21.15.82:0/2673787292 wait complete. 2023-10-06T03:17:31.530 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:17:31.531 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:17:31.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.643+0000 7ff71546c700 1 Processor -- start 2023-10-06T03:17:31.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.643+0000 7ff71546c700 1 -- start start 2023-10-06T03:17:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff71546c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff71015d480 0x7ff710069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff71546c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7100687c0 con 0x7ff710069da0 2023-10-06T03:17:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff71546c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff710068aa0 con 0x7ff7100b0a20 2023-10-06T03:17:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff71546c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff710068d80 con 0x7ff71015d480 2023-10-06T03:17:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff710069da0 0x7ff7100b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34676/0 (socket says 172.21.15.82:34676) 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70f7fe700 1 -- 172.21.15.82:0/89131321 learned_addr learned my addr 172.21.15.82:0/89131321 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177887861 0 0) 0x7ff7100687c0 con 0x7ff710069da0 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f8003570 con 0x7ff710069da0 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70ffff700 1 --2- 172.21.15.82:0/89131321 >> v2:172.21.15.134:3300/0 conn(0x7ff71015d480 0x7ff710069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148221728 0 0) 0x7ff6f8003570 con 0x7ff710069da0 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 >> v2:172.21.15.134:3300/0 conn(0x7ff71015d480 msgr2=0x7ff710069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70effd700 1 --2- 172.21.15.82:0/89131321 >> v2:172.21.15.134:3300/0 conn(0x7ff71015d480 0x7ff710069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.644+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 >> v1:172.21.15.134:6789/0 conn(0x7ff7100b0a20 legacy=0x7ff7100b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710069060 con 0x7ff710069da0 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7ff704001470 con 0x7ff710069da0 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 >> v1:172.21.15.82:6789/0 conn(0x7ff710069da0 legacy=0x7ff7100b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6f8003a60 0x7ff6f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff6f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6f80051c0 0x7ff6f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710068d80 con 0x7ff6f8004810 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f800c160 con 0x7ff6f80051c0 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f800c320 con 0x7ff6f8003a60 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70f7fe700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff6f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70ffff700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6f8003a60 0x7ff6f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff714c6b700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6f80051c0 0x7ff6f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70f7fe700 1 -- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6f8003a60 msgr2=0x7ff6f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70f7fe700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6f8003a60 0x7ff6f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70f7fe700 1 -- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6f80051c0 msgr2=0x7ff6f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70f7fe700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6f80051c0 0x7ff6f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70f7fe700 1 -- 172.21.15.82:0/89131321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8003570 con 0x7ff6f8004810 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff714c6b700 1 -- 172.21.15.82:0/89131321 reap_dead start 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70ffff700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6f8003a60 0x7ff6f8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70f7fe700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff6f8004c80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c3c0 tx=0x7ff704001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b619f377eb21c57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400cc90 con 0x7ff6f8004810 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70400cdf0 con 0x7ff6f8004810 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.645+0000 7ff70effd700 1 -- 172.21.15.82:0/89131321 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704005b50 con 0x7ff6f8004810 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.646+0000 7ff71546c700 1 -- 172.21.15.82:0/89131321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 msgr2=0x7ff6f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.646+0000 7ff71546c700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff6f8004c80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c3c0 tx=0x7ff704001e50 comp rx=0 tx=0).stop 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.646+0000 7ff71546c700 1 -- 172.21.15.82:0/89131321 shutdown_connections 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.646+0000 7ff71546c700 1 --2- 172.21.15.82:0/89131321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff6f8004c80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.646+0000 7ff71546c700 1 -- 172.21.15.82:0/89131321 >> 172.21.15.82:0/89131321 conn(0x7ff7100ccf80 msgr2=0x7ff7100cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.646+0000 7ff71546c700 1 -- 172.21.15.82:0/89131321 shutdown_connections 2023-10-06T03:17:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.646+0000 7ff71546c700 1 -- 172.21.15.82:0/89131321 wait complete. 2023-10-06T03:17:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.647+0000 7ff71546c700 1 Processor -- start 2023-10-06T03:17:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.647+0000 7ff71546c700 1 -- start start 2023-10-06T03:17:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff71546c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff7100a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff71546c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7100cc3c0 0x7ff71016d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff71546c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7101581c0 0x7ff710158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff71546c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100cc990 con 0x7ff6f8004810 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff71546c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71016de50 con 0x7ff7100cc3c0 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff71546c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100a7330 con 0x7ff7101581c0 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff7100a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff7100a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50960/0 (socket says 172.21.15.82:50960) 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 -- 172.21.15.82:0/1549250615 learned_addr learned my addr 172.21.15.82:0/1549250615 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff714c6b700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7101581c0 0x7ff710158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70f7fe700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7100cc3c0 0x7ff71016d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 -- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7101581c0 msgr2=0x7ff710158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7101581c0 0x7ff710158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 -- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7100cc3c0 msgr2=0x7ff71016d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7100cc3c0 0x7ff71016d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 -- 172.21.15.82:0/1549250615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100c9b70 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70f7fe700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7100cc3c0 0x7ff71016d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff70ffff700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff7100a6df0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff700011700 tx=0x7ff700008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff6f7fff700 1 -- 172.21.15.82:0/1549250615 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700015670 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff6f7fff700 1 -- 172.21.15.82:0/1549250615 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7000157d0 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7100c9e50 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff6f7fff700 1 -- 172.21.15.82:0/1549250615 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700015b90 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.648+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7100ca410 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.649+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7100ca630 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.650+0000 7ff6f7fff700 1 -- 172.21.15.82:0/1549250615 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff700013410 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.650+0000 7ff6f7fff700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff6fc066f30 0x7ff6fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.650+0000 7ff6f7fff700 1 -- 172.21.15.82:0/1549250615 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff700084a30 con 0x7ff6f8004810 2023-10-06T03:17:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.651+0000 7ff70f7fe700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff6fc066f30 0x7ff6fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:31.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.651+0000 7ff70f7fe700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff6fc066f30 0x7ff6fc0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff704007cd0 tx=0x7ff704015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:31.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.654+0000 7ff6f7fff700 1 -- 172.21.15.82:0/1549250615 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff700051aa0 con 0x7ff6f8004810 2023-10-06T03:17:31.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.835+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff71004c3c0 con 0x7ff6fc066f30 2023-10-06T03:17:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.844+0000 7ff6f7fff700 1 -- 172.21.15.82:0/1549250615 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311625 (secure 0 0 0) 0x7ff71004c3c0 con 0x7ff6fc066f30 2023-10-06T03:17:31.849 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.847+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff6fc066f30 msgr2=0x7ff6fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.847+0000 7ff71546c700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff6fc066f30 0x7ff6fc0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff704007cd0 tx=0x7ff704015000 comp rx=0 tx=0).stop 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 msgr2=0x7ff7100a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff7100a6df0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff700011700 tx=0x7ff700008040 comp rx=0 tx=0).stop 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 shutdown_connections 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff6fc066f30 0x7ff6fc0693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7101581c0 0x7ff710158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6f8004810 0x7ff7100a6df0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 --2- 172.21.15.82:0/1549250615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7100cc3c0 0x7ff71016d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 >> 172.21.15.82:0/1549250615 conn(0x7ff7100ccf80 msgr2=0x7ff7100ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 shutdown_connections 2023-10-06T03:17:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:31.848+0000 7ff71546c700 1 -- 172.21.15.82:0/1549250615 wait complete. 2023-10-06T03:17:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:17:31.861 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-10-06T03:17:31.172115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384588,"kb_used_data":6284,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590132,"statfs":{"total":773094113280,"available":770652295168,"internally_reserved":0,"allocated":6434816,"data_stored":3429465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.375851"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836990+0000","last_change":"2023-10-06T03:17:27.836990+0000","last_active":"2023-10-06T03:17:27.836990+0000","last_peered":"2023-10-06T03:17:27.836990+0000","last_clean":"2023-10-06T03:17:27.836990+0000","last_became_active":"2023-10-06T03:17:27.836751+0000","last_became_peered":"2023-10-06T03:17:27.836751+0000","last_unstale":"2023-10-06T03:17:27.836990+0000","last_undegraded":"2023-10-06T03:17:27.836990+0000","last_fullsized":"2023-10-06T03:17:27.836990+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:39.893727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.819863+0000","last_change":"2023-10-06T03:17:27.819863+0000","last_active":"2023-10-06T03:17:27.819863+0000","last_peered":"2023-10-06T03:17:27.819863+0000","last_clean":"2023-10-06T03:17:27.819863+0000","last_became_active":"2023-10-06T03:17:27.819587+0000","last_became_peered":"2023-10-06T03:17:27.819587+0000","last_unstale":"2023-10-06T03:17:27.819863+0000","last_undegraded":"2023-10-06T03:17:27.819863+0000","last_fullsized":"2023-10-06T03:17:27.819863+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:19.640429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847238+0000","last_change":"2023-10-06T03:17:27.840037+0000","last_active":"2023-10-06T03:17:27.847238+0000","last_peered":"2023-10-06T03:17:27.847238+0000","last_clean":"2023-10-06T03:17:27.847238+0000","last_became_active":"2023-10-06T03:17:27.839630+0000","last_became_peered":"2023-10-06T03:17:27.839630+0000","last_unstale":"2023-10-06T03:17:27.847238+0000","last_undegraded":"2023-10-06T03:17:27.847238+0000","last_fullsized":"2023-10-06T03:17:27.847238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:58.173143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830611+0000","last_change":"2023-10-06T03:17:27.824806+0000","last_active":"2023-10-06T03:17:27.830611+0000","last_peered":"2023-10-06T03:17:27.830611+0000","last_clean":"2023-10-06T03:17:27.830611+0000","last_became_active":"2023-10-06T03:17:27.824548+0000","last_became_peered":"2023-10-06T03:17:27.824548+0000","last_unstale":"2023-10-06T03:17:27.830611+0000","last_undegraded":"2023-10-06T03:17:27.830611+0000","last_fullsized":"2023-10-06T03:17:27.830611+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:32.072425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.831814+0000","last_change":"2023-10-06T03:17:27.831814+0000","last_active":"2023-10-06T03:17:27.831814+0000","last_peered":"2023-10-06T03:17:27.831814+0000","last_clean":"2023-10-06T03:17:27.831814+0000","last_became_active":"2023-10-06T03:17:27.831550+0000","last_became_peered":"2023-10-06T03:17:27.831550+0000","last_unstale":"2023-10-06T03:17:27.831814+0000","last_undegraded":"2023-10-06T03:17:27.831814+0000","last_fullsized":"2023-10-06T03:17:27.831814+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:49.856690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.842815+0000","last_change":"2023-10-06T03:17:27.834382+0000","last_active":"2023-10-06T03:17:27.842815+0000","last_peered":"2023-10-06T03:17:27.842815+0000","last_clean":"2023-10-06T03:17:27.842815+0000","last_became_active":"2023-10-06T03:17:27.834113+0000","last_became_peered":"2023-10-06T03:17:27.834113+0000","last_unstale":"2023-10-06T03:17:27.842815+0000","last_undegraded":"2023-10-06T03:17:27.842815+0000","last_fullsized":"2023-10-06T03:17:27.842815+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.510541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830400+0000","last_change":"2023-10-06T03:17:27.829755+0000","last_active":"2023-10-06T03:17:27.830400+0000","last_peered":"2023-10-06T03:17:27.830400+0000","last_clean":"2023-10-06T03:17:27.830400+0000","last_became_active":"2023-10-06T03:17:27.829458+0000","last_became_peered":"2023-10-06T03:17:27.829458+0000","last_unstale":"2023-10-06T03:17:27.830400+0000","last_undegraded":"2023-10-06T03:17:27.830400+0000","last_fullsized":"2023-10-06T03:17:27.830400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:30.180629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.840873+0000","last_change":"2023-10-06T03:17:27.835463+0000","last_active":"2023-10-06T03:17:27.840873+0000","last_peered":"2023-10-06T03:17:27.840873+0000","last_clean":"2023-10-06T03:17:27.840873+0000","last_became_active":"2023-10-06T03:17:27.835193+0000","last_became_peered":"2023-10-06T03:17:27.835193+0000","last_unstale":"2023-10-06T03:17:27.840873+0000","last_undegraded":"2023-10-06T03:17:27.840873+0000","last_fullsized":"2023-10-06T03:17:27.840873+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:33.318739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.843955+0000","last_change":"2023-10-06T03:17:27.837322+0000","last_active":"2023-10-06T03:17:27.843955+0000","last_peered":"2023-10-06T03:17:27.843955+0000","last_clean":"2023-10-06T03:17:27.843955+0000","last_became_active":"2023-10-06T03:17:27.837048+0000","last_became_peered":"2023-10-06T03:17:27.837048+0000","last_unstale":"2023-10-06T03:17:27.843955+0000","last_undegraded":"2023-10-06T03:17:27.843955+0000","last_fullsized":"2023-10-06T03:17:27.843955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:18.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836742+0000","last_change":"2023-10-06T03:17:27.832741+0000","last_active":"2023-10-06T03:17:27.836742+0000","last_peered":"2023-10-06T03:17:27.836742+0000","last_clean":"2023-10-06T03:17:27.836742+0000","last_became_active":"2023-10-06T03:17:27.832499+0000","last_became_peered":"2023-10-06T03:17:27.832499+0000","last_unstale":"2023-10-06T03:17:27.836742+0000","last_undegraded":"2023-10-06T03:17:27.836742+0000","last_fullsized":"2023-10-06T03:17:27.836742+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:25.142593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830378+0000","last_change":"2023-10-06T03:17:27.822034+0000","last_active":"2023-10-06T03:17:27.830378+0000","last_peered":"2023-10-06T03:17:27.830378+0000","last_clean":"2023-10-06T03:17:27.830378+0000","last_became_active":"2023-10-06T03:17:27.821738+0000","last_became_peered":"2023-10-06T03:17:27.821738+0000","last_unstale":"2023-10-06T03:17:27.830378+0000","last_undegraded":"2023-10-06T03:17:27.830378+0000","last_fullsized":"2023-10-06T03:17:27.830378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:50.637897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835935+0000","last_change":"2023-10-06T03:17:27.830326+0000","last_active":"2023-10-06T03:17:27.835935+0000","last_peered":"2023-10-06T03:17:27.835935+0000","last_clean":"2023-10-06T03:17:27.835935+0000","last_became_active":"2023-10-06T03:17:27.830034+0000","last_became_peered":"2023-10-06T03:17:27.830034+0000","last_unstale":"2023-10-06T03:17:27.835935+0000","last_undegraded":"2023-10-06T03:17:27.835935+0000","last_fullsized":"2023-10-06T03:17:27.835935+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:50.215503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838123+0000","last_change":"2023-10-06T03:17:27.833639+0000","last_active":"2023-10-06T03:17:27.838123+0000","last_peered":"2023-10-06T03:17:27.838123+0000","last_clean":"2023-10-06T03:17:27.838123+0000","last_became_active":"2023-10-06T03:17:27.833388+0000","last_became_peered":"2023-10-06T03:17:27.833388+0000","last_unstale":"2023-10-06T03:17:27.838123+0000","last_undegraded":"2023-10-06T03:17:27.838123+0000","last_fullsized":"2023-10-06T03:17:27.838123+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:25.142593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847607+0000","last_change":"2023-10-06T03:17:27.840475+0000","last_active":"2023-10-06T03:17:27.847607+0000","last_peered":"2023-10-06T03:17:27.847607+0000","last_clean":"2023-10-06T03:17:27.847607+0000","last_became_active":"2023-10-06T03:17:27.839756+0000","last_became_peered":"2023-10-06T03:17:27.839756+0000","last_unstale":"2023-10-06T03:17:27.847607+0000","last_undegraded":"2023-10-06T03:17:27.847607+0000","last_fullsized":"2023-10-06T03:17:27.847607+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.444587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836711+0000","last_change":"2023-10-06T03:17:27.832150+0000","last_active":"2023-10-06T03:17:27.836711+0000","last_peered":"2023-10-06T03:17:27.836711+0000","last_clean":"2023-10-06T03:17:27.836711+0000","last_became_active":"2023-10-06T03:17:27.831899+0000","last_became_peered":"2023-10-06T03:17:27.831899+0000","last_unstale":"2023-10-06T03:17:27.836711+0000","last_undegraded":"2023-10-06T03:17:27.836711+0000","last_fullsized":"2023-10-06T03:17:27.836711+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:20.600195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.841566+0000","last_change":"2023-10-06T03:17:27.837442+0000","last_active":"2023-10-06T03:17:27.841566+0000","last_peered":"2023-10-06T03:17:27.841566+0000","last_clean":"2023-10-06T03:17:27.841566+0000","last_became_active":"2023-10-06T03:17:27.837187+0000","last_became_peered":"2023-10-06T03:17:27.837187+0000","last_unstale":"2023-10-06T03:17:27.841566+0000","last_undegraded":"2023-10-06T03:17:27.841566+0000","last_fullsized":"2023-10-06T03:17:27.841566+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:44.713339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818479+0000","last_change":"2023-10-06T03:17:27.818479+0000","last_active":"2023-10-06T03:17:27.818479+0000","last_peered":"2023-10-06T03:17:27.818479+0000","last_clean":"2023-10-06T03:17:27.818479+0000","last_became_active":"2023-10-06T03:17:27.818290+0000","last_became_peered":"2023-10-06T03:17:27.818290+0000","last_unstale":"2023-10-06T03:17:27.818479+0000","last_undegraded":"2023-10-06T03:17:27.818479+0000","last_fullsized":"2023-10-06T03:17:27.818479+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.645900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830470+0000","last_change":"2023-10-06T03:17:27.824940+0000","last_active":"2023-10-06T03:17:27.830470+0000","last_peered":"2023-10-06T03:17:27.830470+0000","last_clean":"2023-10-06T03:17:27.830470+0000","last_became_active":"2023-10-06T03:17:27.824624+0000","last_became_peered":"2023-10-06T03:17:27.824624+0000","last_unstale":"2023-10-06T03:17:27.830470+0000","last_undegraded":"2023-10-06T03:17:27.830470+0000","last_fullsized":"2023-10-06T03:17:27.830470+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:48.477824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830625+0000","last_change":"2023-10-06T03:17:27.830625+0000","last_active":"2023-10-06T03:17:27.830625+0000","last_peered":"2023-10-06T03:17:27.830625+0000","last_clean":"2023-10-06T03:17:27.830625+0000","last_became_active":"2023-10-06T03:17:27.830355+0000","last_became_peered":"2023-10-06T03:17:27.830355+0000","last_unstale":"2023-10-06T03:17:27.830625+0000","last_undegraded":"2023-10-06T03:17:27.830625+0000","last_fullsized":"2023-10-06T03:17:27.830625+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:22.256244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.832130+0000","last_change":"2023-10-06T03:17:27.829179+0000","last_active":"2023-10-06T03:17:27.832130+0000","last_peered":"2023-10-06T03:17:27.832130+0000","last_clean":"2023-10-06T03:17:27.832130+0000","last_became_active":"2023-10-06T03:17:27.828896+0000","last_became_peered":"2023-10-06T03:17:27.828896+0000","last_unstale":"2023-10-06T03:17:27.832130+0000","last_undegraded":"2023-10-06T03:17:27.832130+0000","last_fullsized":"2023-10-06T03:17:27.832130+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.510541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835722+0000","last_change":"2023-10-06T03:17:27.823076+0000","last_active":"2023-10-06T03:17:27.835722+0000","last_peered":"2023-10-06T03:17:27.835722+0000","last_clean":"2023-10-06T03:17:27.835722+0000","last_became_active":"2023-10-06T03:17:27.822808+0000","last_became_peered":"2023-10-06T03:17:27.822808+0000","last_unstale":"2023-10-06T03:17:27.835722+0000","last_undegraded":"2023-10-06T03:17:27.835722+0000","last_fullsized":"2023-10-06T03:17:27.835722+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:34.474601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835900+0000","last_change":"2023-10-06T03:17:27.831001+0000","last_active":"2023-10-06T03:17:27.835900+0000","last_peered":"2023-10-06T03:17:27.835900+0000","last_clean":"2023-10-06T03:17:27.835900+0000","last_became_active":"2023-10-06T03:17:27.830792+0000","last_became_peered":"2023-10-06T03:17:27.830792+0000","last_unstale":"2023-10-06T03:17:27.835900+0000","last_undegraded":"2023-10-06T03:17:27.835900+0000","last_fullsized":"2023-10-06T03:17:27.835900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:17.276579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.832166+0000","last_change":"2023-10-06T03:17:27.829449+0000","last_active":"2023-10-06T03:17:27.832166+0000","last_peered":"2023-10-06T03:17:27.832166+0000","last_clean":"2023-10-06T03:17:27.832166+0000","last_became_active":"2023-10-06T03:17:27.829170+0000","last_became_peered":"2023-10-06T03:17:27.829170+0000","last_unstale":"2023-10-06T03:17:27.832166+0000","last_undegraded":"2023-10-06T03:17:27.832166+0000","last_fullsized":"2023-10-06T03:17:27.832166+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:18.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.837219+0000","last_change":"2023-10-06T03:17:27.835784+0000","last_active":"2023-10-06T03:17:27.837219+0000","last_peered":"2023-10-06T03:17:27.837219+0000","last_clean":"2023-10-06T03:17:27.837219+0000","last_became_active":"2023-10-06T03:17:27.835518+0000","last_became_peered":"2023-10-06T03:17:27.835518+0000","last_unstale":"2023-10-06T03:17:27.837219+0000","last_undegraded":"2023-10-06T03:17:27.837219+0000","last_fullsized":"2023-10-06T03:17:27.837219+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:17.987659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836349+0000","last_change":"2023-10-06T03:17:27.824309+0000","last_active":"2023-10-06T03:17:27.836349+0000","last_peered":"2023-10-06T03:17:27.836349+0000","last_clean":"2023-10-06T03:17:27.836349+0000","last_became_active":"2023-10-06T03:17:27.823879+0000","last_became_peered":"2023-10-06T03:17:27.823879+0000","last_unstale":"2023-10-06T03:17:27.836349+0000","last_undegraded":"2023-10-06T03:17:27.836349+0000","last_fullsized":"2023-10-06T03:17:27.836349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:48.477824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838062+0000","last_change":"2023-10-06T03:17:27.833173+0000","last_active":"2023-10-06T03:17:27.838062+0000","last_peered":"2023-10-06T03:17:27.838062+0000","last_clean":"2023-10-06T03:17:27.838062+0000","last_became_active":"2023-10-06T03:17:27.832923+0000","last_became_peered":"2023-10-06T03:17:27.832923+0000","last_unstale":"2023-10-06T03:17:27.838062+0000","last_undegraded":"2023-10-06T03:17:27.838062+0000","last_fullsized":"2023-10-06T03:17:27.838062+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:50.637897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830396+0000","last_change":"2023-10-06T03:17:27.825617+0000","last_active":"2023-10-06T03:17:27.830396+0000","last_peered":"2023-10-06T03:17:27.830396+0000","last_clean":"2023-10-06T03:17:27.830396+0000","last_became_active":"2023-10-06T03:17:27.825080+0000","last_became_peered":"2023-10-06T03:17:27.825080+0000","last_unstale":"2023-10-06T03:17:27.830396+0000","last_undegraded":"2023-10-06T03:17:27.830396+0000","last_fullsized":"2023-10-06T03:17:27.830396+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:10.209030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.829359+0000","last_change":"2023-10-06T03:17:27.829359+0000","last_active":"2023-10-06T03:17:27.829359+0000","last_peered":"2023-10-06T03:17:27.829359+0000","last_clean":"2023-10-06T03:17:27.829359+0000","last_became_active":"2023-10-06T03:17:27.828904+0000","last_became_peered":"2023-10-06T03:17:27.828904+0000","last_unstale":"2023-10-06T03:17:27.829359+0000","last_undegraded":"2023-10-06T03:17:27.829359+0000","last_fullsized":"2023-10-06T03:17:27.829359+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:22.256244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847122+0000","last_change":"2023-10-06T03:17:27.840175+0000","last_active":"2023-10-06T03:17:27.847122+0000","last_peered":"2023-10-06T03:17:27.847122+0000","last_clean":"2023-10-06T03:17:27.847122+0000","last_became_active":"2023-10-06T03:17:27.839165+0000","last_became_peered":"2023-10-06T03:17:27.839165+0000","last_unstale":"2023-10-06T03:17:27.847122+0000","last_undegraded":"2023-10-06T03:17:27.847122+0000","last_fullsized":"2023-10-06T03:17:27.847122+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.271508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838056+0000","last_change":"2023-10-06T03:17:27.834214+0000","last_active":"2023-10-06T03:17:27.838056+0000","last_peered":"2023-10-06T03:17:27.838056+0000","last_clean":"2023-10-06T03:17:27.838056+0000","last_became_active":"2023-10-06T03:17:27.833972+0000","last_became_peered":"2023-10-06T03:17:27.833972+0000","last_unstale":"2023-10-06T03:17:27.838056+0000","last_undegraded":"2023-10-06T03:17:27.838056+0000","last_fullsized":"2023-10-06T03:17:27.838056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:44.053318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.831060+0000","last_change":"2023-10-06T03:17:27.825359+0000","last_active":"2023-10-06T03:17:27.831060+0000","last_peered":"2023-10-06T03:17:27.831060+0000","last_clean":"2023-10-06T03:17:27.831060+0000","last_became_active":"2023-10-06T03:17:27.825021+0000","last_became_peered":"2023-10-06T03:17:27.825021+0000","last_unstale":"2023-10-06T03:17:27.831060+0000","last_undegraded":"2023-10-06T03:17:27.831060+0000","last_fullsized":"2023-10-06T03:17:27.831060+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:13.494774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824707+0000","last_change":"2023-10-06T03:17:27.819107+0000","last_active":"2023-10-06T03:17:27.824707+0000","last_peered":"2023-10-06T03:17:27.824707+0000","last_clean":"2023-10-06T03:17:27.824707+0000","last_became_active":"2023-10-06T03:17:27.818875+0000","last_became_peered":"2023-10-06T03:17:27.818875+0000","last_unstale":"2023-10-06T03:17:27.824707+0000","last_undegraded":"2023-10-06T03:17:27.824707+0000","last_fullsized":"2023-10-06T03:17:27.824707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:17.276579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.827772+0000","last_change":"2023-10-06T03:17:27.827772+0000","last_active":"2023-10-06T03:17:27.827772+0000","last_peered":"2023-10-06T03:17:27.827772+0000","last_clean":"2023-10-06T03:17:27.827772+0000","last_became_active":"2023-10-06T03:17:27.827389+0000","last_became_peered":"2023-10-06T03:17:27.827389+0000","last_unstale":"2023-10-06T03:17:27.827772+0000","last_undegraded":"2023-10-06T03:17:27.827772+0000","last_fullsized":"2023-10-06T03:17:27.827772+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:56.757661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.839476+0000","last_change":"2023-10-06T03:17:26.816352+0000","last_active":"2023-10-06T03:17:27.839476+0000","last_peered":"2023-10-06T03:17:27.839476+0000","last_clean":"2023-10-06T03:17:27.839476+0000","last_became_active":"2023-10-06T03:17:26.816036+0000","last_became_peered":"2023-10-06T03:17:26.816036+0000","last_unstale":"2023-10-06T03:17:27.839476+0000","last_undegraded":"2023-10-06T03:17:27.839476+0000","last_fullsized":"2023-10-06T03:17:27.839476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:51.790551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835759+0000","last_change":"2023-10-06T03:17:27.831993+0000","last_active":"2023-10-06T03:17:27.835759+0000","last_peered":"2023-10-06T03:17:27.835759+0000","last_clean":"2023-10-06T03:17:27.835759+0000","last_became_active":"2023-10-06T03:17:27.831496+0000","last_became_peered":"2023-10-06T03:17:27.831496+0000","last_unstale":"2023-10-06T03:17:27.835759+0000","last_undegraded":"2023-10-06T03:17:27.835759+0000","last_fullsized":"2023-10-06T03:17:27.835759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:50.151603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.841836+0000","last_change":"2023-10-06T03:17:26.817998+0000","last_active":"2023-10-06T03:17:27.841836+0000","last_peered":"2023-10-06T03:17:27.841836+0000","last_clean":"2023-10-06T03:17:27.841836+0000","last_became_active":"2023-10-06T03:17:26.817778+0000","last_became_peered":"2023-10-06T03:17:26.817778+0000","last_unstale":"2023-10-06T03:17:27.841836+0000","last_undegraded":"2023-10-06T03:17:27.841836+0000","last_fullsized":"2023-10-06T03:17:27.841836+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.311874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824752+0000","last_change":"2023-10-06T03:17:27.819647+0000","last_active":"2023-10-06T03:17:27.824752+0000","last_peered":"2023-10-06T03:17:27.824752+0000","last_clean":"2023-10-06T03:17:27.824752+0000","last_became_active":"2023-10-06T03:17:27.819410+0000","last_became_peered":"2023-10-06T03:17:27.819410+0000","last_unstale":"2023-10-06T03:17:27.824752+0000","last_undegraded":"2023-10-06T03:17:27.824752+0000","last_fullsized":"2023-10-06T03:17:27.824752+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.271508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838508+0000","last_change":"2023-10-06T03:17:26.813685+0000","last_active":"2023-10-06T03:17:27.838508+0000","last_peered":"2023-10-06T03:17:27.838508+0000","last_clean":"2023-10-06T03:17:27.838508+0000","last_became_active":"2023-10-06T03:17:26.813362+0000","last_became_peered":"2023-10-06T03:17:26.813362+0000","last_unstale":"2023-10-06T03:17:27.838508+0000","last_undegraded":"2023-10-06T03:17:27.838508+0000","last_fullsized":"2023-10-06T03:17:27.838508+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:19.593330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.837526+0000","last_change":"2023-10-06T03:17:27.833225+0000","last_active":"2023-10-06T03:17:27.837526+0000","last_peered":"2023-10-06T03:17:27.837526+0000","last_clean":"2023-10-06T03:17:27.837526+0000","last_became_active":"2023-10-06T03:17:27.832984+0000","last_became_peered":"2023-10-06T03:17:27.832984+0000","last_unstale":"2023-10-06T03:17:27.837526+0000","last_undegraded":"2023-10-06T03:17:27.837526+0000","last_fullsized":"2023-10-06T03:17:27.837526+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:23.323268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.842452+0000","last_change":"2023-10-06T03:17:26.809766+0000","last_active":"2023-10-06T03:17:27.842452+0000","last_peered":"2023-10-06T03:17:27.842452+0000","last_clean":"2023-10-06T03:17:27.842452+0000","last_became_active":"2023-10-06T03:17:26.809328+0000","last_became_peered":"2023-10-06T03:17:26.809328+0000","last_unstale":"2023-10-06T03:17:27.842452+0000","last_undegraded":"2023-10-06T03:17:27.842452+0000","last_fullsized":"2023-10-06T03:17:27.842452+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:47.470959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824892+0000","last_change":"2023-10-06T03:17:27.821269+0000","last_active":"2023-10-06T03:17:27.824892+0000","last_peered":"2023-10-06T03:17:27.824892+0000","last_clean":"2023-10-06T03:17:27.824892+0000","last_became_active":"2023-10-06T03:17:27.821044+0000","last_became_peered":"2023-10-06T03:17:27.821044+0000","last_unstale":"2023-10-06T03:17:27.824892+0000","last_undegraded":"2023-10-06T03:17:27.824892+0000","last_fullsized":"2023-10-06T03:17:27.824892+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:22.677476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838682+0000","last_change":"2023-10-06T03:17:26.806926+0000","last_active":"2023-10-06T03:17:27.838682+0000","last_peered":"2023-10-06T03:17:27.838682+0000","last_clean":"2023-10-06T03:17:27.838682+0000","last_became_active":"2023-10-06T03:17:26.806629+0000","last_became_peered":"2023-10-06T03:17:26.806629+0000","last_unstale":"2023-10-06T03:17:27.838682+0000","last_undegraded":"2023-10-06T03:17:27.838682+0000","last_fullsized":"2023-10-06T03:17:27.838682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:49.208638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.817791+0000","last_change":"2023-10-06T03:17:27.817791+0000","last_active":"2023-10-06T03:17:27.817791+0000","last_peered":"2023-10-06T03:17:27.817791+0000","last_clean":"2023-10-06T03:17:27.817791+0000","last_became_active":"2023-10-06T03:17:27.817492+0000","last_became_peered":"2023-10-06T03:17:27.817492+0000","last_unstale":"2023-10-06T03:17:27.817791+0000","last_undegraded":"2023-10-06T03:17:27.817791+0000","last_fullsized":"2023-10-06T03:17:27.817791+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:49.856690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838730+0000","last_change":"2023-10-06T03:17:26.812402+0000","last_active":"2023-10-06T03:17:27.838730+0000","last_peered":"2023-10-06T03:17:27.838730+0000","last_clean":"2023-10-06T03:17:27.838730+0000","last_became_active":"2023-10-06T03:17:26.812143+0000","last_became_peered":"2023-10-06T03:17:26.812143+0000","last_unstale":"2023-10-06T03:17:27.838730+0000","last_undegraded":"2023-10-06T03:17:27.838730+0000","last_fullsized":"2023-10-06T03:17:27.838730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:49.631031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828762+0000","last_change":"2023-10-06T03:17:27.828762+0000","last_active":"2023-10-06T03:17:27.828762+0000","last_peered":"2023-10-06T03:17:27.828762+0000","last_clean":"2023-10-06T03:17:27.828762+0000","last_became_active":"2023-10-06T03:17:27.827842+0000","last_became_peered":"2023-10-06T03:17:27.827842+0000","last_unstale":"2023-10-06T03:17:27.828762+0000","last_undegraded":"2023-10-06T03:17:27.828762+0000","last_fullsized":"2023-10-06T03:17:27.828762+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.084282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816400+0000","last_change":"2023-10-06T03:17:26.814607+0000","last_active":"2023-10-06T03:17:27.816400+0000","last_peered":"2023-10-06T03:17:27.816400+0000","last_clean":"2023-10-06T03:17:27.816400+0000","last_became_active":"2023-10-06T03:17:26.814356+0000","last_became_peered":"2023-10-06T03:17:26.814356+0000","last_unstale":"2023-10-06T03:17:27.816400+0000","last_undegraded":"2023-10-06T03:17:27.816400+0000","last_fullsized":"2023-10-06T03:17:27.816400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:49.144738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.822650+0000","last_change":"2023-10-06T03:17:27.820411+0000","last_active":"2023-10-06T03:17:27.822650+0000","last_peered":"2023-10-06T03:17:27.822650+0000","last_clean":"2023-10-06T03:17:27.822650+0000","last_became_active":"2023-10-06T03:17:27.820123+0000","last_became_peered":"2023-10-06T03:17:27.820123+0000","last_unstale":"2023-10-06T03:17:27.822650+0000","last_undegraded":"2023-10-06T03:17:27.822650+0000","last_fullsized":"2023-10-06T03:17:27.822650+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:04.127117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.821213+0000","last_change":"2023-10-06T03:17:26.817692+0000","last_active":"2023-10-06T03:17:26.821213+0000","last_peered":"2023-10-06T03:17:26.821213+0000","last_clean":"2023-10-06T03:17:26.821213+0000","last_became_active":"2023-10-06T03:17:26.817411+0000","last_became_peered":"2023-10-06T03:17:26.817411+0000","last_unstale":"2023-10-06T03:17:26.821213+0000","last_undegraded":"2023-10-06T03:17:26.821213+0000","last_fullsized":"2023-10-06T03:17:26.821213+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:22.084373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818300+0000","last_change":"2023-10-06T03:17:27.818300+0000","last_active":"2023-10-06T03:17:27.818300+0000","last_peered":"2023-10-06T03:17:27.818300+0000","last_clean":"2023-10-06T03:17:27.818300+0000","last_became_active":"2023-10-06T03:17:27.818062+0000","last_became_peered":"2023-10-06T03:17:27.818062+0000","last_unstale":"2023-10-06T03:17:27.818300+0000","last_undegraded":"2023-10-06T03:17:27.818300+0000","last_fullsized":"2023-10-06T03:17:27.818300+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:03.674022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824348+0000","last_change":"2023-10-06T03:17:26.817706+0000","last_active":"2023-10-06T03:17:27.824348+0000","last_peered":"2023-10-06T03:17:27.824348+0000","last_clean":"2023-10-06T03:17:27.824348+0000","last_became_active":"2023-10-06T03:17:26.817443+0000","last_became_peered":"2023-10-06T03:17:26.817443+0000","last_unstale":"2023-10-06T03:17:27.824348+0000","last_undegraded":"2023-10-06T03:17:27.824348+0000","last_fullsized":"2023-10-06T03:17:27.824348+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:38.674911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.841336+0000","last_change":"2023-10-06T03:17:27.836767+0000","last_active":"2023-10-06T03:17:27.841336+0000","last_peered":"2023-10-06T03:17:27.841336+0000","last_clean":"2023-10-06T03:17:27.841336+0000","last_became_active":"2023-10-06T03:17:27.836504+0000","last_became_peered":"2023-10-06T03:17:27.836504+0000","last_unstale":"2023-10-06T03:17:27.841336+0000","last_undegraded":"2023-10-06T03:17:27.841336+0000","last_fullsized":"2023-10-06T03:17:27.841336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.271508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.817521+0000","last_change":"2023-10-06T03:17:26.823868+0000","last_active":"2023-10-06T03:17:27.817521+0000","last_peered":"2023-10-06T03:17:27.817521+0000","last_clean":"2023-10-06T03:17:27.817521+0000","last_became_active":"2023-10-06T03:17:26.823616+0000","last_became_peered":"2023-10-06T03:17:26.823616+0000","last_unstale":"2023-10-06T03:17:27.817521+0000","last_undegraded":"2023-10-06T03:17:27.817521+0000","last_fullsized":"2023-10-06T03:17:27.817521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:02.667157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836543+0000","last_change":"2023-10-06T03:17:27.836543+0000","last_active":"2023-10-06T03:17:27.836543+0000","last_peered":"2023-10-06T03:17:27.836543+0000","last_clean":"2023-10-06T03:17:27.836543+0000","last_became_active":"2023-10-06T03:17:27.836282+0000","last_became_peered":"2023-10-06T03:17:27.836282+0000","last_unstale":"2023-10-06T03:17:27.836543+0000","last_undegraded":"2023-10-06T03:17:27.836543+0000","last_fullsized":"2023-10-06T03:17:27.836543+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:11.636278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"54'3","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847539+0000","last_change":"2023-10-06T03:17:26.822470+0000","last_active":"2023-10-06T03:17:27.847539+0000","last_peered":"2023-10-06T03:17:27.847539+0000","last_clean":"2023-10-06T03:17:27.847539+0000","last_became_active":"2023-10-06T03:17:26.822191+0000","last_became_peered":"2023-10-06T03:17:26.822191+0000","last_unstale":"2023-10-06T03:17:27.847539+0000","last_undegraded":"2023-10-06T03:17:27.847539+0000","last_fullsized":"2023-10-06T03:17:27.847539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:19.878385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.833948+0000","last_change":"2023-10-06T03:17:27.827143+0000","last_active":"2023-10-06T03:17:27.833948+0000","last_peered":"2023-10-06T03:17:27.833948+0000","last_clean":"2023-10-06T03:17:27.833948+0000","last_became_active":"2023-10-06T03:17:27.825159+0000","last_became_peered":"2023-10-06T03:17:27.825159+0000","last_unstale":"2023-10-06T03:17:27.833948+0000","last_undegraded":"2023-10-06T03:17:27.833948+0000","last_fullsized":"2023-10-06T03:17:27.833948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:09.923870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"54'6","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836041+0000","last_change":"2023-10-06T03:17:26.823682+0000","last_active":"2023-10-06T03:17:27.836041+0000","last_peered":"2023-10-06T03:17:27.836041+0000","last_clean":"2023-10-06T03:17:27.836041+0000","last_became_active":"2023-10-06T03:17:26.823503+0000","last_became_peered":"2023-10-06T03:17:26.823503+0000","last_unstale":"2023-10-06T03:17:27.836041+0000","last_undegraded":"2023-10-06T03:17:27.836041+0000","last_fullsized":"2023-10-06T03:17:27.836041+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:43.867675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.837495+0000","last_change":"2023-10-06T03:17:27.831003+0000","last_active":"2023-10-06T03:17:27.837495+0000","last_peered":"2023-10-06T03:17:27.837495+0000","last_clean":"2023-10-06T03:17:27.837495+0000","last_became_active":"2023-10-06T03:17:27.829906+0000","last_became_peered":"2023-10-06T03:17:27.829906+0000","last_unstale":"2023-10-06T03:17:27.837495+0000","last_undegraded":"2023-10-06T03:17:27.837495+0000","last_fullsized":"2023-10-06T03:17:27.837495+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:36.211064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847407+0000","last_change":"2023-10-06T03:17:26.821788+0000","last_active":"2023-10-06T03:17:27.847407+0000","last_peered":"2023-10-06T03:17:27.847407+0000","last_clean":"2023-10-06T03:17:27.847407+0000","last_became_active":"2023-10-06T03:17:26.821503+0000","last_became_peered":"2023-10-06T03:17:26.821503+0000","last_unstale":"2023-10-06T03:17:27.847407+0000","last_undegraded":"2023-10-06T03:17:27.847407+0000","last_fullsized":"2023-10-06T03:17:27.847407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:08.917005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835771+0000","last_change":"2023-10-06T03:17:27.824409+0000","last_active":"2023-10-06T03:17:27.835771+0000","last_peered":"2023-10-06T03:17:27.835771+0000","last_clean":"2023-10-06T03:17:27.835771+0000","last_became_active":"2023-10-06T03:17:27.823084+0000","last_became_peered":"2023-10-06T03:17:27.823084+0000","last_unstale":"2023-10-06T03:17:27.835771+0000","last_undegraded":"2023-10-06T03:17:27.835771+0000","last_fullsized":"2023-10-06T03:17:27.835771+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:20.600195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818947+0000","last_change":"2023-10-06T03:17:26.812016+0000","last_active":"2023-10-06T03:17:27.818947+0000","last_peered":"2023-10-06T03:17:27.818947+0000","last_clean":"2023-10-06T03:17:27.818947+0000","last_became_active":"2023-10-06T03:17:26.811688+0000","last_became_peered":"2023-10-06T03:17:26.811688+0000","last_unstale":"2023-10-06T03:17:27.818947+0000","last_undegraded":"2023-10-06T03:17:27.818947+0000","last_fullsized":"2023-10-06T03:17:27.818947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:21.249378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828188+0000","last_change":"2023-10-06T03:17:27.828188+0000","last_active":"2023-10-06T03:17:27.828188+0000","last_peered":"2023-10-06T03:17:27.828188+0000","last_clean":"2023-10-06T03:17:27.828188+0000","last_became_active":"2023-10-06T03:17:27.827576+0000","last_became_peered":"2023-10-06T03:17:27.827576+0000","last_unstale":"2023-10-06T03:17:27.828188+0000","last_undegraded":"2023-10-06T03:17:27.828188+0000","last_fullsized":"2023-10-06T03:17:27.828188+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:27.034375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.823264+0000","last_change":"2023-10-06T03:17:26.820476+0000","last_active":"2023-10-06T03:17:27.823264+0000","last_peered":"2023-10-06T03:17:27.823264+0000","last_clean":"2023-10-06T03:17:27.823264+0000","last_became_active":"2023-10-06T03:17:26.820217+0000","last_became_peered":"2023-10-06T03:17:26.820217+0000","last_unstale":"2023-10-06T03:17:27.823264+0000","last_undegraded":"2023-10-06T03:17:27.823264+0000","last_fullsized":"2023-10-06T03:17:27.823264+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:09.202165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830337+0000","last_change":"2023-10-06T03:17:27.830337+0000","last_active":"2023-10-06T03:17:27.830337+0000","last_peered":"2023-10-06T03:17:27.830337+0000","last_clean":"2023-10-06T03:17:27.830337+0000","last_became_active":"2023-10-06T03:17:27.830066+0000","last_became_peered":"2023-10-06T03:17:27.830066+0000","last_unstale":"2023-10-06T03:17:27.830337+0000","last_undegraded":"2023-10-06T03:17:27.830337+0000","last_fullsized":"2023-10-06T03:17:27.830337+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.084282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'8","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847799+0000","last_change":"2023-10-06T03:17:26.822412+0000","last_active":"2023-10-06T03:17:27.847799+0000","last_peered":"2023-10-06T03:17:27.847799+0000","last_clean":"2023-10-06T03:17:27.847799+0000","last_became_active":"2023-10-06T03:17:26.822163+0000","last_became_peered":"2023-10-06T03:17:26.822163+0000","last_unstale":"2023-10-06T03:17:27.847799+0000","last_undegraded":"2023-10-06T03:17:27.847799+0000","last_fullsized":"2023-10-06T03:17:27.847799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:38.886862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824761+0000","last_change":"2023-10-06T03:17:27.819156+0000","last_active":"2023-10-06T03:17:27.824761+0000","last_peered":"2023-10-06T03:17:27.824761+0000","last_clean":"2023-10-06T03:17:27.824761+0000","last_became_active":"2023-10-06T03:17:27.818942+0000","last_became_peered":"2023-10-06T03:17:27.818942+0000","last_unstale":"2023-10-06T03:17:27.824761+0000","last_undegraded":"2023-10-06T03:17:27.824761+0000","last_fullsized":"2023-10-06T03:17:27.824761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:04.127117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.839255+0000","last_change":"2023-10-06T03:17:26.817960+0000","last_active":"2023-10-06T03:17:27.839255+0000","last_peered":"2023-10-06T03:17:27.839255+0000","last_clean":"2023-10-06T03:17:27.839255+0000","last_became_active":"2023-10-06T03:17:26.817690+0000","last_became_peered":"2023-10-06T03:17:26.817690+0000","last_unstale":"2023-10-06T03:17:27.839255+0000","last_undegraded":"2023-10-06T03:17:27.839255+0000","last_fullsized":"2023-10-06T03:17:27.839255+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.639035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.825336+0000","last_change":"2023-10-06T03:17:27.822730+0000","last_active":"2023-10-06T03:17:27.825336+0000","last_peered":"2023-10-06T03:17:27.825336+0000","last_clean":"2023-10-06T03:17:27.825336+0000","last_became_active":"2023-10-06T03:17:27.822437+0000","last_became_peered":"2023-10-06T03:17:27.822437+0000","last_unstale":"2023-10-06T03:17:27.825336+0000","last_undegraded":"2023-10-06T03:17:27.825336+0000","last_fullsized":"2023-10-06T03:17:27.825336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:25.773902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.819054+0000","last_change":"2023-10-06T03:17:26.809521+0000","last_active":"2023-10-06T03:17:27.819054+0000","last_peered":"2023-10-06T03:17:27.819054+0000","last_clean":"2023-10-06T03:17:27.819054+0000","last_became_active":"2023-10-06T03:17:26.809224+0000","last_became_peered":"2023-10-06T03:17:26.809224+0000","last_unstale":"2023-10-06T03:17:27.819054+0000","last_undegraded":"2023-10-06T03:17:27.819054+0000","last_fullsized":"2023-10-06T03:17:27.819054+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:26.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835774+0000","last_change":"2023-10-06T03:17:27.824741+0000","last_active":"2023-10-06T03:17:27.835774+0000","last_peered":"2023-10-06T03:17:27.835774+0000","last_clean":"2023-10-06T03:17:27.835774+0000","last_became_active":"2023-10-06T03:17:27.823415+0000","last_became_peered":"2023-10-06T03:17:27.823415+0000","last_unstale":"2023-10-06T03:17:27.835774+0000","last_undegraded":"2023-10-06T03:17:27.835774+0000","last_fullsized":"2023-10-06T03:17:27.835774+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:38.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.814104+0000","last_change":"2023-10-06T03:17:26.813527+0000","last_active":"2023-10-06T03:17:27.814104+0000","last_peered":"2023-10-06T03:17:27.814104+0000","last_clean":"2023-10-06T03:17:27.814104+0000","last_became_active":"2023-10-06T03:17:26.813259+0000","last_became_peered":"2023-10-06T03:17:26.813259+0000","last_unstale":"2023-10-06T03:17:27.814104+0000","last_undegraded":"2023-10-06T03:17:27.814104+0000","last_fullsized":"2023-10-06T03:17:27.814104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:33.467736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828587+0000","last_change":"2023-10-06T03:17:27.828587+0000","last_active":"2023-10-06T03:17:27.828587+0000","last_peered":"2023-10-06T03:17:27.828587+0000","last_clean":"2023-10-06T03:17:27.828587+0000","last_became_active":"2023-10-06T03:17:27.828375+0000","last_became_peered":"2023-10-06T03:17:27.828375+0000","last_unstale":"2023-10-06T03:17:27.828587+0000","last_undegraded":"2023-10-06T03:17:27.828587+0000","last_fullsized":"2023-10-06T03:17:27.828587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:19.640429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.826024+0000","last_change":"2023-10-06T03:17:26.823348+0000","last_active":"2023-10-06T03:17:26.826024+0000","last_peered":"2023-10-06T03:17:26.826024+0000","last_clean":"2023-10-06T03:17:26.826024+0000","last_became_active":"2023-10-06T03:17:26.823142+0000","last_became_peered":"2023-10-06T03:17:26.823142+0000","last_unstale":"2023-10-06T03:17:26.826024+0000","last_undegraded":"2023-10-06T03:17:26.826024+0000","last_fullsized":"2023-10-06T03:17:26.826024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:50.671962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.825437+0000","last_change":"2023-10-06T03:17:27.825437+0000","last_active":"2023-10-06T03:17:27.825437+0000","last_peered":"2023-10-06T03:17:27.825437+0000","last_clean":"2023-10-06T03:17:27.825437+0000","last_became_active":"2023-10-06T03:17:27.824516+0000","last_became_peered":"2023-10-06T03:17:27.824516+0000","last_unstale":"2023-10-06T03:17:27.825437+0000","last_undegraded":"2023-10-06T03:17:27.825437+0000","last_fullsized":"2023-10-06T03:17:27.825437+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:37.529961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.823530+0000","last_change":"2023-10-06T03:17:26.820595+0000","last_active":"2023-10-06T03:17:27.823530+0000","last_peered":"2023-10-06T03:17:27.823530+0000","last_clean":"2023-10-06T03:17:27.823530+0000","last_became_active":"2023-10-06T03:17:26.820314+0000","last_became_peered":"2023-10-06T03:17:26.820314+0000","last_unstale":"2023-10-06T03:17:27.823530+0000","last_undegraded":"2023-10-06T03:17:27.823530+0000","last_fullsized":"2023-10-06T03:17:27.823530+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:12.487909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835483+0000","last_change":"2023-10-06T03:17:27.830954+0000","last_active":"2023-10-06T03:17:27.835483+0000","last_peered":"2023-10-06T03:17:27.835483+0000","last_clean":"2023-10-06T03:17:27.835483+0000","last_became_active":"2023-10-06T03:17:27.829559+0000","last_became_peered":"2023-10-06T03:17:27.829559+0000","last_unstale":"2023-10-06T03:17:27.835483+0000","last_undegraded":"2023-10-06T03:17:27.835483+0000","last_fullsized":"2023-10-06T03:17:27.835483+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:20.885250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816035+0000","last_change":"2023-10-06T03:17:26.809924+0000","last_active":"2023-10-06T03:17:27.816035+0000","last_peered":"2023-10-06T03:17:27.816035+0000","last_clean":"2023-10-06T03:17:27.816035+0000","last_became_active":"2023-10-06T03:17:26.809704+0000","last_became_peered":"2023-10-06T03:17:26.809704+0000","last_unstale":"2023-10-06T03:17:27.816035+0000","last_undegraded":"2023-10-06T03:17:27.816035+0000","last_fullsized":"2023-10-06T03:17:27.816035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:33.467736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.820556+0000","last_change":"2023-10-06T03:17:27.820556+0000","last_active":"2023-10-06T03:17:27.820556+0000","last_peered":"2023-10-06T03:17:27.820556+0000","last_clean":"2023-10-06T03:17:27.820556+0000","last_became_active":"2023-10-06T03:17:27.820287+0000","last_became_peered":"2023-10-06T03:17:27.820287+0000","last_unstale":"2023-10-06T03:17:27.820556+0000","last_undegraded":"2023-10-06T03:17:27.820556+0000","last_fullsized":"2023-10-06T03:17:27.820556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:27.034375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816467+0000","last_change":"2023-10-06T03:17:26.814908+0000","last_active":"2023-10-06T03:17:27.816467+0000","last_peered":"2023-10-06T03:17:27.816467+0000","last_clean":"2023-10-06T03:17:27.816467+0000","last_became_active":"2023-10-06T03:17:26.814631+0000","last_became_peered":"2023-10-06T03:17:26.814631+0000","last_unstale":"2023-10-06T03:17:27.816467+0000","last_undegraded":"2023-10-06T03:17:27.816467+0000","last_fullsized":"2023-10-06T03:17:27.816467+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:37.371353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.841586+0000","last_change":"2023-10-06T03:17:27.837432+0000","last_active":"2023-10-06T03:17:27.841586+0000","last_peered":"2023-10-06T03:17:27.841586+0000","last_clean":"2023-10-06T03:17:27.841586+0000","last_became_active":"2023-10-06T03:17:27.837133+0000","last_became_peered":"2023-10-06T03:17:27.837133+0000","last_unstale":"2023-10-06T03:17:27.841586+0000","last_undegraded":"2023-10-06T03:17:27.841586+0000","last_fullsized":"2023-10-06T03:17:27.841586+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:37.829631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.820315+0000","last_change":"2023-10-06T03:17:26.817267+0000","last_active":"2023-10-06T03:17:26.820315+0000","last_peered":"2023-10-06T03:17:26.820315+0000","last_clean":"2023-10-06T03:17:26.820315+0000","last_became_active":"2023-10-06T03:17:26.817030+0000","last_became_peered":"2023-10-06T03:17:26.817030+0000","last_unstale":"2023-10-06T03:17:26.820315+0000","last_undegraded":"2023-10-06T03:17:26.820315+0000","last_fullsized":"2023-10-06T03:17:26.820315+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:38.055277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.833543+0000","last_change":"2023-10-06T03:17:27.827825+0000","last_active":"2023-10-06T03:17:27.833543+0000","last_peered":"2023-10-06T03:17:27.833543+0000","last_clean":"2023-10-06T03:17:27.833543+0000","last_became_active":"2023-10-06T03:17:27.827576+0000","last_became_peered":"2023-10-06T03:17:27.827576+0000","last_unstale":"2023-10-06T03:17:27.833543+0000","last_undegraded":"2023-10-06T03:17:27.833543+0000","last_fullsized":"2023-10-06T03:17:27.833543+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:34.474601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847469+0000","last_change":"2023-10-06T03:17:26.822552+0000","last_active":"2023-10-06T03:17:27.847469+0000","last_peered":"2023-10-06T03:17:27.847469+0000","last_clean":"2023-10-06T03:17:27.847469+0000","last_became_active":"2023-10-06T03:17:26.822247+0000","last_became_peered":"2023-10-06T03:17:26.822247+0000","last_unstale":"2023-10-06T03:17:27.847469+0000","last_undegraded":"2023-10-06T03:17:27.847469+0000","last_fullsized":"2023-10-06T03:17:27.847469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:29.807193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.817385+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:17:27.817385+0000","last_peered":"2023-10-06T03:17:27.817385+0000","last_clean":"2023-10-06T03:17:27.817385+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:27.817385+0000","last_undegraded":"2023-10-06T03:17:27.817385+0000","last_fullsized":"2023-10-06T03:17:27.817385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.832515+0000","last_change":"2023-10-06T03:17:27.832515+0000","last_active":"2023-10-06T03:17:27.832515+0000","last_peered":"2023-10-06T03:17:27.832515+0000","last_clean":"2023-10-06T03:17:27.832515+0000","last_became_active":"2023-10-06T03:17:27.832153+0000","last_became_peered":"2023-10-06T03:17:27.832153+0000","last_unstale":"2023-10-06T03:17:27.832515+0000","last_undegraded":"2023-10-06T03:17:27.832515+0000","last_fullsized":"2023-10-06T03:17:27.832515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:03.674022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816651+0000","last_change":"2023-10-06T03:17:26.826792+0000","last_active":"2023-10-06T03:17:27.816651+0000","last_peered":"2023-10-06T03:17:27.816651+0000","last_clean":"2023-10-06T03:17:27.816651+0000","last_became_active":"2023-10-06T03:17:26.826518+0000","last_became_peered":"2023-10-06T03:17:26.826518+0000","last_unstale":"2023-10-06T03:17:27.816651+0000","last_undegraded":"2023-10-06T03:17:27.816651+0000","last_fullsized":"2023-10-06T03:17:27.816651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:35.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816725+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:17:27.816725+0000","last_peered":"2023-10-06T03:17:27.816725+0000","last_clean":"2023-10-06T03:17:27.816725+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:27.816725+0000","last_undegraded":"2023-10-06T03:17:27.816725+0000","last_fullsized":"2023-10-06T03:17:27.816725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.821994+0000","last_change":"2023-10-06T03:17:27.817911+0000","last_active":"2023-10-06T03:17:27.821994+0000","last_peered":"2023-10-06T03:17:27.821994+0000","last_clean":"2023-10-06T03:17:27.821994+0000","last_became_active":"2023-10-06T03:17:27.817689+0000","last_became_peered":"2023-10-06T03:17:27.817689+0000","last_unstale":"2023-10-06T03:17:27.821994+0000","last_undegraded":"2023-10-06T03:17:27.821994+0000","last_fullsized":"2023-10-06T03:17:27.821994+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:18.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.842030+0000","last_change":"2023-10-06T03:17:26.817721+0000","last_active":"2023-10-06T03:17:27.842030+0000","last_peered":"2023-10-06T03:17:27.842030+0000","last_clean":"2023-10-06T03:17:27.842030+0000","last_became_active":"2023-10-06T03:17:26.817468+0000","last_became_peered":"2023-10-06T03:17:26.817468+0000","last_unstale":"2023-10-06T03:17:27.842030+0000","last_undegraded":"2023-10-06T03:17:27.842030+0000","last_fullsized":"2023-10-06T03:17:27.842030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:49.631031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.799416+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:17:26.799416+0000","last_peered":"2023-10-06T03:17:26.799416+0000","last_clean":"2023-10-06T03:17:26.799416+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:26.799416+0000","last_undegraded":"2023-10-06T03:17:26.799416+0000","last_fullsized":"2023-10-06T03:17:26.799416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.822898+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:17:27.822898+0000","last_peered":"2023-10-06T03:17:27.822898+0000","last_clean":"2023-10-06T03:17:27.822898+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:17:27.822898+0000","last_undegraded":"2023-10-06T03:17:27.822898+0000","last_fullsized":"2023-10-06T03:17:27.822898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835745+0000","last_change":"2023-10-06T03:17:27.824301+0000","last_active":"2023-10-06T03:17:27.835745+0000","last_peered":"2023-10-06T03:17:27.835745+0000","last_clean":"2023-10-06T03:17:27.835745+0000","last_became_active":"2023-10-06T03:17:27.824007+0000","last_became_peered":"2023-10-06T03:17:27.824007+0000","last_unstale":"2023-10-06T03:17:27.835745+0000","last_undegraded":"2023-10-06T03:17:27.835745+0000","last_fullsized":"2023-10-06T03:17:27.835745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:50.151603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818602+0000","last_change":"2023-10-06T03:17:26.814980+0000","last_active":"2023-10-06T03:17:27.818602+0000","last_peered":"2023-10-06T03:17:27.818602+0000","last_clean":"2023-10-06T03:17:27.818602+0000","last_became_active":"2023-10-06T03:17:26.814685+0000","last_became_peered":"2023-10-06T03:17:26.814685+0000","last_unstale":"2023-10-06T03:17:27.818602+0000","last_undegraded":"2023-10-06T03:17:27.818602+0000","last_fullsized":"2023-10-06T03:17:27.818602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:38.886862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828445+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:17:27.828445+0000","last_peered":"2023-10-06T03:17:27.828445+0000","last_clean":"2023-10-06T03:17:27.828445+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:27.828445+0000","last_undegraded":"2023-10-06T03:17:27.828445+0000","last_fullsized":"2023-10-06T03:17:27.828445+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.827930+0000","last_change":"2023-10-06T03:17:27.827930+0000","last_active":"2023-10-06T03:17:27.827930+0000","last_peered":"2023-10-06T03:17:27.827930+0000","last_clean":"2023-10-06T03:17:27.827930+0000","last_became_active":"2023-10-06T03:17:27.827409+0000","last_became_peered":"2023-10-06T03:17:27.827409+0000","last_unstale":"2023-10-06T03:17:27.827930+0000","last_undegraded":"2023-10-06T03:17:27.827930+0000","last_fullsized":"2023-10-06T03:17:27.827930+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:39.893727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.815725+0000","last_change":"2023-10-06T03:17:26.814218+0000","last_active":"2023-10-06T03:17:27.815725+0000","last_peered":"2023-10-06T03:17:27.815725+0000","last_clean":"2023-10-06T03:17:27.815725+0000","last_became_active":"2023-10-06T03:17:26.813958+0000","last_became_peered":"2023-10-06T03:17:26.813958+0000","last_unstale":"2023-10-06T03:17:27.815725+0000","last_undegraded":"2023-10-06T03:17:27.815725+0000","last_fullsized":"2023-10-06T03:17:27.815725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.311874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.822992+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:17:27.822992+0000","last_peered":"2023-10-06T03:17:27.822992+0000","last_clean":"2023-10-06T03:17:27.822992+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:27.822992+0000","last_undegraded":"2023-10-06T03:17:27.822992+0000","last_fullsized":"2023-10-06T03:17:27.822992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828037+0000","last_change":"2023-10-06T03:17:27.828037+0000","last_active":"2023-10-06T03:17:27.828037+0000","last_peered":"2023-10-06T03:17:27.828037+0000","last_clean":"2023-10-06T03:17:27.828037+0000","last_became_active":"2023-10-06T03:17:27.827311+0000","last_became_peered":"2023-10-06T03:17:27.827311+0000","last_unstale":"2023-10-06T03:17:27.828037+0000","last_undegraded":"2023-10-06T03:17:27.828037+0000","last_fullsized":"2023-10-06T03:17:27.828037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:27.281636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.813655+0000","last_change":"2023-10-06T03:17:26.815755+0000","last_active":"2023-10-06T03:17:27.813655+0000","last_peered":"2023-10-06T03:17:27.813655+0000","last_clean":"2023-10-06T03:17:27.813655+0000","last_became_active":"2023-10-06T03:17:26.815511+0000","last_became_peered":"2023-10-06T03:17:26.815511+0000","last_unstale":"2023-10-06T03:17:27.813655+0000","last_undegraded":"2023-10-06T03:17:27.813655+0000","last_fullsized":"2023-10-06T03:17:27.813655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:49.208638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818549+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:17:27.818549+0000","last_peered":"2023-10-06T03:17:27.818549+0000","last_clean":"2023-10-06T03:17:27.818549+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:27.818549+0000","last_undegraded":"2023-10-06T03:17:27.818549+0000","last_fullsized":"2023-10-06T03:17:27.818549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.834973+0000","last_change":"2023-10-06T03:17:27.834973+0000","last_active":"2023-10-06T03:17:27.834973+0000","last_peered":"2023-10-06T03:17:27.834973+0000","last_clean":"2023-10-06T03:17:27.834973+0000","last_became_active":"2023-10-06T03:17:27.834706+0000","last_became_peered":"2023-10-06T03:17:27.834706+0000","last_unstale":"2023-10-06T03:17:27.834973+0000","last_undegraded":"2023-10-06T03:17:27.834973+0000","last_fullsized":"2023-10-06T03:17:27.834973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.645900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847470+0000","last_change":"2023-10-06T03:17:26.822789+0000","last_active":"2023-10-06T03:17:27.847470+0000","last_peered":"2023-10-06T03:17:27.847470+0000","last_clean":"2023-10-06T03:17:27.847470+0000","last_became_active":"2023-10-06T03:17:26.822421+0000","last_became_peered":"2023-10-06T03:17:26.822421+0000","last_unstale":"2023-10-06T03:17:27.847470+0000","last_undegraded":"2023-10-06T03:17:27.847470+0000","last_fullsized":"2023-10-06T03:17:27.847470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:33.511298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.812631+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:17:26.812631+0000","last_peered":"2023-10-06T03:17:26.812631+0000","last_clean":"2023-10-06T03:17:26.812631+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:26.812631+0000","last_undegraded":"2023-10-06T03:17:26.812631+0000","last_fullsized":"2023-10-06T03:17:26.812631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.843992+0000","last_change":"2023-10-06T03:17:27.837562+0000","last_active":"2023-10-06T03:17:27.843992+0000","last_peered":"2023-10-06T03:17:27.843992+0000","last_clean":"2023-10-06T03:17:27.843992+0000","last_became_active":"2023-10-06T03:17:27.837311+0000","last_became_peered":"2023-10-06T03:17:27.837311+0000","last_unstale":"2023-10-06T03:17:27.843992+0000","last_undegraded":"2023-10-06T03:17:27.843992+0000","last_fullsized":"2023-10-06T03:17:27.843992+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:17.276579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.839179+0000","last_change":"2023-10-06T03:17:26.810669+0000","last_active":"2023-10-06T03:17:27.839179+0000","last_peered":"2023-10-06T03:17:27.839179+0000","last_clean":"2023-10-06T03:17:27.839179+0000","last_became_active":"2023-10-06T03:17:26.810045+0000","last_became_peered":"2023-10-06T03:17:26.810045+0000","last_unstale":"2023-10-06T03:17:27.839179+0000","last_undegraded":"2023-10-06T03:17:27.839179+0000","last_fullsized":"2023-10-06T03:17:27.839179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:25.077417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.813198+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:17:26.813198+0000","last_peered":"2023-10-06T03:17:26.813198+0000","last_clean":"2023-10-06T03:17:26.813198+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:26.813198+0000","last_undegraded":"2023-10-06T03:17:26.813198+0000","last_fullsized":"2023-10-06T03:17:26.813198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":876104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.62},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.73199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":278381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.505},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.436}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.628},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298528,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073312,"statfs":{"total":96636764160,"available":96331071488,"internally_reserved":0,"allocated":1269760,"data_stored":872340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.29799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.255},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.873}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.79500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":278347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.376},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.25800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.31},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.34300000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":278347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.25},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.26800000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.6960000000000002,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.29799999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.502},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.497}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.42599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":281236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":279722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.498}]},{"osd":2,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.623}]},{"osd":4,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:17:31.868 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:17:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.014+0000 7fc682e84700 1 Processor -- start 2023-10-06T03:17:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.014+0000 7fc682e84700 1 -- start start 2023-10-06T03:17:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc682e84700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d560 0x7fc67c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc682e84700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc67c1591b0 0x7fc67c159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc682e84700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c0b2ad0 con 0x7fc67c15d930 2023-10-06T03:17:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc682e84700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c0b4160 con 0x7fc67c1591b0 2023-10-06T03:17:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc682e84700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c159b70 con 0x7fc67c15d560 2023-10-06T03:17:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc681421700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc67c1591b0 0x7fc67c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc67bfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc67c15d930 0x7fc67c0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34692/0 (socket says 172.21.15.82:34692) 2023-10-06T03:17:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc67bfff700 1 -- 172.21.15.82:0/3883673776 learned_addr learned my addr 172.21.15.82:0/3883673776 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc681421700 1 -- 172.21.15.82:0/3883673776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d560 msgr2=0x7fc67c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc680c20700 1 --2- 172.21.15.82:0/3883673776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d560 0x7fc67c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc681421700 1 --2- 172.21.15.82:0/3883673776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d560 0x7fc67c0d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc67b7fe700 1 -- 172.21.15.82:0/3883673776 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433433706 0 0) 0x7fc67c0b2ad0 con 0x7fc67c15d930 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc681421700 1 -- 172.21.15.82:0/3883673776 >> v1:172.21.15.82:6789/0 conn(0x7fc67c15d930 legacy=0x7fc67c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc681421700 1 -- 172.21.15.82:0/3883673776 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0b2230 con 0x7fc67c1591b0 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.015+0000 7fc681421700 1 --2- 172.21.15.82:0/3883673776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c1591b0 0x7fc67c159630 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc6640098e0 tx=0x7fc6640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee98ac1798358c2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc67b7fe700 1 -- 172.21.15.82:0/3883673776 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664009e80 con 0x7fc67c1591b0 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc67b7fe700 1 -- 172.21.15.82:0/3883673776 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66400b860 con 0x7fc67c1591b0 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc67b7fe700 1 -- 172.21.15.82:0/3883673776 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400bbe0 con 0x7fc67c1591b0 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc682e84700 1 -- 172.21.15.82:0/3883673776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c1591b0 msgr2=0x7fc67c159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc682e84700 1 --2- 172.21.15.82:0/3883673776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c1591b0 0x7fc67c159630 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc6640098e0 tx=0x7fc6640091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc682e84700 1 -- 172.21.15.82:0/3883673776 shutdown_connections 2023-10-06T03:17:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc682e84700 1 --2- 172.21.15.82:0/3883673776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c1591b0 0x7fc67c159630 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc682e84700 1 --2- 172.21.15.82:0/3883673776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d560 0x7fc67c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc682e84700 1 -- 172.21.15.82:0/3883673776 >> 172.21.15.82:0/3883673776 conn(0x7fc67c0d1180 msgr2=0x7fc67c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc682e84700 1 -- 172.21.15.82:0/3883673776 shutdown_connections 2023-10-06T03:17:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.016+0000 7fc682e84700 1 -- 172.21.15.82:0/3883673776 wait complete. 2023-10-06T03:17:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.017+0000 7fc682e84700 1 Processor -- start 2023-10-06T03:17:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.017+0000 7fc682e84700 1 -- start start 2023-10-06T03:17:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc682e84700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc67c1591b0 0x7fc67c0c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc682e84700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c15d560 0x7fc67c0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc682e84700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d930 0x7fc67c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc682e84700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c15b3d0 con 0x7fc67c15d560 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc682e84700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0cd410 con 0x7fc67c1591b0 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc682e84700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c15ac70 con 0x7fc67c15d930 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc67bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c15d560 0x7fc67c0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc67bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c15d560 0x7fc67c0cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50974/0 (socket says 172.21.15.82:50974) 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc67bfff700 1 -- 172.21.15.82:0/1694725591 learned_addr learned my addr 172.21.15.82:0/1694725591 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc67bfff700 1 -- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d930 msgr2=0x7fc67c15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc67bfff700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d930 0x7fc67c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc67bfff700 1 -- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc67c1591b0 msgr2=0x7fc67c0c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc67bfff700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc67c1591b0 0x7fc67c0c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.018+0000 7fc67bfff700 1 -- 172.21.15.82:0/1694725591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664009420 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.019+0000 7fc67bfff700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c15d560 0x7fc67c0cced0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00ccf0 tx=0x7fc66c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.019+0000 7fc678ff9700 1 -- 172.21.15.82:0/1694725591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c00ab30 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.019+0000 7fc678ff9700 1 -- 172.21.15.82:0/1694725591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c00ac90 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.019+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c0c5ae0 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.019+0000 7fc678ff9700 1 -- 172.21.15.82:0/1694725591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c007340 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.019+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c15b060 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.020+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c0c6000 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.020+0000 7fc678ff9700 1 -- 172.21.15.82:0/1694725591 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc66c007770 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.020+0000 7fc678ff9700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc65c066f30 0x7fc65c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.020+0000 7fc678ff9700 1 -- 172.21.15.82:0/1694725591 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc66c084b20 con 0x7fc67c15d560 2023-10-06T03:17:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.021+0000 7fc680c20700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc65c066f30 0x7fc65c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.021+0000 7fc680c20700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc65c066f30 0x7fc65c0693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc674007970 tx=0x7fc674008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.025+0000 7fc678ff9700 1 -- 172.21.15.82:0/1694725591 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc67c0c6000 con 0x7fc67c15d560 2023-10-06T03:17:32.101 INFO:tasks.ceph.mds.a.smithi082.stderr:2023-10-06T03:17:32.099+0000 7f54171e3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:17:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.203+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc67c15aec0 con 0x7fc65c066f30 2023-10-06T03:17:32.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.212+0000 7fc678ff9700 1 -- 172.21.15.82:0/1694725591 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311625 (secure 0 0 0) 0x7fc67c15aec0 con 0x7fc65c066f30 2023-10-06T03:17:32.217 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:32.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc65c066f30 msgr2=0x7fc65c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc65c066f30 0x7fc65c0693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc674007970 tx=0x7fc674008040 comp rx=0 tx=0).stop 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c15d560 msgr2=0x7fc67c0cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c15d560 0x7fc67c0cced0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00ccf0 tx=0x7fc66c001a80 comp rx=0 tx=0).stop 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 shutdown_connections 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc65c066f30 0x7fc65c0693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc67c15d930 0x7fc67c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc67c1591b0 0x7fc67c0c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 --2- 172.21.15.82:0/1694725591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c15d560 0x7fc67c0cced0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 >> 172.21.15.82:0/1694725591 conn(0x7fc67c0d1180 msgr2=0x7fc67c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 shutdown_connections 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.215+0000 7fc682e84700 1 -- 172.21.15.82:0/1694725591 wait complete. 2023-10-06T03:17:32.221 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:17:32.228 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-10-06T03:17:31.172115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384588,"kb_used_data":6284,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590132,"statfs":{"total":773094113280,"available":770652295168,"internally_reserved":0,"allocated":6434816,"data_stored":3429465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.375851"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836990+0000","last_change":"2023-10-06T03:17:27.836990+0000","last_active":"2023-10-06T03:17:27.836990+0000","last_peered":"2023-10-06T03:17:27.836990+0000","last_clean":"2023-10-06T03:17:27.836990+0000","last_became_active":"2023-10-06T03:17:27.836751+0000","last_became_peered":"2023-10-06T03:17:27.836751+0000","last_unstale":"2023-10-06T03:17:27.836990+0000","last_undegraded":"2023-10-06T03:17:27.836990+0000","last_fullsized":"2023-10-06T03:17:27.836990+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:39.893727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.819863+0000","last_change":"2023-10-06T03:17:27.819863+0000","last_active":"2023-10-06T03:17:27.819863+0000","last_peered":"2023-10-06T03:17:27.819863+0000","last_clean":"2023-10-06T03:17:27.819863+0000","last_became_active":"2023-10-06T03:17:27.819587+0000","last_became_peered":"2023-10-06T03:17:27.819587+0000","last_unstale":"2023-10-06T03:17:27.819863+0000","last_undegraded":"2023-10-06T03:17:27.819863+0000","last_fullsized":"2023-10-06T03:17:27.819863+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:19.640429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847238+0000","last_change":"2023-10-06T03:17:27.840037+0000","last_active":"2023-10-06T03:17:27.847238+0000","last_peered":"2023-10-06T03:17:27.847238+0000","last_clean":"2023-10-06T03:17:27.847238+0000","last_became_active":"2023-10-06T03:17:27.839630+0000","last_became_peered":"2023-10-06T03:17:27.839630+0000","last_unstale":"2023-10-06T03:17:27.847238+0000","last_undegraded":"2023-10-06T03:17:27.847238+0000","last_fullsized":"2023-10-06T03:17:27.847238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:58.173143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830611+0000","last_change":"2023-10-06T03:17:27.824806+0000","last_active":"2023-10-06T03:17:27.830611+0000","last_peered":"2023-10-06T03:17:27.830611+0000","last_clean":"2023-10-06T03:17:27.830611+0000","last_became_active":"2023-10-06T03:17:27.824548+0000","last_became_peered":"2023-10-06T03:17:27.824548+0000","last_unstale":"2023-10-06T03:17:27.830611+0000","last_undegraded":"2023-10-06T03:17:27.830611+0000","last_fullsized":"2023-10-06T03:17:27.830611+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:32.072425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.831814+0000","last_change":"2023-10-06T03:17:27.831814+0000","last_active":"2023-10-06T03:17:27.831814+0000","last_peered":"2023-10-06T03:17:27.831814+0000","last_clean":"2023-10-06T03:17:27.831814+0000","last_became_active":"2023-10-06T03:17:27.831550+0000","last_became_peered":"2023-10-06T03:17:27.831550+0000","last_unstale":"2023-10-06T03:17:27.831814+0000","last_undegraded":"2023-10-06T03:17:27.831814+0000","last_fullsized":"2023-10-06T03:17:27.831814+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:49.856690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.842815+0000","last_change":"2023-10-06T03:17:27.834382+0000","last_active":"2023-10-06T03:17:27.842815+0000","last_peered":"2023-10-06T03:17:27.842815+0000","last_clean":"2023-10-06T03:17:27.842815+0000","last_became_active":"2023-10-06T03:17:27.834113+0000","last_became_peered":"2023-10-06T03:17:27.834113+0000","last_unstale":"2023-10-06T03:17:27.842815+0000","last_undegraded":"2023-10-06T03:17:27.842815+0000","last_fullsized":"2023-10-06T03:17:27.842815+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.510541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830400+0000","last_change":"2023-10-06T03:17:27.829755+0000","last_active":"2023-10-06T03:17:27.830400+0000","last_peered":"2023-10-06T03:17:27.830400+0000","last_clean":"2023-10-06T03:17:27.830400+0000","last_became_active":"2023-10-06T03:17:27.829458+0000","last_became_peered":"2023-10-06T03:17:27.829458+0000","last_unstale":"2023-10-06T03:17:27.830400+0000","last_undegraded":"2023-10-06T03:17:27.830400+0000","last_fullsized":"2023-10-06T03:17:27.830400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:30.180629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.840873+0000","last_change":"2023-10-06T03:17:27.835463+0000","last_active":"2023-10-06T03:17:27.840873+0000","last_peered":"2023-10-06T03:17:27.840873+0000","last_clean":"2023-10-06T03:17:27.840873+0000","last_became_active":"2023-10-06T03:17:27.835193+0000","last_became_peered":"2023-10-06T03:17:27.835193+0000","last_unstale":"2023-10-06T03:17:27.840873+0000","last_undegraded":"2023-10-06T03:17:27.840873+0000","last_fullsized":"2023-10-06T03:17:27.840873+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:33.318739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.843955+0000","last_change":"2023-10-06T03:17:27.837322+0000","last_active":"2023-10-06T03:17:27.843955+0000","last_peered":"2023-10-06T03:17:27.843955+0000","last_clean":"2023-10-06T03:17:27.843955+0000","last_became_active":"2023-10-06T03:17:27.837048+0000","last_became_peered":"2023-10-06T03:17:27.837048+0000","last_unstale":"2023-10-06T03:17:27.843955+0000","last_undegraded":"2023-10-06T03:17:27.843955+0000","last_fullsized":"2023-10-06T03:17:27.843955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:18.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836742+0000","last_change":"2023-10-06T03:17:27.832741+0000","last_active":"2023-10-06T03:17:27.836742+0000","last_peered":"2023-10-06T03:17:27.836742+0000","last_clean":"2023-10-06T03:17:27.836742+0000","last_became_active":"2023-10-06T03:17:27.832499+0000","last_became_peered":"2023-10-06T03:17:27.832499+0000","last_unstale":"2023-10-06T03:17:27.836742+0000","last_undegraded":"2023-10-06T03:17:27.836742+0000","last_fullsized":"2023-10-06T03:17:27.836742+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:25.142593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830378+0000","last_change":"2023-10-06T03:17:27.822034+0000","last_active":"2023-10-06T03:17:27.830378+0000","last_peered":"2023-10-06T03:17:27.830378+0000","last_clean":"2023-10-06T03:17:27.830378+0000","last_became_active":"2023-10-06T03:17:27.821738+0000","last_became_peered":"2023-10-06T03:17:27.821738+0000","last_unstale":"2023-10-06T03:17:27.830378+0000","last_undegraded":"2023-10-06T03:17:27.830378+0000","last_fullsized":"2023-10-06T03:17:27.830378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:50.637897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835935+0000","last_change":"2023-10-06T03:17:27.830326+0000","last_active":"2023-10-06T03:17:27.835935+0000","last_peered":"2023-10-06T03:17:27.835935+0000","last_clean":"2023-10-06T03:17:27.835935+0000","last_became_active":"2023-10-06T03:17:27.830034+0000","last_became_peered":"2023-10-06T03:17:27.830034+0000","last_unstale":"2023-10-06T03:17:27.835935+0000","last_undegraded":"2023-10-06T03:17:27.835935+0000","last_fullsized":"2023-10-06T03:17:27.835935+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:50.215503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838123+0000","last_change":"2023-10-06T03:17:27.833639+0000","last_active":"2023-10-06T03:17:27.838123+0000","last_peered":"2023-10-06T03:17:27.838123+0000","last_clean":"2023-10-06T03:17:27.838123+0000","last_became_active":"2023-10-06T03:17:27.833388+0000","last_became_peered":"2023-10-06T03:17:27.833388+0000","last_unstale":"2023-10-06T03:17:27.838123+0000","last_undegraded":"2023-10-06T03:17:27.838123+0000","last_fullsized":"2023-10-06T03:17:27.838123+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:25.142593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847607+0000","last_change":"2023-10-06T03:17:27.840475+0000","last_active":"2023-10-06T03:17:27.847607+0000","last_peered":"2023-10-06T03:17:27.847607+0000","last_clean":"2023-10-06T03:17:27.847607+0000","last_became_active":"2023-10-06T03:17:27.839756+0000","last_became_peered":"2023-10-06T03:17:27.839756+0000","last_unstale":"2023-10-06T03:17:27.847607+0000","last_undegraded":"2023-10-06T03:17:27.847607+0000","last_fullsized":"2023-10-06T03:17:27.847607+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.444587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836711+0000","last_change":"2023-10-06T03:17:27.832150+0000","last_active":"2023-10-06T03:17:27.836711+0000","last_peered":"2023-10-06T03:17:27.836711+0000","last_clean":"2023-10-06T03:17:27.836711+0000","last_became_active":"2023-10-06T03:17:27.831899+0000","last_became_peered":"2023-10-06T03:17:27.831899+0000","last_unstale":"2023-10-06T03:17:27.836711+0000","last_undegraded":"2023-10-06T03:17:27.836711+0000","last_fullsized":"2023-10-06T03:17:27.836711+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:20.600195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.841566+0000","last_change":"2023-10-06T03:17:27.837442+0000","last_active":"2023-10-06T03:17:27.841566+0000","last_peered":"2023-10-06T03:17:27.841566+0000","last_clean":"2023-10-06T03:17:27.841566+0000","last_became_active":"2023-10-06T03:17:27.837187+0000","last_became_peered":"2023-10-06T03:17:27.837187+0000","last_unstale":"2023-10-06T03:17:27.841566+0000","last_undegraded":"2023-10-06T03:17:27.841566+0000","last_fullsized":"2023-10-06T03:17:27.841566+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:44.713339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818479+0000","last_change":"2023-10-06T03:17:27.818479+0000","last_active":"2023-10-06T03:17:27.818479+0000","last_peered":"2023-10-06T03:17:27.818479+0000","last_clean":"2023-10-06T03:17:27.818479+0000","last_became_active":"2023-10-06T03:17:27.818290+0000","last_became_peered":"2023-10-06T03:17:27.818290+0000","last_unstale":"2023-10-06T03:17:27.818479+0000","last_undegraded":"2023-10-06T03:17:27.818479+0000","last_fullsized":"2023-10-06T03:17:27.818479+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.645900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830470+0000","last_change":"2023-10-06T03:17:27.824940+0000","last_active":"2023-10-06T03:17:27.830470+0000","last_peered":"2023-10-06T03:17:27.830470+0000","last_clean":"2023-10-06T03:17:27.830470+0000","last_became_active":"2023-10-06T03:17:27.824624+0000","last_became_peered":"2023-10-06T03:17:27.824624+0000","last_unstale":"2023-10-06T03:17:27.830470+0000","last_undegraded":"2023-10-06T03:17:27.830470+0000","last_fullsized":"2023-10-06T03:17:27.830470+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:48.477824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830625+0000","last_change":"2023-10-06T03:17:27.830625+0000","last_active":"2023-10-06T03:17:27.830625+0000","last_peered":"2023-10-06T03:17:27.830625+0000","last_clean":"2023-10-06T03:17:27.830625+0000","last_became_active":"2023-10-06T03:17:27.830355+0000","last_became_peered":"2023-10-06T03:17:27.830355+0000","last_unstale":"2023-10-06T03:17:27.830625+0000","last_undegraded":"2023-10-06T03:17:27.830625+0000","last_fullsized":"2023-10-06T03:17:27.830625+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:22.256244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.832130+0000","last_change":"2023-10-06T03:17:27.829179+0000","last_active":"2023-10-06T03:17:27.832130+0000","last_peered":"2023-10-06T03:17:27.832130+0000","last_clean":"2023-10-06T03:17:27.832130+0000","last_became_active":"2023-10-06T03:17:27.828896+0000","last_became_peered":"2023-10-06T03:17:27.828896+0000","last_unstale":"2023-10-06T03:17:27.832130+0000","last_undegraded":"2023-10-06T03:17:27.832130+0000","last_fullsized":"2023-10-06T03:17:27.832130+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.510541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835722+0000","last_change":"2023-10-06T03:17:27.823076+0000","last_active":"2023-10-06T03:17:27.835722+0000","last_peered":"2023-10-06T03:17:27.835722+0000","last_clean":"2023-10-06T03:17:27.835722+0000","last_became_active":"2023-10-06T03:17:27.822808+0000","last_became_peered":"2023-10-06T03:17:27.822808+0000","last_unstale":"2023-10-06T03:17:27.835722+0000","last_undegraded":"2023-10-06T03:17:27.835722+0000","last_fullsized":"2023-10-06T03:17:27.835722+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:34.474601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835900+0000","last_change":"2023-10-06T03:17:27.831001+0000","last_active":"2023-10-06T03:17:27.835900+0000","last_peered":"2023-10-06T03:17:27.835900+0000","last_clean":"2023-10-06T03:17:27.835900+0000","last_became_active":"2023-10-06T03:17:27.830792+0000","last_became_peered":"2023-10-06T03:17:27.830792+0000","last_unstale":"2023-10-06T03:17:27.835900+0000","last_undegraded":"2023-10-06T03:17:27.835900+0000","last_fullsized":"2023-10-06T03:17:27.835900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:17.276579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.832166+0000","last_change":"2023-10-06T03:17:27.829449+0000","last_active":"2023-10-06T03:17:27.832166+0000","last_peered":"2023-10-06T03:17:27.832166+0000","last_clean":"2023-10-06T03:17:27.832166+0000","last_became_active":"2023-10-06T03:17:27.829170+0000","last_became_peered":"2023-10-06T03:17:27.829170+0000","last_unstale":"2023-10-06T03:17:27.832166+0000","last_undegraded":"2023-10-06T03:17:27.832166+0000","last_fullsized":"2023-10-06T03:17:27.832166+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:18.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.837219+0000","last_change":"2023-10-06T03:17:27.835784+0000","last_active":"2023-10-06T03:17:27.837219+0000","last_peered":"2023-10-06T03:17:27.837219+0000","last_clean":"2023-10-06T03:17:27.837219+0000","last_became_active":"2023-10-06T03:17:27.835518+0000","last_became_peered":"2023-10-06T03:17:27.835518+0000","last_unstale":"2023-10-06T03:17:27.837219+0000","last_undegraded":"2023-10-06T03:17:27.837219+0000","last_fullsized":"2023-10-06T03:17:27.837219+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:17.987659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836349+0000","last_change":"2023-10-06T03:17:27.824309+0000","last_active":"2023-10-06T03:17:27.836349+0000","last_peered":"2023-10-06T03:17:27.836349+0000","last_clean":"2023-10-06T03:17:27.836349+0000","last_became_active":"2023-10-06T03:17:27.823879+0000","last_became_peered":"2023-10-06T03:17:27.823879+0000","last_unstale":"2023-10-06T03:17:27.836349+0000","last_undegraded":"2023-10-06T03:17:27.836349+0000","last_fullsized":"2023-10-06T03:17:27.836349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:48.477824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838062+0000","last_change":"2023-10-06T03:17:27.833173+0000","last_active":"2023-10-06T03:17:27.838062+0000","last_peered":"2023-10-06T03:17:27.838062+0000","last_clean":"2023-10-06T03:17:27.838062+0000","last_became_active":"2023-10-06T03:17:27.832923+0000","last_became_peered":"2023-10-06T03:17:27.832923+0000","last_unstale":"2023-10-06T03:17:27.838062+0000","last_undegraded":"2023-10-06T03:17:27.838062+0000","last_fullsized":"2023-10-06T03:17:27.838062+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:50.637897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830396+0000","last_change":"2023-10-06T03:17:27.825617+0000","last_active":"2023-10-06T03:17:27.830396+0000","last_peered":"2023-10-06T03:17:27.830396+0000","last_clean":"2023-10-06T03:17:27.830396+0000","last_became_active":"2023-10-06T03:17:27.825080+0000","last_became_peered":"2023-10-06T03:17:27.825080+0000","last_unstale":"2023-10-06T03:17:27.830396+0000","last_undegraded":"2023-10-06T03:17:27.830396+0000","last_fullsized":"2023-10-06T03:17:27.830396+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:10.209030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.829359+0000","last_change":"2023-10-06T03:17:27.829359+0000","last_active":"2023-10-06T03:17:27.829359+0000","last_peered":"2023-10-06T03:17:27.829359+0000","last_clean":"2023-10-06T03:17:27.829359+0000","last_became_active":"2023-10-06T03:17:27.828904+0000","last_became_peered":"2023-10-06T03:17:27.828904+0000","last_unstale":"2023-10-06T03:17:27.829359+0000","last_undegraded":"2023-10-06T03:17:27.829359+0000","last_fullsized":"2023-10-06T03:17:27.829359+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:22.256244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847122+0000","last_change":"2023-10-06T03:17:27.840175+0000","last_active":"2023-10-06T03:17:27.847122+0000","last_peered":"2023-10-06T03:17:27.847122+0000","last_clean":"2023-10-06T03:17:27.847122+0000","last_became_active":"2023-10-06T03:17:27.839165+0000","last_became_peered":"2023-10-06T03:17:27.839165+0000","last_unstale":"2023-10-06T03:17:27.847122+0000","last_undegraded":"2023-10-06T03:17:27.847122+0000","last_fullsized":"2023-10-06T03:17:27.847122+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.271508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838056+0000","last_change":"2023-10-06T03:17:27.834214+0000","last_active":"2023-10-06T03:17:27.838056+0000","last_peered":"2023-10-06T03:17:27.838056+0000","last_clean":"2023-10-06T03:17:27.838056+0000","last_became_active":"2023-10-06T03:17:27.833972+0000","last_became_peered":"2023-10-06T03:17:27.833972+0000","last_unstale":"2023-10-06T03:17:27.838056+0000","last_undegraded":"2023-10-06T03:17:27.838056+0000","last_fullsized":"2023-10-06T03:17:27.838056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:44.053318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.831060+0000","last_change":"2023-10-06T03:17:27.825359+0000","last_active":"2023-10-06T03:17:27.831060+0000","last_peered":"2023-10-06T03:17:27.831060+0000","last_clean":"2023-10-06T03:17:27.831060+0000","last_became_active":"2023-10-06T03:17:27.825021+0000","last_became_peered":"2023-10-06T03:17:27.825021+0000","last_unstale":"2023-10-06T03:17:27.831060+0000","last_undegraded":"2023-10-06T03:17:27.831060+0000","last_fullsized":"2023-10-06T03:17:27.831060+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:13.494774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824707+0000","last_change":"2023-10-06T03:17:27.819107+0000","last_active":"2023-10-06T03:17:27.824707+0000","last_peered":"2023-10-06T03:17:27.824707+0000","last_clean":"2023-10-06T03:17:27.824707+0000","last_became_active":"2023-10-06T03:17:27.818875+0000","last_became_peered":"2023-10-06T03:17:27.818875+0000","last_unstale":"2023-10-06T03:17:27.824707+0000","last_undegraded":"2023-10-06T03:17:27.824707+0000","last_fullsized":"2023-10-06T03:17:27.824707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:17.276579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.827772+0000","last_change":"2023-10-06T03:17:27.827772+0000","last_active":"2023-10-06T03:17:27.827772+0000","last_peered":"2023-10-06T03:17:27.827772+0000","last_clean":"2023-10-06T03:17:27.827772+0000","last_became_active":"2023-10-06T03:17:27.827389+0000","last_became_peered":"2023-10-06T03:17:27.827389+0000","last_unstale":"2023-10-06T03:17:27.827772+0000","last_undegraded":"2023-10-06T03:17:27.827772+0000","last_fullsized":"2023-10-06T03:17:27.827772+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:56.757661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"54'4","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.839476+0000","last_change":"2023-10-06T03:17:26.816352+0000","last_active":"2023-10-06T03:17:27.839476+0000","last_peered":"2023-10-06T03:17:27.839476+0000","last_clean":"2023-10-06T03:17:27.839476+0000","last_became_active":"2023-10-06T03:17:26.816036+0000","last_became_peered":"2023-10-06T03:17:26.816036+0000","last_unstale":"2023-10-06T03:17:27.839476+0000","last_undegraded":"2023-10-06T03:17:27.839476+0000","last_fullsized":"2023-10-06T03:17:27.839476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:51.790551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835759+0000","last_change":"2023-10-06T03:17:27.831993+0000","last_active":"2023-10-06T03:17:27.835759+0000","last_peered":"2023-10-06T03:17:27.835759+0000","last_clean":"2023-10-06T03:17:27.835759+0000","last_became_active":"2023-10-06T03:17:27.831496+0000","last_became_peered":"2023-10-06T03:17:27.831496+0000","last_unstale":"2023-10-06T03:17:27.835759+0000","last_undegraded":"2023-10-06T03:17:27.835759+0000","last_fullsized":"2023-10-06T03:17:27.835759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:50.151603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.841836+0000","last_change":"2023-10-06T03:17:26.817998+0000","last_active":"2023-10-06T03:17:27.841836+0000","last_peered":"2023-10-06T03:17:27.841836+0000","last_clean":"2023-10-06T03:17:27.841836+0000","last_became_active":"2023-10-06T03:17:26.817778+0000","last_became_peered":"2023-10-06T03:17:26.817778+0000","last_unstale":"2023-10-06T03:17:27.841836+0000","last_undegraded":"2023-10-06T03:17:27.841836+0000","last_fullsized":"2023-10-06T03:17:27.841836+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.311874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824752+0000","last_change":"2023-10-06T03:17:27.819647+0000","last_active":"2023-10-06T03:17:27.824752+0000","last_peered":"2023-10-06T03:17:27.824752+0000","last_clean":"2023-10-06T03:17:27.824752+0000","last_became_active":"2023-10-06T03:17:27.819410+0000","last_became_peered":"2023-10-06T03:17:27.819410+0000","last_unstale":"2023-10-06T03:17:27.824752+0000","last_undegraded":"2023-10-06T03:17:27.824752+0000","last_fullsized":"2023-10-06T03:17:27.824752+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.271508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838508+0000","last_change":"2023-10-06T03:17:26.813685+0000","last_active":"2023-10-06T03:17:27.838508+0000","last_peered":"2023-10-06T03:17:27.838508+0000","last_clean":"2023-10-06T03:17:27.838508+0000","last_became_active":"2023-10-06T03:17:26.813362+0000","last_became_peered":"2023-10-06T03:17:26.813362+0000","last_unstale":"2023-10-06T03:17:27.838508+0000","last_undegraded":"2023-10-06T03:17:27.838508+0000","last_fullsized":"2023-10-06T03:17:27.838508+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:19.593330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.837526+0000","last_change":"2023-10-06T03:17:27.833225+0000","last_active":"2023-10-06T03:17:27.837526+0000","last_peered":"2023-10-06T03:17:27.837526+0000","last_clean":"2023-10-06T03:17:27.837526+0000","last_became_active":"2023-10-06T03:17:27.832984+0000","last_became_peered":"2023-10-06T03:17:27.832984+0000","last_unstale":"2023-10-06T03:17:27.837526+0000","last_undegraded":"2023-10-06T03:17:27.837526+0000","last_fullsized":"2023-10-06T03:17:27.837526+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:23.323268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.842452+0000","last_change":"2023-10-06T03:17:26.809766+0000","last_active":"2023-10-06T03:17:27.842452+0000","last_peered":"2023-10-06T03:17:27.842452+0000","last_clean":"2023-10-06T03:17:27.842452+0000","last_became_active":"2023-10-06T03:17:26.809328+0000","last_became_peered":"2023-10-06T03:17:26.809328+0000","last_unstale":"2023-10-06T03:17:27.842452+0000","last_undegraded":"2023-10-06T03:17:27.842452+0000","last_fullsized":"2023-10-06T03:17:27.842452+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:47.470959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824892+0000","last_change":"2023-10-06T03:17:27.821269+0000","last_active":"2023-10-06T03:17:27.824892+0000","last_peered":"2023-10-06T03:17:27.824892+0000","last_clean":"2023-10-06T03:17:27.824892+0000","last_became_active":"2023-10-06T03:17:27.821044+0000","last_became_peered":"2023-10-06T03:17:27.821044+0000","last_unstale":"2023-10-06T03:17:27.824892+0000","last_undegraded":"2023-10-06T03:17:27.824892+0000","last_fullsized":"2023-10-06T03:17:27.824892+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:22.677476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838682+0000","last_change":"2023-10-06T03:17:26.806926+0000","last_active":"2023-10-06T03:17:27.838682+0000","last_peered":"2023-10-06T03:17:27.838682+0000","last_clean":"2023-10-06T03:17:27.838682+0000","last_became_active":"2023-10-06T03:17:26.806629+0000","last_became_peered":"2023-10-06T03:17:26.806629+0000","last_unstale":"2023-10-06T03:17:27.838682+0000","last_undegraded":"2023-10-06T03:17:27.838682+0000","last_fullsized":"2023-10-06T03:17:27.838682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:49.208638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.817791+0000","last_change":"2023-10-06T03:17:27.817791+0000","last_active":"2023-10-06T03:17:27.817791+0000","last_peered":"2023-10-06T03:17:27.817791+0000","last_clean":"2023-10-06T03:17:27.817791+0000","last_became_active":"2023-10-06T03:17:27.817492+0000","last_became_peered":"2023-10-06T03:17:27.817492+0000","last_unstale":"2023-10-06T03:17:27.817791+0000","last_undegraded":"2023-10-06T03:17:27.817791+0000","last_fullsized":"2023-10-06T03:17:27.817791+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:49.856690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.838730+0000","last_change":"2023-10-06T03:17:26.812402+0000","last_active":"2023-10-06T03:17:27.838730+0000","last_peered":"2023-10-06T03:17:27.838730+0000","last_clean":"2023-10-06T03:17:27.838730+0000","last_became_active":"2023-10-06T03:17:26.812143+0000","last_became_peered":"2023-10-06T03:17:26.812143+0000","last_unstale":"2023-10-06T03:17:27.838730+0000","last_undegraded":"2023-10-06T03:17:27.838730+0000","last_fullsized":"2023-10-06T03:17:27.838730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:49.631031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828762+0000","last_change":"2023-10-06T03:17:27.828762+0000","last_active":"2023-10-06T03:17:27.828762+0000","last_peered":"2023-10-06T03:17:27.828762+0000","last_clean":"2023-10-06T03:17:27.828762+0000","last_became_active":"2023-10-06T03:17:27.827842+0000","last_became_peered":"2023-10-06T03:17:27.827842+0000","last_unstale":"2023-10-06T03:17:27.828762+0000","last_undegraded":"2023-10-06T03:17:27.828762+0000","last_fullsized":"2023-10-06T03:17:27.828762+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.084282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816400+0000","last_change":"2023-10-06T03:17:26.814607+0000","last_active":"2023-10-06T03:17:27.816400+0000","last_peered":"2023-10-06T03:17:27.816400+0000","last_clean":"2023-10-06T03:17:27.816400+0000","last_became_active":"2023-10-06T03:17:26.814356+0000","last_became_peered":"2023-10-06T03:17:26.814356+0000","last_unstale":"2023-10-06T03:17:27.816400+0000","last_undegraded":"2023-10-06T03:17:27.816400+0000","last_fullsized":"2023-10-06T03:17:27.816400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:49.144738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.822650+0000","last_change":"2023-10-06T03:17:27.820411+0000","last_active":"2023-10-06T03:17:27.822650+0000","last_peered":"2023-10-06T03:17:27.822650+0000","last_clean":"2023-10-06T03:17:27.822650+0000","last_became_active":"2023-10-06T03:17:27.820123+0000","last_became_peered":"2023-10-06T03:17:27.820123+0000","last_unstale":"2023-10-06T03:17:27.822650+0000","last_undegraded":"2023-10-06T03:17:27.822650+0000","last_fullsized":"2023-10-06T03:17:27.822650+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:04.127117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.821213+0000","last_change":"2023-10-06T03:17:26.817692+0000","last_active":"2023-10-06T03:17:26.821213+0000","last_peered":"2023-10-06T03:17:26.821213+0000","last_clean":"2023-10-06T03:17:26.821213+0000","last_became_active":"2023-10-06T03:17:26.817411+0000","last_became_peered":"2023-10-06T03:17:26.817411+0000","last_unstale":"2023-10-06T03:17:26.821213+0000","last_undegraded":"2023-10-06T03:17:26.821213+0000","last_fullsized":"2023-10-06T03:17:26.821213+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:22.084373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818300+0000","last_change":"2023-10-06T03:17:27.818300+0000","last_active":"2023-10-06T03:17:27.818300+0000","last_peered":"2023-10-06T03:17:27.818300+0000","last_clean":"2023-10-06T03:17:27.818300+0000","last_became_active":"2023-10-06T03:17:27.818062+0000","last_became_peered":"2023-10-06T03:17:27.818062+0000","last_unstale":"2023-10-06T03:17:27.818300+0000","last_undegraded":"2023-10-06T03:17:27.818300+0000","last_fullsized":"2023-10-06T03:17:27.818300+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:03.674022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824348+0000","last_change":"2023-10-06T03:17:26.817706+0000","last_active":"2023-10-06T03:17:27.824348+0000","last_peered":"2023-10-06T03:17:27.824348+0000","last_clean":"2023-10-06T03:17:27.824348+0000","last_became_active":"2023-10-06T03:17:26.817443+0000","last_became_peered":"2023-10-06T03:17:26.817443+0000","last_unstale":"2023-10-06T03:17:27.824348+0000","last_undegraded":"2023-10-06T03:17:27.824348+0000","last_fullsized":"2023-10-06T03:17:27.824348+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:38.674911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.841336+0000","last_change":"2023-10-06T03:17:27.836767+0000","last_active":"2023-10-06T03:17:27.841336+0000","last_peered":"2023-10-06T03:17:27.841336+0000","last_clean":"2023-10-06T03:17:27.841336+0000","last_became_active":"2023-10-06T03:17:27.836504+0000","last_became_peered":"2023-10-06T03:17:27.836504+0000","last_unstale":"2023-10-06T03:17:27.841336+0000","last_undegraded":"2023-10-06T03:17:27.841336+0000","last_fullsized":"2023-10-06T03:17:27.841336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.271508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.817521+0000","last_change":"2023-10-06T03:17:26.823868+0000","last_active":"2023-10-06T03:17:27.817521+0000","last_peered":"2023-10-06T03:17:27.817521+0000","last_clean":"2023-10-06T03:17:27.817521+0000","last_became_active":"2023-10-06T03:17:26.823616+0000","last_became_peered":"2023-10-06T03:17:26.823616+0000","last_unstale":"2023-10-06T03:17:27.817521+0000","last_undegraded":"2023-10-06T03:17:27.817521+0000","last_fullsized":"2023-10-06T03:17:27.817521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:02.667157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836543+0000","last_change":"2023-10-06T03:17:27.836543+0000","last_active":"2023-10-06T03:17:27.836543+0000","last_peered":"2023-10-06T03:17:27.836543+0000","last_clean":"2023-10-06T03:17:27.836543+0000","last_became_active":"2023-10-06T03:17:27.836282+0000","last_became_peered":"2023-10-06T03:17:27.836282+0000","last_unstale":"2023-10-06T03:17:27.836543+0000","last_undegraded":"2023-10-06T03:17:27.836543+0000","last_fullsized":"2023-10-06T03:17:27.836543+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:11.636278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"54'3","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847539+0000","last_change":"2023-10-06T03:17:26.822470+0000","last_active":"2023-10-06T03:17:27.847539+0000","last_peered":"2023-10-06T03:17:27.847539+0000","last_clean":"2023-10-06T03:17:27.847539+0000","last_became_active":"2023-10-06T03:17:26.822191+0000","last_became_peered":"2023-10-06T03:17:26.822191+0000","last_unstale":"2023-10-06T03:17:27.847539+0000","last_undegraded":"2023-10-06T03:17:27.847539+0000","last_fullsized":"2023-10-06T03:17:27.847539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:19.878385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.833948+0000","last_change":"2023-10-06T03:17:27.827143+0000","last_active":"2023-10-06T03:17:27.833948+0000","last_peered":"2023-10-06T03:17:27.833948+0000","last_clean":"2023-10-06T03:17:27.833948+0000","last_became_active":"2023-10-06T03:17:27.825159+0000","last_became_peered":"2023-10-06T03:17:27.825159+0000","last_unstale":"2023-10-06T03:17:27.833948+0000","last_undegraded":"2023-10-06T03:17:27.833948+0000","last_fullsized":"2023-10-06T03:17:27.833948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:09.923870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"54'6","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.836041+0000","last_change":"2023-10-06T03:17:26.823682+0000","last_active":"2023-10-06T03:17:27.836041+0000","last_peered":"2023-10-06T03:17:27.836041+0000","last_clean":"2023-10-06T03:17:27.836041+0000","last_became_active":"2023-10-06T03:17:26.823503+0000","last_became_peered":"2023-10-06T03:17:26.823503+0000","last_unstale":"2023-10-06T03:17:27.836041+0000","last_undegraded":"2023-10-06T03:17:27.836041+0000","last_fullsized":"2023-10-06T03:17:27.836041+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:43.867675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.837495+0000","last_change":"2023-10-06T03:17:27.831003+0000","last_active":"2023-10-06T03:17:27.837495+0000","last_peered":"2023-10-06T03:17:27.837495+0000","last_clean":"2023-10-06T03:17:27.837495+0000","last_became_active":"2023-10-06T03:17:27.829906+0000","last_became_peered":"2023-10-06T03:17:27.829906+0000","last_unstale":"2023-10-06T03:17:27.837495+0000","last_undegraded":"2023-10-06T03:17:27.837495+0000","last_fullsized":"2023-10-06T03:17:27.837495+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:36.211064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847407+0000","last_change":"2023-10-06T03:17:26.821788+0000","last_active":"2023-10-06T03:17:27.847407+0000","last_peered":"2023-10-06T03:17:27.847407+0000","last_clean":"2023-10-06T03:17:27.847407+0000","last_became_active":"2023-10-06T03:17:26.821503+0000","last_became_peered":"2023-10-06T03:17:26.821503+0000","last_unstale":"2023-10-06T03:17:27.847407+0000","last_undegraded":"2023-10-06T03:17:27.847407+0000","last_fullsized":"2023-10-06T03:17:27.847407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:08.917005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835771+0000","last_change":"2023-10-06T03:17:27.824409+0000","last_active":"2023-10-06T03:17:27.835771+0000","last_peered":"2023-10-06T03:17:27.835771+0000","last_clean":"2023-10-06T03:17:27.835771+0000","last_became_active":"2023-10-06T03:17:27.823084+0000","last_became_peered":"2023-10-06T03:17:27.823084+0000","last_unstale":"2023-10-06T03:17:27.835771+0000","last_undegraded":"2023-10-06T03:17:27.835771+0000","last_fullsized":"2023-10-06T03:17:27.835771+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:20.600195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818947+0000","last_change":"2023-10-06T03:17:26.812016+0000","last_active":"2023-10-06T03:17:27.818947+0000","last_peered":"2023-10-06T03:17:27.818947+0000","last_clean":"2023-10-06T03:17:27.818947+0000","last_became_active":"2023-10-06T03:17:26.811688+0000","last_became_peered":"2023-10-06T03:17:26.811688+0000","last_unstale":"2023-10-06T03:17:27.818947+0000","last_undegraded":"2023-10-06T03:17:27.818947+0000","last_fullsized":"2023-10-06T03:17:27.818947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:21.249378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828188+0000","last_change":"2023-10-06T03:17:27.828188+0000","last_active":"2023-10-06T03:17:27.828188+0000","last_peered":"2023-10-06T03:17:27.828188+0000","last_clean":"2023-10-06T03:17:27.828188+0000","last_became_active":"2023-10-06T03:17:27.827576+0000","last_became_peered":"2023-10-06T03:17:27.827576+0000","last_unstale":"2023-10-06T03:17:27.828188+0000","last_undegraded":"2023-10-06T03:17:27.828188+0000","last_fullsized":"2023-10-06T03:17:27.828188+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:27.034375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.823264+0000","last_change":"2023-10-06T03:17:26.820476+0000","last_active":"2023-10-06T03:17:27.823264+0000","last_peered":"2023-10-06T03:17:27.823264+0000","last_clean":"2023-10-06T03:17:27.823264+0000","last_became_active":"2023-10-06T03:17:26.820217+0000","last_became_peered":"2023-10-06T03:17:26.820217+0000","last_unstale":"2023-10-06T03:17:27.823264+0000","last_undegraded":"2023-10-06T03:17:27.823264+0000","last_fullsized":"2023-10-06T03:17:27.823264+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:09.202165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.830337+0000","last_change":"2023-10-06T03:17:27.830337+0000","last_active":"2023-10-06T03:17:27.830337+0000","last_peered":"2023-10-06T03:17:27.830337+0000","last_clean":"2023-10-06T03:17:27.830337+0000","last_became_active":"2023-10-06T03:17:27.830066+0000","last_became_peered":"2023-10-06T03:17:27.830066+0000","last_unstale":"2023-10-06T03:17:27.830337+0000","last_undegraded":"2023-10-06T03:17:27.830337+0000","last_fullsized":"2023-10-06T03:17:27.830337+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.084282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"54'8","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847799+0000","last_change":"2023-10-06T03:17:26.822412+0000","last_active":"2023-10-06T03:17:27.847799+0000","last_peered":"2023-10-06T03:17:27.847799+0000","last_clean":"2023-10-06T03:17:27.847799+0000","last_became_active":"2023-10-06T03:17:26.822163+0000","last_became_peered":"2023-10-06T03:17:26.822163+0000","last_unstale":"2023-10-06T03:17:27.847799+0000","last_undegraded":"2023-10-06T03:17:27.847799+0000","last_fullsized":"2023-10-06T03:17:27.847799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:38.886862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.824761+0000","last_change":"2023-10-06T03:17:27.819156+0000","last_active":"2023-10-06T03:17:27.824761+0000","last_peered":"2023-10-06T03:17:27.824761+0000","last_clean":"2023-10-06T03:17:27.824761+0000","last_became_active":"2023-10-06T03:17:27.818942+0000","last_became_peered":"2023-10-06T03:17:27.818942+0000","last_unstale":"2023-10-06T03:17:27.824761+0000","last_undegraded":"2023-10-06T03:17:27.824761+0000","last_fullsized":"2023-10-06T03:17:27.824761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:04.127117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.839255+0000","last_change":"2023-10-06T03:17:26.817960+0000","last_active":"2023-10-06T03:17:27.839255+0000","last_peered":"2023-10-06T03:17:27.839255+0000","last_clean":"2023-10-06T03:17:27.839255+0000","last_became_active":"2023-10-06T03:17:26.817690+0000","last_became_peered":"2023-10-06T03:17:26.817690+0000","last_unstale":"2023-10-06T03:17:27.839255+0000","last_undegraded":"2023-10-06T03:17:27.839255+0000","last_fullsized":"2023-10-06T03:17:27.839255+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.639035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.825336+0000","last_change":"2023-10-06T03:17:27.822730+0000","last_active":"2023-10-06T03:17:27.825336+0000","last_peered":"2023-10-06T03:17:27.825336+0000","last_clean":"2023-10-06T03:17:27.825336+0000","last_became_active":"2023-10-06T03:17:27.822437+0000","last_became_peered":"2023-10-06T03:17:27.822437+0000","last_unstale":"2023-10-06T03:17:27.825336+0000","last_undegraded":"2023-10-06T03:17:27.825336+0000","last_fullsized":"2023-10-06T03:17:27.825336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:25.773902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.819054+0000","last_change":"2023-10-06T03:17:26.809521+0000","last_active":"2023-10-06T03:17:27.819054+0000","last_peered":"2023-10-06T03:17:27.819054+0000","last_clean":"2023-10-06T03:17:27.819054+0000","last_became_active":"2023-10-06T03:17:26.809224+0000","last_became_peered":"2023-10-06T03:17:26.809224+0000","last_unstale":"2023-10-06T03:17:27.819054+0000","last_undegraded":"2023-10-06T03:17:27.819054+0000","last_fullsized":"2023-10-06T03:17:27.819054+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:26.027509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835774+0000","last_change":"2023-10-06T03:17:27.824741+0000","last_active":"2023-10-06T03:17:27.835774+0000","last_peered":"2023-10-06T03:17:27.835774+0000","last_clean":"2023-10-06T03:17:27.835774+0000","last_became_active":"2023-10-06T03:17:27.823415+0000","last_became_peered":"2023-10-06T03:17:27.823415+0000","last_unstale":"2023-10-06T03:17:27.835774+0000","last_undegraded":"2023-10-06T03:17:27.835774+0000","last_fullsized":"2023-10-06T03:17:27.835774+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:38.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.814104+0000","last_change":"2023-10-06T03:17:26.813527+0000","last_active":"2023-10-06T03:17:27.814104+0000","last_peered":"2023-10-06T03:17:27.814104+0000","last_clean":"2023-10-06T03:17:27.814104+0000","last_became_active":"2023-10-06T03:17:26.813259+0000","last_became_peered":"2023-10-06T03:17:26.813259+0000","last_unstale":"2023-10-06T03:17:27.814104+0000","last_undegraded":"2023-10-06T03:17:27.814104+0000","last_fullsized":"2023-10-06T03:17:27.814104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:33.467736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828587+0000","last_change":"2023-10-06T03:17:27.828587+0000","last_active":"2023-10-06T03:17:27.828587+0000","last_peered":"2023-10-06T03:17:27.828587+0000","last_clean":"2023-10-06T03:17:27.828587+0000","last_became_active":"2023-10-06T03:17:27.828375+0000","last_became_peered":"2023-10-06T03:17:27.828375+0000","last_unstale":"2023-10-06T03:17:27.828587+0000","last_undegraded":"2023-10-06T03:17:27.828587+0000","last_fullsized":"2023-10-06T03:17:27.828587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:19.640429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.826024+0000","last_change":"2023-10-06T03:17:26.823348+0000","last_active":"2023-10-06T03:17:26.826024+0000","last_peered":"2023-10-06T03:17:26.826024+0000","last_clean":"2023-10-06T03:17:26.826024+0000","last_became_active":"2023-10-06T03:17:26.823142+0000","last_became_peered":"2023-10-06T03:17:26.823142+0000","last_unstale":"2023-10-06T03:17:26.826024+0000","last_undegraded":"2023-10-06T03:17:26.826024+0000","last_fullsized":"2023-10-06T03:17:26.826024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:50.671962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.825437+0000","last_change":"2023-10-06T03:17:27.825437+0000","last_active":"2023-10-06T03:17:27.825437+0000","last_peered":"2023-10-06T03:17:27.825437+0000","last_clean":"2023-10-06T03:17:27.825437+0000","last_became_active":"2023-10-06T03:17:27.824516+0000","last_became_peered":"2023-10-06T03:17:27.824516+0000","last_unstale":"2023-10-06T03:17:27.825437+0000","last_undegraded":"2023-10-06T03:17:27.825437+0000","last_fullsized":"2023-10-06T03:17:27.825437+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:37.529961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.823530+0000","last_change":"2023-10-06T03:17:26.820595+0000","last_active":"2023-10-06T03:17:27.823530+0000","last_peered":"2023-10-06T03:17:27.823530+0000","last_clean":"2023-10-06T03:17:27.823530+0000","last_became_active":"2023-10-06T03:17:26.820314+0000","last_became_peered":"2023-10-06T03:17:26.820314+0000","last_unstale":"2023-10-06T03:17:27.823530+0000","last_undegraded":"2023-10-06T03:17:27.823530+0000","last_fullsized":"2023-10-06T03:17:27.823530+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:12.487909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835483+0000","last_change":"2023-10-06T03:17:27.830954+0000","last_active":"2023-10-06T03:17:27.835483+0000","last_peered":"2023-10-06T03:17:27.835483+0000","last_clean":"2023-10-06T03:17:27.835483+0000","last_became_active":"2023-10-06T03:17:27.829559+0000","last_became_peered":"2023-10-06T03:17:27.829559+0000","last_unstale":"2023-10-06T03:17:27.835483+0000","last_undegraded":"2023-10-06T03:17:27.835483+0000","last_fullsized":"2023-10-06T03:17:27.835483+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:20.885250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816035+0000","last_change":"2023-10-06T03:17:26.809924+0000","last_active":"2023-10-06T03:17:27.816035+0000","last_peered":"2023-10-06T03:17:27.816035+0000","last_clean":"2023-10-06T03:17:27.816035+0000","last_became_active":"2023-10-06T03:17:26.809704+0000","last_became_peered":"2023-10-06T03:17:26.809704+0000","last_unstale":"2023-10-06T03:17:27.816035+0000","last_undegraded":"2023-10-06T03:17:27.816035+0000","last_fullsized":"2023-10-06T03:17:27.816035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:33.467736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.820556+0000","last_change":"2023-10-06T03:17:27.820556+0000","last_active":"2023-10-06T03:17:27.820556+0000","last_peered":"2023-10-06T03:17:27.820556+0000","last_clean":"2023-10-06T03:17:27.820556+0000","last_became_active":"2023-10-06T03:17:27.820287+0000","last_became_peered":"2023-10-06T03:17:27.820287+0000","last_unstale":"2023-10-06T03:17:27.820556+0000","last_undegraded":"2023-10-06T03:17:27.820556+0000","last_fullsized":"2023-10-06T03:17:27.820556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:27.034375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816467+0000","last_change":"2023-10-06T03:17:26.814908+0000","last_active":"2023-10-06T03:17:27.816467+0000","last_peered":"2023-10-06T03:17:27.816467+0000","last_clean":"2023-10-06T03:17:27.816467+0000","last_became_active":"2023-10-06T03:17:26.814631+0000","last_became_peered":"2023-10-06T03:17:26.814631+0000","last_unstale":"2023-10-06T03:17:27.816467+0000","last_undegraded":"2023-10-06T03:17:27.816467+0000","last_fullsized":"2023-10-06T03:17:27.816467+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:37.371353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.841586+0000","last_change":"2023-10-06T03:17:27.837432+0000","last_active":"2023-10-06T03:17:27.841586+0000","last_peered":"2023-10-06T03:17:27.841586+0000","last_clean":"2023-10-06T03:17:27.841586+0000","last_became_active":"2023-10-06T03:17:27.837133+0000","last_became_peered":"2023-10-06T03:17:27.837133+0000","last_unstale":"2023-10-06T03:17:27.841586+0000","last_undegraded":"2023-10-06T03:17:27.841586+0000","last_fullsized":"2023-10-06T03:17:27.841586+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:37.829631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.820315+0000","last_change":"2023-10-06T03:17:26.817267+0000","last_active":"2023-10-06T03:17:26.820315+0000","last_peered":"2023-10-06T03:17:26.820315+0000","last_clean":"2023-10-06T03:17:26.820315+0000","last_became_active":"2023-10-06T03:17:26.817030+0000","last_became_peered":"2023-10-06T03:17:26.817030+0000","last_unstale":"2023-10-06T03:17:26.820315+0000","last_undegraded":"2023-10-06T03:17:26.820315+0000","last_fullsized":"2023-10-06T03:17:26.820315+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:38.055277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.833543+0000","last_change":"2023-10-06T03:17:27.827825+0000","last_active":"2023-10-06T03:17:27.833543+0000","last_peered":"2023-10-06T03:17:27.833543+0000","last_clean":"2023-10-06T03:17:27.833543+0000","last_became_active":"2023-10-06T03:17:27.827576+0000","last_became_peered":"2023-10-06T03:17:27.827576+0000","last_unstale":"2023-10-06T03:17:27.833543+0000","last_undegraded":"2023-10-06T03:17:27.833543+0000","last_fullsized":"2023-10-06T03:17:27.833543+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:34.474601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847469+0000","last_change":"2023-10-06T03:17:26.822552+0000","last_active":"2023-10-06T03:17:27.847469+0000","last_peered":"2023-10-06T03:17:27.847469+0000","last_clean":"2023-10-06T03:17:27.847469+0000","last_became_active":"2023-10-06T03:17:26.822247+0000","last_became_peered":"2023-10-06T03:17:26.822247+0000","last_unstale":"2023-10-06T03:17:27.847469+0000","last_undegraded":"2023-10-06T03:17:27.847469+0000","last_fullsized":"2023-10-06T03:17:27.847469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:29.807193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.817385+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:17:27.817385+0000","last_peered":"2023-10-06T03:17:27.817385+0000","last_clean":"2023-10-06T03:17:27.817385+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:27.817385+0000","last_undegraded":"2023-10-06T03:17:27.817385+0000","last_fullsized":"2023-10-06T03:17:27.817385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.832515+0000","last_change":"2023-10-06T03:17:27.832515+0000","last_active":"2023-10-06T03:17:27.832515+0000","last_peered":"2023-10-06T03:17:27.832515+0000","last_clean":"2023-10-06T03:17:27.832515+0000","last_became_active":"2023-10-06T03:17:27.832153+0000","last_became_peered":"2023-10-06T03:17:27.832153+0000","last_unstale":"2023-10-06T03:17:27.832515+0000","last_undegraded":"2023-10-06T03:17:27.832515+0000","last_fullsized":"2023-10-06T03:17:27.832515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:03.674022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816651+0000","last_change":"2023-10-06T03:17:26.826792+0000","last_active":"2023-10-06T03:17:27.816651+0000","last_peered":"2023-10-06T03:17:27.816651+0000","last_clean":"2023-10-06T03:17:27.816651+0000","last_became_active":"2023-10-06T03:17:26.826518+0000","last_became_peered":"2023-10-06T03:17:26.826518+0000","last_unstale":"2023-10-06T03:17:27.816651+0000","last_undegraded":"2023-10-06T03:17:27.816651+0000","last_fullsized":"2023-10-06T03:17:27.816651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:35.204199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.816725+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:17:27.816725+0000","last_peered":"2023-10-06T03:17:27.816725+0000","last_clean":"2023-10-06T03:17:27.816725+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:27.816725+0000","last_undegraded":"2023-10-06T03:17:27.816725+0000","last_fullsized":"2023-10-06T03:17:27.816725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.821994+0000","last_change":"2023-10-06T03:17:27.817911+0000","last_active":"2023-10-06T03:17:27.821994+0000","last_peered":"2023-10-06T03:17:27.821994+0000","last_clean":"2023-10-06T03:17:27.821994+0000","last_became_active":"2023-10-06T03:17:27.817689+0000","last_became_peered":"2023-10-06T03:17:27.817689+0000","last_unstale":"2023-10-06T03:17:27.821994+0000","last_undegraded":"2023-10-06T03:17:27.821994+0000","last_fullsized":"2023-10-06T03:17:27.821994+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:18.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.842030+0000","last_change":"2023-10-06T03:17:26.817721+0000","last_active":"2023-10-06T03:17:27.842030+0000","last_peered":"2023-10-06T03:17:27.842030+0000","last_clean":"2023-10-06T03:17:27.842030+0000","last_became_active":"2023-10-06T03:17:26.817468+0000","last_became_peered":"2023-10-06T03:17:26.817468+0000","last_unstale":"2023-10-06T03:17:27.842030+0000","last_undegraded":"2023-10-06T03:17:27.842030+0000","last_fullsized":"2023-10-06T03:17:27.842030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:49.631031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.799416+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:17:26.799416+0000","last_peered":"2023-10-06T03:17:26.799416+0000","last_clean":"2023-10-06T03:17:26.799416+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:26.799416+0000","last_undegraded":"2023-10-06T03:17:26.799416+0000","last_fullsized":"2023-10-06T03:17:26.799416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.822898+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:17:27.822898+0000","last_peered":"2023-10-06T03:17:27.822898+0000","last_clean":"2023-10-06T03:17:27.822898+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:17:27.822898+0000","last_undegraded":"2023-10-06T03:17:27.822898+0000","last_fullsized":"2023-10-06T03:17:27.822898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.835745+0000","last_change":"2023-10-06T03:17:27.824301+0000","last_active":"2023-10-06T03:17:27.835745+0000","last_peered":"2023-10-06T03:17:27.835745+0000","last_clean":"2023-10-06T03:17:27.835745+0000","last_became_active":"2023-10-06T03:17:27.824007+0000","last_became_peered":"2023-10-06T03:17:27.824007+0000","last_unstale":"2023-10-06T03:17:27.835745+0000","last_undegraded":"2023-10-06T03:17:27.835745+0000","last_fullsized":"2023-10-06T03:17:27.835745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:50.151603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818602+0000","last_change":"2023-10-06T03:17:26.814980+0000","last_active":"2023-10-06T03:17:27.818602+0000","last_peered":"2023-10-06T03:17:27.818602+0000","last_clean":"2023-10-06T03:17:27.818602+0000","last_became_active":"2023-10-06T03:17:26.814685+0000","last_became_peered":"2023-10-06T03:17:26.814685+0000","last_unstale":"2023-10-06T03:17:27.818602+0000","last_undegraded":"2023-10-06T03:17:27.818602+0000","last_fullsized":"2023-10-06T03:17:27.818602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:38.886862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828445+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:17:27.828445+0000","last_peered":"2023-10-06T03:17:27.828445+0000","last_clean":"2023-10-06T03:17:27.828445+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:27.828445+0000","last_undegraded":"2023-10-06T03:17:27.828445+0000","last_fullsized":"2023-10-06T03:17:27.828445+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.827930+0000","last_change":"2023-10-06T03:17:27.827930+0000","last_active":"2023-10-06T03:17:27.827930+0000","last_peered":"2023-10-06T03:17:27.827930+0000","last_clean":"2023-10-06T03:17:27.827930+0000","last_became_active":"2023-10-06T03:17:27.827409+0000","last_became_peered":"2023-10-06T03:17:27.827409+0000","last_unstale":"2023-10-06T03:17:27.827930+0000","last_undegraded":"2023-10-06T03:17:27.827930+0000","last_fullsized":"2023-10-06T03:17:27.827930+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:39.893727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.815725+0000","last_change":"2023-10-06T03:17:26.814218+0000","last_active":"2023-10-06T03:17:27.815725+0000","last_peered":"2023-10-06T03:17:27.815725+0000","last_clean":"2023-10-06T03:17:27.815725+0000","last_became_active":"2023-10-06T03:17:26.813958+0000","last_became_peered":"2023-10-06T03:17:26.813958+0000","last_unstale":"2023-10-06T03:17:27.815725+0000","last_undegraded":"2023-10-06T03:17:27.815725+0000","last_fullsized":"2023-10-06T03:17:27.815725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.311874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.822992+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:17:27.822992+0000","last_peered":"2023-10-06T03:17:27.822992+0000","last_clean":"2023-10-06T03:17:27.822992+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:27.822992+0000","last_undegraded":"2023-10-06T03:17:27.822992+0000","last_fullsized":"2023-10-06T03:17:27.822992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.828037+0000","last_change":"2023-10-06T03:17:27.828037+0000","last_active":"2023-10-06T03:17:27.828037+0000","last_peered":"2023-10-06T03:17:27.828037+0000","last_clean":"2023-10-06T03:17:27.828037+0000","last_became_active":"2023-10-06T03:17:27.827311+0000","last_became_peered":"2023-10-06T03:17:27.827311+0000","last_unstale":"2023-10-06T03:17:27.828037+0000","last_undegraded":"2023-10-06T03:17:27.828037+0000","last_fullsized":"2023-10-06T03:17:27.828037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:27.281636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.813655+0000","last_change":"2023-10-06T03:17:26.815755+0000","last_active":"2023-10-06T03:17:27.813655+0000","last_peered":"2023-10-06T03:17:27.813655+0000","last_clean":"2023-10-06T03:17:27.813655+0000","last_became_active":"2023-10-06T03:17:26.815511+0000","last_became_peered":"2023-10-06T03:17:26.815511+0000","last_unstale":"2023-10-06T03:17:27.813655+0000","last_undegraded":"2023-10-06T03:17:27.813655+0000","last_fullsized":"2023-10-06T03:17:27.813655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:49.208638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.818549+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:17:27.818549+0000","last_peered":"2023-10-06T03:17:27.818549+0000","last_clean":"2023-10-06T03:17:27.818549+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:27.818549+0000","last_undegraded":"2023-10-06T03:17:27.818549+0000","last_fullsized":"2023-10-06T03:17:27.818549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.834973+0000","last_change":"2023-10-06T03:17:27.834973+0000","last_active":"2023-10-06T03:17:27.834973+0000","last_peered":"2023-10-06T03:17:27.834973+0000","last_clean":"2023-10-06T03:17:27.834973+0000","last_became_active":"2023-10-06T03:17:27.834706+0000","last_became_peered":"2023-10-06T03:17:27.834706+0000","last_unstale":"2023-10-06T03:17:27.834973+0000","last_undegraded":"2023-10-06T03:17:27.834973+0000","last_fullsized":"2023-10-06T03:17:27.834973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.645900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.847470+0000","last_change":"2023-10-06T03:17:26.822789+0000","last_active":"2023-10-06T03:17:27.847470+0000","last_peered":"2023-10-06T03:17:27.847470+0000","last_clean":"2023-10-06T03:17:27.847470+0000","last_became_active":"2023-10-06T03:17:26.822421+0000","last_became_peered":"2023-10-06T03:17:26.822421+0000","last_unstale":"2023-10-06T03:17:27.847470+0000","last_undegraded":"2023-10-06T03:17:27.847470+0000","last_fullsized":"2023-10-06T03:17:27.847470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:33.511298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.812631+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:17:26.812631+0000","last_peered":"2023-10-06T03:17:26.812631+0000","last_clean":"2023-10-06T03:17:26.812631+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:26.812631+0000","last_undegraded":"2023-10-06T03:17:26.812631+0000","last_fullsized":"2023-10-06T03:17:26.812631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.843992+0000","last_change":"2023-10-06T03:17:27.837562+0000","last_active":"2023-10-06T03:17:27.843992+0000","last_peered":"2023-10-06T03:17:27.843992+0000","last_clean":"2023-10-06T03:17:27.843992+0000","last_became_active":"2023-10-06T03:17:27.837311+0000","last_became_peered":"2023-10-06T03:17:27.837311+0000","last_unstale":"2023-10-06T03:17:27.843992+0000","last_undegraded":"2023-10-06T03:17:27.843992+0000","last_fullsized":"2023-10-06T03:17:27.843992+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:26.795362+0000","last_clean_scrub_stamp":"2023-10-06T03:17:26.795362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:17.276579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:17:27.839179+0000","last_change":"2023-10-06T03:17:26.810669+0000","last_active":"2023-10-06T03:17:27.839179+0000","last_peered":"2023-10-06T03:17:27.839179+0000","last_clean":"2023-10-06T03:17:27.839179+0000","last_became_active":"2023-10-06T03:17:26.810045+0000","last_became_peered":"2023-10-06T03:17:26.810045+0000","last_unstale":"2023-10-06T03:17:27.839179+0000","last_undegraded":"2023-10-06T03:17:27.839179+0000","last_fullsized":"2023-10-06T03:17:27.839179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:25.788497+0000","last_clean_scrub_stamp":"2023-10-06T03:17:25.788497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:25.077417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T03:17:26.813198+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:17:26.813198+0000","last_peered":"2023-10-06T03:17:26.813198+0000","last_clean":"2023-10-06T03:17:26.813198+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:26.813198+0000","last_undegraded":"2023-10-06T03:17:26.813198+0000","last_fullsized":"2023-10-06T03:17:26.813198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":876104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.62},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.73199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":278381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.505},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.436}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.628},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298528,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073312,"statfs":{"total":96636764160,"available":96331071488,"internally_reserved":0,"allocated":1269760,"data_stored":872340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.29799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.255},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.873}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.79500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":278347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.376},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.25800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.31},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.34300000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":278347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.25},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.26800000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.6960000000000002,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.29799999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.502},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.497}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.42599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":281236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":279722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.498}]},{"osd":2,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.623}]},{"osd":4,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:17:32.235 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:17:32.236 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:17:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.388+0000 7f534c360700 1 Processor -- start 2023-10-06T03:17:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.388+0000 7f534c360700 1 -- start start 2023-10-06T03:17:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f534c360700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5344159890 0x7f53440b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f534c360700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440b1be0 0x7f5344159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f534c360700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53440cd860 con 0x7f53440cdcf0 2023-10-06T03:17:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f534c360700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440ce190 con 0x7f5344159890 2023-10-06T03:17:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f534c360700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53440ccc50 con 0x7f53440b1be0 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f53498fb700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f53440cdcf0 0x7f53440b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34704/0 (socket says 172.21.15.82:34704) 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f53498fb700 1 -- 172.21.15.82:0/697744117 learned_addr learned my addr 172.21.15.82:0/697744117 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f534a0fc700 1 --2- 172.21.15.82:0/697744117 >> v2:172.21.15.134:3300/0 conn(0x7f5344159890 0x7f53440b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f534a8fd700 1 --2- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440b1be0 0x7f5344159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f53490fa700 1 -- 172.21.15.82:0/697744117 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135938441 0 0) 0x7f53440cd860 con 0x7f53440cdcf0 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.389+0000 7f53490fa700 1 -- 172.21.15.82:0/697744117 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5330003570 con 0x7f53440cdcf0 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f534a0fc700 1 -- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440b1be0 msgr2=0x7f5344159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f534a0fc700 1 --2- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440b1be0 0x7f5344159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f534a0fc700 1 -- 172.21.15.82:0/697744117 >> v1:172.21.15.82:6789/0 conn(0x7f53440cdcf0 legacy=0x7f53440b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f534a0fc700 1 -- 172.21.15.82:0/697744117 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53440ccf30 con 0x7f5344159890 2023-10-06T03:17:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f534a8fd700 1 --2- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440b1be0 0x7f5344159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f534a0fc700 1 --2- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344159890 0x7f53440b0eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5340009eb0 tx=0x7f5340009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd0da0881f191012 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f53490fa700 1 -- 172.21.15.82:0/697744117 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000e070 con 0x7f5344159890 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f53490fa700 1 -- 172.21.15.82:0/697744117 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000bb80 con 0x7f5344159890 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f53490fa700 1 -- 172.21.15.82:0/697744117 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340012430 con 0x7f5344159890 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f534c360700 1 -- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344159890 msgr2=0x7f53440b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.390+0000 7f534c360700 1 --2- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344159890 0x7f53440b0eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5340009eb0 tx=0x7f5340009780 comp rx=0 tx=0).stop 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.391+0000 7f534c360700 1 -- 172.21.15.82:0/697744117 shutdown_connections 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.391+0000 7f534c360700 1 --2- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440b1be0 0x7f5344159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.391+0000 7f534c360700 1 --2- 172.21.15.82:0/697744117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344159890 0x7f53440b0eb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.391+0000 7f534c360700 1 -- 172.21.15.82:0/697744117 >> 172.21.15.82:0/697744117 conn(0x7f5344099990 msgr2=0x7f53440b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.391+0000 7f534c360700 1 -- 172.21.15.82:0/697744117 shutdown_connections 2023-10-06T03:17:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.391+0000 7f534c360700 1 -- 172.21.15.82:0/697744117 wait complete. 2023-10-06T03:17:32.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534c360700 1 Processor -- start 2023-10-06T03:17:32.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534c360700 1 -- start start 2023-10-06T03:17:32.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534c360700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53440b1be0 0x7f534415bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534c360700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440cdcf0 0x7f534415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534c360700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344159890 0x7f534415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534c360700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440ac550 con 0x7f5344159890 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534c360700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440ac830 con 0x7f53440b1be0 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534c360700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53440acb10 con 0x7f53440cdcf0 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.392+0000 7f534a8fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344159890 0x7f534415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534a8fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344159890 0x7f534415b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50984/0 (socket says 172.21.15.82:50984) 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534a8fd700 1 -- 172.21.15.82:0/1721942644 learned_addr learned my addr 172.21.15.82:0/1721942644 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534a8fd700 1 -- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440cdcf0 msgr2=0x7f534415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534a8fd700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440cdcf0 0x7f534415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534a8fd700 1 -- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53440b1be0 msgr2=0x7f534415bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534a8fd700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53440b1be0 0x7f534415bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534a8fd700 1 -- 172.21.15.82:0/1721942644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009420 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534a8fd700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344159890 0x7f534415b170 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f533c009fd0 tx=0x7f533c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f533a7fc700 1 -- 172.21.15.82:0/1721942644 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00c850 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f533a7fc700 1 -- 172.21.15.82:0/1721942644 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c00c9b0 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5340009a20 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f533a7fc700 1 -- 172.21.15.82:0/1721942644 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00cd30 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.393+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53440ad0d0 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.394+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5344064050 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.394+0000 7f533a7fc700 1 -- 172.21.15.82:0/1721942644 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f533c013680 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.395+0000 7f533a7fc700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5328066f30 0x7f53280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.395+0000 7f533a7fc700 1 -- 172.21.15.82:0/1721942644 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f533c084a30 con 0x7f5344159890 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.395+0000 7f534a0fc700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5328066f30 0x7f53280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.395+0000 7f534a0fc700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5328066f30 0x7f53280693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5340009eb0 tx=0x7f5340019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.399+0000 7f533a7fc700 1 -- 172.21.15.82:0/1721942644 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f533c051aa0 con 0x7f5344159890 2023-10-06T03:17:32.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.658+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5344089e10 con 0x7f5344159890 2023-10-06T03:17:32.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.662+0000 7f533a7fc700 1 -- 172.21.15.82:0/1721942644 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f533c084020 con 0x7f5344159890 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5328066f30 msgr2=0x7f53280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5328066f30 0x7f53280693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5340009eb0 tx=0x7f5340019000 comp rx=0 tx=0).stop 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344159890 msgr2=0x7f534415b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344159890 0x7f534415b170 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f533c009fd0 tx=0x7f533c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 shutdown_connections 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344159890 0x7f534415b170 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53440b1be0 0x7f534415bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5328066f30 0x7f53280693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 --2- 172.21.15.82:0/1721942644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53440cdcf0 0x7f534415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 >> 172.21.15.82:0/1721942644 conn(0x7f5344099990 msgr2=0x7f53440ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 shutdown_connections 2023-10-06T03:17:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.664+0000 7f534c360700 1 -- 172.21.15.82:0/1721942644 wait complete. 2023-10-06T03:17:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-10-06T03:17:32.677 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.789+0000 7faee0e05700 1 Processor -- start 2023-10-06T03:17:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.789+0000 7faee0e05700 1 -- start start 2023-10-06T03:17:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faee0e05700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 0x7faedc069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faee0e05700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faedc069da0 0x7faedc0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faee0e05700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0687c0 con 0x7faedc15d850 2023-10-06T03:17:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faee0e05700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc068aa0 con 0x7faedc069da0 2023-10-06T03:17:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faee0e05700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc068d80 con 0x7faedc15d480 2023-10-06T03:17:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faedaffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faedc069da0 0x7faedc0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faedaffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faedc069da0 0x7faedc0b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51000/0 (socket says 172.21.15.82:51000) 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faedaffd700 1 -- 172.21.15.82:0/932382550 learned_addr learned my addr 172.21.15.82:0/932382550 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faedaffd700 1 -- 172.21.15.82:0/932382550 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 msgr2=0x7faedc069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faedaffd700 1 --2- 172.21.15.82:0/932382550 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 0x7faedc069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faedaffd700 1 -- 172.21.15.82:0/932382550 >> v1:172.21.15.134:6789/0 conn(0x7faedc15d850 legacy=0x7faedc142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faedaffd700 1 -- 172.21.15.82:0/932382550 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc069060 con 0x7faedc069da0 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.790+0000 7faedaffd700 1 --2- 172.21.15.82:0/932382550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0b0310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7faed00099b0 tx=0x7faed0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4204b5857e411368 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faeda7fc700 1 -- 172.21.15.82:0/932382550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000b820 con 0x7faedc069da0 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faeda7fc700 1 -- 172.21.15.82:0/932382550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000b980 con 0x7faedc069da0 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faeda7fc700 1 -- 172.21.15.82:0/932382550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000bd20 con 0x7faedc069da0 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faee0e05700 1 -- 172.21.15.82:0/932382550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 msgr2=0x7faedc0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faee0e05700 1 --2- 172.21.15.82:0/932382550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0b0310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7faed00099b0 tx=0x7faed0009250 comp rx=0 tx=0).stop 2023-10-06T03:17:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faee0e05700 1 -- 172.21.15.82:0/932382550 shutdown_connections 2023-10-06T03:17:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faee0e05700 1 --2- 172.21.15.82:0/932382550 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 0x7faedc069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faee0e05700 1 --2- 172.21.15.82:0/932382550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0b0310 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faee0e05700 1 -- 172.21.15.82:0/932382550 >> 172.21.15.82:0/932382550 conn(0x7faedc0ccf80 msgr2=0x7faedc0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faee0e05700 1 -- 172.21.15.82:0/932382550 shutdown_connections 2023-10-06T03:17:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.791+0000 7faee0e05700 1 -- 172.21.15.82:0/932382550 wait complete. 2023-10-06T03:17:32.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.792+0000 7faee0e05700 1 Processor -- start 2023-10-06T03:17:32.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.792+0000 7faee0e05700 1 -- start start 2023-10-06T03:17:32.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faee0e05700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faee0e05700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 0x7faedc0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faee0e05700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faedc15d850 0x7faedc169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faee0e05700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc16aae0 con 0x7faedc069da0 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faee0e05700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc140890 con 0x7faedc15d850 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faee0e05700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc16a010 con 0x7faedc15d480 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51008/0 (socket says 172.21.15.82:51008) 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faedb7fe700 1 -- 172.21.15.82:0/2890880982 learned_addr learned my addr 172.21.15.82:0/2890880982 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faedb7fe700 1 -- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 msgr2=0x7faedc0ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faedaffd700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 0x7faedc0ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faedbfff700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faedc15d850 0x7faedc169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.793+0000 7faedb7fe700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 0x7faedc0ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faedb7fe700 1 -- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faedc15d850 msgr2=0x7faedc169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faedb7fe700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faedc15d850 0x7faedc169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faedb7fe700 1 -- 172.21.15.82:0/2890880982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00094f0 con 0x7faedc069da0 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faedaffd700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 0x7faedc0ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faedbfff700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faedc15d850 0x7faedc169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faedb7fe700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0ae960 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7faecc00bc30 tx=0x7faecc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faec37fe700 1 -- 172.21.15.82:0/2890880982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0092e0 con 0x7faedc069da0 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faec37fe700 1 -- 172.21.15.82:0/2890880982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00c830 con 0x7faedc069da0 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc0c8560 con 0x7faedc069da0 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faec37fe700 1 -- 172.21.15.82:0/2890880982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00cc10 con 0x7faedc069da0 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.794+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc16a520 con 0x7faedc069da0 2023-10-06T03:17:32.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.795+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc04c3c0 con 0x7faedc069da0 2023-10-06T03:17:32.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.795+0000 7faec37fe700 1 -- 172.21.15.82:0/2890880982 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faecc012070 con 0x7faedc069da0 2023-10-06T03:17:32.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.795+0000 7faec37fe700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faec8066f30 0x7faec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:32.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.796+0000 7faec37fe700 1 -- 172.21.15.82:0/2890880982 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faecc084360 con 0x7faedc069da0 2023-10-06T03:17:32.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.796+0000 7faedaffd700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faec8066f30 0x7faec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:32.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.796+0000 7faedaffd700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faec8066f30 0x7faec80693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faed00099b0 tx=0x7faed0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:32.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:32.800+0000 7faec37fe700 1 -- 172.21.15.82:0/2890880982 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faecc051520 con 0x7faedc069da0 2023-10-06T03:17:33.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.032+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faedc070fe0 con 0x7faedc069da0 2023-10-06T03:17:33.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.033+0000 7faec37fe700 1 -- 172.21.15.82:0/2890880982 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4592 (secure 0 0 0) 0x7faecc054b40 con 0x7faedc069da0 2023-10-06T03:17:33.035 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:33.035 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/763820094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":763820094},{"type":"v1","addr":"172.21.15.134:6837","nonce":763820094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/1309129480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1309129480},{"type":"v1","addr":"172.21.15.134:6836","nonce":1309129480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/21148295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":21148295},{"type":"v1","addr":"172.21.15.82:6834","nonce":21148295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:27.187663+0000","modified":"2023-10-06T03:17:30.826288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5706":{"gid":5706,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/598797511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":598797511},{"type":"v1","addr":"172.21.15.82:6835","nonce":598797511}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:17:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faec8066f30 msgr2=0x7faec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faec8066f30 0x7faec80693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faed00099b0 tx=0x7faed0016000 comp rx=0 tx=0).stop 2023-10-06T03:17:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 msgr2=0x7faedc0ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0ae960 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7faecc00bc30 tx=0x7faecc009840 comp rx=0 tx=0).stop 2023-10-06T03:17:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 shutdown_connections 2023-10-06T03:17:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faedc15d850 0x7faedc169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc069da0 0x7faedc0ae960 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7faec8066f30 0x7faec80693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 --2- 172.21.15.82:0/2890880982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faedc15d480 0x7faedc0ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 >> 172.21.15.82:0/2890880982 conn(0x7faedc0ccf80 msgr2=0x7faedc0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 shutdown_connections 2023-10-06T03:17:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.035+0000 7faee0e05700 1 -- 172.21.15.82:0/2890880982 wait complete. 2023-10-06T03:17:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-10-06T03:17:33.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:17:27.187663+0000', 'modified': '2023-10-06T03:17:30.826288+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5706}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5706': {'gid': 5706, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6835/598797511', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6833', 'nonce': 598797511}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 598797511}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:17:33.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:17:33.451 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:17:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.566+0000 7f0b7298b700 1 Processor -- start 2023-10-06T03:17:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.566+0000 7f0b7298b700 1 -- start start 2023-10-06T03:17:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b7298b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b6c159500 0x7f0b6c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b7298b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c15dab0 0x7f0b6c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b7298b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c0b1110 con 0x7f0b6c0b3fd0 2023-10-06T03:17:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b7298b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b13b0 con 0x7f0b6c159500 2023-10-06T03:17:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b7298b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b1690 con 0x7f0b6c15dab0 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b6c159500 0x7f0b6c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b6c159500 0x7f0b6c1598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51010/0 (socket says 172.21.15.82:51010) 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6bfff700 1 -- 172.21.15.82:0/1124845782 learned_addr learned my addr 172.21.15.82:0/1124845782 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6bfff700 1 -- 172.21.15.82:0/1124845782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c15dab0 msgr2=0x7f0b6c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b70f28700 1 --2- 172.21.15.82:0/1124845782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c15dab0 0x7f0b6c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/1124845782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c15dab0 0x7f0b6c0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6bfff700 1 -- 172.21.15.82:0/1124845782 >> v1:172.21.15.134:6789/0 conn(0x7f0b6c0b3fd0 legacy=0x7f0b6c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6bfff700 1 -- 172.21.15.82:0/1124845782 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0b1970 con 0x7f0b6c159500 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/1124845782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c159500 0x7f0b6c1598d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0b600099b0 tx=0x7f0b60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1047388f2a993f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6affd700 1 -- 172.21.15.82:0/1124845782 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000b820 con 0x7f0b6c159500 2023-10-06T03:17:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6affd700 1 -- 172.21.15.82:0/1124845782 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000b980 con 0x7f0b6c159500 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.567+0000 7f0b6affd700 1 -- 172.21.15.82:0/1124845782 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000bd20 con 0x7f0b6c159500 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.568+0000 7f0b7298b700 1 -- 172.21.15.82:0/1124845782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c159500 msgr2=0x7f0b6c1598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.568+0000 7f0b7298b700 1 --2- 172.21.15.82:0/1124845782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c159500 0x7f0b6c1598d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0b600099b0 tx=0x7f0b60009250 comp rx=0 tx=0).stop 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.568+0000 7f0b7298b700 1 -- 172.21.15.82:0/1124845782 shutdown_connections 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.568+0000 7f0b7298b700 1 --2- 172.21.15.82:0/1124845782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c15dab0 0x7f0b6c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.568+0000 7f0b7298b700 1 --2- 172.21.15.82:0/1124845782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c159500 0x7f0b6c1598d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.568+0000 7f0b7298b700 1 -- 172.21.15.82:0/1124845782 >> 172.21.15.82:0/1124845782 conn(0x7f0b6c067630 msgr2=0x7f0b6c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.568+0000 7f0b7298b700 1 -- 172.21.15.82:0/1124845782 shutdown_connections 2023-10-06T03:17:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.568+0000 7f0b7298b700 1 -- 172.21.15.82:0/1124845782 wait complete. 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.569+0000 7f0b7298b700 1 Processor -- start 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.569+0000 7f0b7298b700 1 -- start start 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b7298b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c0b3fd0 0x7f0b6c13c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b7298b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b6c159500 0x7f0b6c14e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b7298b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c15dab0 0x7f0b6c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b7298b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c16bd20 con 0x7f0b6c15dab0 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b7298b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c16b430 con 0x7f0b6c159500 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b7298b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c068710 con 0x7f0b6c0b3fd0 2023-10-06T03:17:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c15dab0 0x7f0b6c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c15dab0 0x7f0b6c14ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51016/0 (socket says 172.21.15.82:51016) 2023-10-06T03:17:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 -- 172.21.15.82:0/272805500 learned_addr learned my addr 172.21.15.82:0/272805500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b6b7fe700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b6c159500 0x7f0b6c14e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c0b3fd0 0x7f0b6c13c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 -- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c0b3fd0 msgr2=0x7f0b6c13c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c0b3fd0 0x7f0b6c13c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 -- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b6c159500 msgr2=0x7f0b6c14e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b6c159500 0x7f0b6c14e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 -- 172.21.15.82:0/272805500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600094f0 con 0x7f0b6c15dab0 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.570+0000 7f0b70f28700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c15dab0 0x7f0b6c14ea60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400ce80 tx=0x7f0b64007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.571+0000 7f0b53fff700 1 -- 172.21.15.82:0/272805500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400ae40 con 0x7f0b6c15dab0 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.571+0000 7f0b53fff700 1 -- 172.21.15.82:0/272805500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b64016430 con 0x7f0b6c15dab0 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.571+0000 7f0b53fff700 1 -- 172.21.15.82:0/272805500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640167d0 con 0x7f0b6c15dab0 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.571+0000 7f0b7298b700 1 -- 172.21.15.82:0/272805500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c16b6d0 con 0x7f0b6c15dab0 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.571+0000 7f0b7298b700 1 -- 172.21.15.82:0/272805500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c13c760 con 0x7f0b6c15dab0 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.572+0000 7f0b53fff700 1 -- 172.21.15.82:0/272805500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b64003020 con 0x7f0b6c15dab0 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.573+0000 7f0b53fff700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0b58066f30 0x7f0b580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.573+0000 7f0b53fff700 1 -- 172.21.15.82:0/272805500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0b64012070 con 0x7f0b6c15dab0 2023-10-06T03:17:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.573+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0b58066f30 0x7f0b580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.574+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0b58066f30 0x7f0b580693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0b600099b0 tx=0x7f0b60016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.575+0000 7f0b7bc83b80 1 Processor -- start 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.575+0000 7f0b7bc83b80 1 -- start start 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.575+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x55578906bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.575+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.575+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x5557890bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.575+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555788fc2a70 con 0x5557890bbc00 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.575+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x555788fc0270 con 0x55578906ccc0 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.575+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x555788fbc060 con 0x55578906b840 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x5557890bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x5557890bc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51032/0 (socket says 172.21.15.82:51032) 2023-10-06T03:17:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 -- 172.21.15.82:0/3831129919 learned_addr learned my addr 172.21.15.82:0/3831129919 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b6b7fe700 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x55578906bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 -- 172.21.15.82:0/3831129919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 msgr2=0x55578906bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x55578906bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 -- 172.21.15.82:0/3831129919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 msgr2=0x5557890bb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890bb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 -- 172.21.15.82:0/3831129919 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555788e56270 con 0x5557890bbc00 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b70f28700 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x5557890bc050 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0b640838f0 tx=0x7f0b64083880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4641cd8bfc9119 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b517fa700 1 -- 172.21.15.82:0/3831129919 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64059580 con 0x5557890bbc00 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b517fa700 1 -- 172.21.15.82:0/3831129919 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6405d2d0 con 0x5557890bbc00 2023-10-06T03:17:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.576+0000 7f0b517fa700 1 -- 172.21.15.82:0/3831129919 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640546d0 con 0x5557890bbc00 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/3831129919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 msgr2=0x5557890bc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x5557890bc050 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0b640838f0 tx=0x7f0b64083880 comp rx=0 tx=0).stop 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/3831129919 shutdown_connections 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x5557890bc050 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x55578906bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/3831129919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890bb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/3831129919 >> 172.21.15.82:0/3831129919 conn(0x55578906d160 msgr2=0x55578906d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/3831129919 shutdown_connections 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/3831129919 wait complete. 2023-10-06T03:17:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.577+0000 7f0b7bc83b80 1 -- start start 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b7bc83b80 1 Processor -- start 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906b840 0x5557890b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5557890bbc00 0x5557890aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555788f67890 con 0x55578906b840 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x555788f82ea0 con 0x55578906ccc0 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x555788e3ee30 con 0x5557890bbc00 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b7bc83b80 10 client.0 _ll_register_callbacks cb 0x55578902ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:17:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b6bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906b840 0x5557890b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b6bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906b840 0x5557890b9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51040/0 (socket says 172.21.15.82:51040) 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.578+0000 7f0b6bfff700 1 -- 172.21.15.82:0/1658252466 learned_addr learned my addr 172.21.15.82:0/1658252466 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b6b7fe700 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b6bfff700 1 -- 172.21.15.82:0/1658252466 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5557890bbc00 msgr2=0x5557890aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5557890bbc00 0x5557890aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b6bfff700 1 -- 172.21.15.82:0/1658252466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 msgr2=0x5557890ba1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890ba1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b6bfff700 1 -- 172.21.15.82:0/1658252466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c13c760 con 0x55578906b840 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906b840 0x5557890b9c90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000b3c0 tx=0x7f0b6001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab31a1cde25d434 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b4a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-10-06T03:17:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/1658252466 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60011e10 con 0x55578906b840 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/1658252466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555789060940 con 0x55578906b840 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/1658252466 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0b60034c90 con 0x55578906b840 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/1658252466 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b60034e50 con 0x55578906b840 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 10 client.5850 fetch_fsmap learned FSMap version 30 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/1658252466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x555788df8fe0 con 0x55578906b840 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/1658252466 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555789060940 con 0x55578906b840 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/1658252466 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b6001d880 con 0x55578906b840 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 10 client.5850 fetch_fsmap finished waiting for FSMap version 30 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 10 client.5850 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 20 client.5850 populate_metadata read hostname 'smithi082' 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] conn(0x5557890943c0 0x5557890aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 4 client.5850 mds_command: new command op to 5706 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.579+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/1658252466 --> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55578903d870 con 0x5557890943c0 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b6b7fe700 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] conn(0x5557890943c0 0x5557890aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b4a7fc700 10 client.5850 ms_handle_connect on v2:172.21.15.82:6833/598797511 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b6b7fe700 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] conn(0x5557890943c0 0x5557890aab30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca07bfe25d8db26 server_cookie=94975309e33e82da in_seq=0 out_seq=0 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/1658252466 <== mds.0 v2:172.21.15.82:6833/598797511 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55578903d870 con 0x5557890943c0 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b4a7fc700 10 client.5850 handle_command_reply: tid=0 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b7bc83b80 1 client.5850 shutdown 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/1658252466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906b840 msgr2=0x5557890b9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906b840 0x5557890b9c90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000b3c0 tx=0x7f0b6001f040 comp rx=0 tx=0).stop 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/1658252466 shutdown_connections 2023-10-06T03:17:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] conn(0x5557890943c0 0x5557890aab30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5557890bbc00 0x5557890aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.580+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906b840 0x5557890b9c90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.581+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/1658252466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890ba1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.581+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/1658252466 >> 172.21.15.82:0/1658252466 conn(0x55578906d160 msgr2=0x55578906c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.581+0000 7f0b4a7fc700 0 client.5850 ms_handle_reset on v2:172.21.15.82:6833/598797511 2023-10-06T03:17:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.581+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/1658252466 shutdown_connections 2023-10-06T03:17:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.581+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/1658252466 wait complete. 2023-10-06T03:17:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.581+0000 7f0b7bc83b80 20 client.5850 trim_cache size 0 max 16384 2023-10-06T03:17:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.597+0000 7f0b7bc83b80 1 Processor -- start 2023-10-06T03:17:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b7bc83b80 1 -- start start 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x55578906eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890937d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x555789094350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55578906e0b0 con 0x5557890bbc00 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55578906adc0 con 0x55578906ccc0 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557890af1a0 con 0x55578906b840 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b70f28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x555789094350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.598+0000 7f0b70f28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x555789094350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51052/0 (socket says 172.21.15.82:51052) 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b70f28700 1 -- 172.21.15.82:0/680243333 learned_addr learned my addr 172.21.15.82:0/680243333 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b70f28700 1 -- 172.21.15.82:0/680243333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 msgr2=0x55578906eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b70f28700 1 --2- 172.21.15.82:0/680243333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x55578906eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b70f28700 1 -- 172.21.15.82:0/680243333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 msgr2=0x5557890937d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b70f28700 1 --2- 172.21.15.82:0/680243333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890937d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b70f28700 1 -- 172.21.15.82:0/680243333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555788f8a780 con 0x5557890bbc00 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b70f28700 1 --2- 172.21.15.82:0/680243333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x555789094350 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b64052d20 tx=0x7f0b64071000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aebd453f5d3c024 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b51ffb700 1 -- 172.21.15.82:0/680243333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640563b0 con 0x5557890bbc00 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b51ffb700 1 -- 172.21.15.82:0/680243333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b64059580 con 0x5557890bbc00 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b51ffb700 1 -- 172.21.15.82:0/680243333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640567a0 con 0x5557890bbc00 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/680243333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 msgr2=0x555789094350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.599+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/680243333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x555789094350 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b64052d20 tx=0x7f0b64071000 comp rx=0 tx=0).stop 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/680243333 shutdown_connections 2023-10-06T03:17:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/680243333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557890bbc00 0x555789094350 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/680243333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x55578906eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/680243333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55578906ccc0 0x5557890937d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/680243333 >> 172.21.15.82:0/680243333 conn(0x55578906d160 msgr2=0x5557890bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/680243333 shutdown_connections 2023-10-06T03:17:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/680243333 wait complete. 2023-10-06T03:17:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 -- start start 2023-10-06T03:17:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.600+0000 7f0b7bc83b80 1 Processor -- start 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x555789117410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906ccc0 0x5557891112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b7bc83b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5557890bbc00 0x5557890af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557890b5470 con 0x55578906ccc0 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557890b4b40 con 0x5557890bbc00 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b7bc83b80 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557890b4e20 con 0x55578906b840 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b7bc83b80 10 client.0 _ll_register_callbacks cb 0x55578902ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906ccc0 0x5557891112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906ccc0 0x5557891112a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51058/0 (socket says 172.21.15.82:51058) 2023-10-06T03:17:33.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6b7fe700 1 -- 172.21.15.82:0/4381686 learned_addr learned my addr 172.21.15.82:0/4381686 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b70f28700 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5557890bbc00 0x5557890af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x555789117410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6b7fe700 1 -- 172.21.15.82:0/4381686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 msgr2=0x555789117410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6b7fe700 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x555789117410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6b7fe700 1 -- 172.21.15.82:0/4381686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5557890bbc00 msgr2=0x5557890af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6b7fe700 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5557890bbc00 0x5557890af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.601+0000 7f0b6b7fe700 1 -- 172.21.15.82:0/4381686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555788e56270 con 0x55578906ccc0 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b6b7fe700 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906ccc0 0x5557891112a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c140020 tx=0x7f0b5c0171e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a316e622dc64e1f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b4a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/4381686 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0179f0 con 0x55578906ccc0 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/4381686 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0b5c017b50 con 0x55578906ccc0 2023-10-06T03:17:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/4381686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557890b73c0 con 0x55578906ccc0 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/4381686 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b5c013400 con 0x55578906ccc0 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 10 client.5856 fetch_fsmap learned FSMap version 30 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/4381686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x555788f71470 con 0x55578906ccc0 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/4381686 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557890b73c0 con 0x55578906ccc0 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/4381686 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b5c013560 con 0x55578906ccc0 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 10 client.5856 fetch_fsmap finished waiting for FSMap version 30 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 10 client.5856 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 20 client.5856 populate_metadata read hostname 'smithi082' 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] conn(0x5557890ce140 0x5557890ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 4 client.5856 mds_command: new command op to 5706 tid=0[{"prefix": "status"}] 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/4381686 --> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f0b6405d2d0 con 0x5557890ce140 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] conn(0x5557890ce140 0x5557890ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b4a7fc700 10 client.5856 ms_handle_connect on v2:172.21.15.82:6833/598797511 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.602+0000 7f0b6bfff700 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] conn(0x5557890ce140 0x5557890ce510 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee25cf063027b3 server_cookie=3effafba8cd640fa in_seq=0 out_seq=0 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b4a7fc700 1 -- 172.21.15.82:0/4381686 <== mds.0 v2:172.21.15.82:6833/598797511 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f0b6405d2d0 con 0x5557890ce140 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b4a7fc700 10 client.5856 handle_command_reply: tid=0 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 client.5856 shutdown 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/4381686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906ccc0 msgr2=0x5557891112a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906ccc0 0x5557891112a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c140020 tx=0x7f0b5c0171e0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/4381686 shutdown_connections 2023-10-06T03:17:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.82:6833/598797511,v1:172.21.15.82:6835/598797511] conn(0x5557890ce140 0x5557890ce510 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5557890bbc00 0x5557890af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55578906b840 0x555789117410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 --2- 172.21.15.82:0/4381686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55578906ccc0 0x5557891112a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b4a7fc700 0 client.5856 ms_handle_reset on v2:172.21.15.82:6833/598797511 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/4381686 >> 172.21.15.82:0/4381686 conn(0x55578906d160 msgr2=0x5557890ba250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/4381686 shutdown_connections 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 1 -- 172.21.15.82:0/4381686 wait complete. 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7bc83b80 20 client.5856 trim_cache size 0 max 16384 2023-10-06T03:17:33.612 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "968d6894-b90c-4b96-8e67-09d8a805d810", 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5706, 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 5.7834658049999996, 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 30, 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 55, 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 55, 2023-10-06T03:17:33.613 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 11.910982602000001 2023-10-06T03:17:33.614 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:33.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 -- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0b58066f30 msgr2=0x7f0b580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0b58066f30 0x7f0b580693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0b600099b0 tx=0x7f0b60016000 comp rx=0 tx=0).stop 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 -- 172.21.15.82:0/272805500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c15dab0 msgr2=0x7f0b6c14ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c15dab0 0x7f0b6c14ea60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400ce80 tx=0x7f0b64007840 comp rx=0 tx=0).stop 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 -- 172.21.15.82:0/272805500 shutdown_connections 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6c15dab0 0x7f0b6c14ea60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0b58066f30 0x7f0b580693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b6c0b3fd0 0x7f0b6c13c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 --2- 172.21.15.82:0/272805500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b6c159500 0x7f0b6c14e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 -- 172.21.15.82:0/272805500 >> 172.21.15.82:0/272805500 conn(0x7f0b6c067630 msgr2=0x7f0b6c14d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.603+0000 7f0b7298b700 1 -- 172.21.15.82:0/272805500 shutdown_connections 2023-10-06T03:17:33.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.604+0000 7f0b7298b700 1 -- 172.21.15.82:0/272805500 wait complete. 2023-10-06T03:17:33.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:17:33.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.729+0000 7fa9f501d700 1 Processor -- start 2023-10-06T03:17:33.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.729+0000 7fa9f501d700 1 -- start start 2023-10-06T03:17:33.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.730+0000 7fa9f501d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9f01596c0 0x7fa9f015d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.730+0000 7fa9f501d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f00b09a0 0x7fa9f00c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.730+0000 7fa9f501d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f015e3a0 con 0x7fa9f015d960 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.730+0000 7fa9f501d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00cc470 con 0x7fa9f01596c0 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.730+0000 7fa9f501d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f015dde0 con 0x7fa9f00b09a0 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.730+0000 7fa9eed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9f01596c0 0x7fa9f015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.730+0000 7fa9ef59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa9f015d960 0x7fa9f0068fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34716/0 (socket says 172.21.15.82:34716) 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.730+0000 7fa9ef59e700 1 -- 172.21.15.82:0/2522488314 learned_addr learned my addr 172.21.15.82:0/2522488314 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9e659c700 1 --2- 172.21.15.82:0/2522488314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f00b09a0 0x7fa9f00c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9eed9d700 1 -- 172.21.15.82:0/2522488314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f00b09a0 msgr2=0x7fa9f00c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9eed9d700 1 --2- 172.21.15.82:0/2522488314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f00b09a0 0x7fa9f00c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9eed9d700 1 -- 172.21.15.82:0/2522488314 >> v1:172.21.15.82:6789/0 conn(0x7fa9f015d960 legacy=0x7fa9f0068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9eed9d700 1 -- 172.21.15.82:0/2522488314 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f015e0c0 con 0x7fa9f01596c0 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9ee59c700 1 -- 172.21.15.82:0/2522488314 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326727694 0 0) 0x7fa9f015e3a0 con 0x7fa9f015d960 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9e659c700 1 --2- 172.21.15.82:0/2522488314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f00b09a0 0x7fa9f00c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9eed9d700 1 --2- 172.21.15.82:0/2522488314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01596c0 0x7fa9f015d420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00098e0 tx=0x7fa9e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f075046d63dc74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9ee59c700 1 -- 172.21.15.82:0/2522488314 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0009e80 con 0x7fa9f01596c0 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9ee59c700 1 -- 172.21.15.82:0/2522488314 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e000b860 con 0x7fa9f01596c0 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9ee59c700 1 -- 172.21.15.82:0/2522488314 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000bbe0 con 0x7fa9f01596c0 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9f501d700 1 -- 172.21.15.82:0/2522488314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01596c0 msgr2=0x7fa9f015d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9f501d700 1 --2- 172.21.15.82:0/2522488314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01596c0 0x7fa9f015d420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00098e0 tx=0x7fa9e00091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9f501d700 1 -- 172.21.15.82:0/2522488314 shutdown_connections 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9f501d700 1 --2- 172.21.15.82:0/2522488314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01596c0 0x7fa9f015d420 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9f501d700 1 --2- 172.21.15.82:0/2522488314 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f00b09a0 0x7fa9f00c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9f501d700 1 -- 172.21.15.82:0/2522488314 >> 172.21.15.82:0/2522488314 conn(0x7fa9f0067630 msgr2=0x7fa9f0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9f501d700 1 -- 172.21.15.82:0/2522488314 shutdown_connections 2023-10-06T03:17:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.731+0000 7fa9f501d700 1 -- 172.21.15.82:0/2522488314 wait complete. 2023-10-06T03:17:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.733+0000 7fa9f501d700 1 Processor -- start 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.733+0000 7fa9f501d700 1 -- start start 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.733+0000 7fa9f501d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f01596c0 0x7fa9f0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.733+0000 7fa9f501d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01577e0 0x7fa9f0156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.733+0000 7fa9f501d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f01571a0 0x7fa9f0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.733+0000 7fa9f501d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f015c3a0 con 0x7fa9f01577e0 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.733+0000 7fa9f501d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f015b790 con 0x7fa9f01571a0 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.733+0000 7fa9f501d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f015ba70 con 0x7fa9f01596c0 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01577e0 0x7fa9f0156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01577e0 0x7fa9f0156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51064/0 (socket says 172.21.15.82:51064) 2023-10-06T03:17:33.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 -- 172.21.15.82:0/3704172646 learned_addr learned my addr 172.21.15.82:0/3704172646 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9eed9d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f01596c0 0x7fa9f0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 -- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f01596c0 msgr2=0x7fa9f0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f01596c0 0x7fa9f0159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9ef59e700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f01571a0 0x7fa9f0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 -- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f01571a0 msgr2=0x7fa9f0156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f01571a0 0x7fa9f0156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 -- 172.21.15.82:0/3704172646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009420 con 0x7fa9f01577e0 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9ef59e700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f01571a0 0x7fa9f0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e659c700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01577e0 0x7fa9f0156640 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800c830 tx=0x7fa9d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e77fe700 1 -- 172.21.15.82:0/3704172646 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011600 con 0x7fa9f01577e0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e77fe700 1 -- 172.21.15.82:0/3704172646 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d8011760 con 0x7fa9f01577e0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f015bd50 con 0x7fa9f01577e0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9e77fe700 1 -- 172.21.15.82:0/3704172646 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011b20 con 0x7fa9f01577e0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.734+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f015b3d0 con 0x7fa9f01577e0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.735+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0064050 con 0x7fa9f01577e0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.736+0000 7fa9e77fe700 1 -- 172.21.15.82:0/3704172646 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9d800a3e0 con 0x7fa9f01577e0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.736+0000 7fa9e77fe700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa9d0066f30 0x7fa9d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.736+0000 7fa9e77fe700 1 -- 172.21.15.82:0/3704172646 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9d8084b60 con 0x7fa9f01577e0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.736+0000 7fa9eed9d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa9d0066f30 0x7fa9d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.737+0000 7fa9eed9d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa9d0066f30 0x7fa9d00693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0003080 tx=0x7fa9e0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:33.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.740+0000 7fa9e77fe700 1 -- 172.21.15.82:0/3704172646 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9d8051c70 con 0x7fa9f01577e0 2023-10-06T03:17:33.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.967+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa9f006af50 con 0x7fa9f01577e0 2023-10-06T03:17:34.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.967+0000 7fa9e77fe700 1 -- 172.21.15.82:0/3704172646 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa9d8015070 con 0x7fa9f01577e0 2023-10-06T03:17:34.040 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:17:34.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa9d0066f30 msgr2=0x7fa9d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:34.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa9d0066f30 0x7fa9d00693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0003080 tx=0x7fa9e0017000 comp rx=0 tx=0).stop 2023-10-06T03:17:34.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01577e0 msgr2=0x7fa9f0156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:34.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01577e0 0x7fa9f0156640 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800c830 tx=0x7fa9d8008040 comp rx=0 tx=0).stop 2023-10-06T03:17:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 shutdown_connections 2023-10-06T03:17:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9f01571a0 0x7fa9f0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa9d0066f30 0x7fa9d00693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9f01596c0 0x7fa9f0159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 --2- 172.21.15.82:0/3704172646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9f01577e0 0x7fa9f0156640 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 >> 172.21.15.82:0/3704172646 conn(0x7fa9f0067630 msgr2=0x7fa9f00b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 shutdown_connections 2023-10-06T03:17:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:33.969+0000 7fa9f501d700 1 -- 172.21.15.82:0/3704172646 wait complete. 2023-10-06T03:17:34.043 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:17:34.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:17:34.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-10-06T03:17:34.044 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:17:34.044 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:34.044 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:17:34.044 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:17:34.044 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:17:34.044 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:17:34.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:34.045 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-10-06T03:17:34.063 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:17:34.063 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:17:34.063 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:17:34.063 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:34.063 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-10-06T03:17:34.063 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:34.063 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:34.063 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42409sec preferred_lft 42409sec 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-10-06T03:17:34.064 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 36:95:8d:ad:89:e0 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::8c5f:c4ff:fe3a:9eac/64 scope link 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether be:dd:8c:84:42:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::bcdd:8cff:fe84:42c0/64 scope link 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:17:34.065 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 36:95:8d:ad:89:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:17:34.066 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::3495:8dff:fead:89e0/64 scope link 2023-10-06T03:17:34.066 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:34.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:34.066 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:17:34.129 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-10-06T03:17:34.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:34.130 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-10-06T03:17:34.189 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-10-06T03:17:34.189 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:17:34.189 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:17:34.189 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:17:34.189 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:17:34.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:34.190 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-10-06T03:17:34.190 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-10-06T03:17:34.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:17:34.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:17:34.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:17:34.190 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-10-06T03:17:34.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:34.291 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:17:34.305 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:17:34.305 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:17:34.305 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:17:34.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:34.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-10-06T03:17:34.371 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:17:34.371 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:34.425 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:17:34.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:17:34.425 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:34.479 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:17:34.479 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:17:34.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:17:34.558 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:17:34.559 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:17:34.559 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:17:34.567 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:17:34.567 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:17:34.567 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:17:34.567 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:17:34.567 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:17:34.590 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:17:34.590 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:17:34.590 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-10-06T03:17:34.590 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:17:34.590 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:17:34.590 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:17:34.590 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:17:34.590 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:17:34.592 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:17:34.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:34.592 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:34.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:17:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.810+0000 7f3617917700 1 Processor -- start 2023-10-06T03:17:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.810+0000 7f3617917700 1 -- start start 2023-10-06T03:17:34.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3617917700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36100cbe50 0x7f36100c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:34.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3617917700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100c6bf0 0x7f36100ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:34.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3617917700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36100ae140 con 0x7f36100cdc00 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3617917700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100c7070 con 0x7f36100cbe50 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3617917700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36100cc2a0 con 0x7f36100c6bf0 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3614eb2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36100cbe50 0x7f36100c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3614eb2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36100cbe50 0x7f36100c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51068/0 (socket says 172.21.15.82:51068) 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3614eb2700 1 -- 172.21.15.82:0/499532449 learned_addr learned my addr 172.21.15.82:0/499532449 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3615eb4700 1 --2- 172.21.15.82:0/499532449 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100c6bf0 0x7f36100ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3614eb2700 1 -- 172.21.15.82:0/499532449 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100c6bf0 msgr2=0x7f36100ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3614eb2700 1 --2- 172.21.15.82:0/499532449 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100c6bf0 0x7f36100ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3614eb2700 1 -- 172.21.15.82:0/499532449 >> v1:172.21.15.134:6789/0 conn(0x7f36100cdc00 legacy=0x7f36100d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3614eb2700 1 -- 172.21.15.82:0/499532449 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100ad530 con 0x7f36100cbe50 2023-10-06T03:17:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.811+0000 7f3614eb2700 1 --2- 172.21.15.82:0/499532449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100cbe50 0x7f36100c66b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f36000099b0 tx=0x7f3600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedaf5edd7274578 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3607fff700 1 -- 172.21.15.82:0/499532449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600009ea0 con 0x7f36100cbe50 2023-10-06T03:17:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3607fff700 1 -- 172.21.15.82:0/499532449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360000b860 con 0x7f36100cbe50 2023-10-06T03:17:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3607fff700 1 -- 172.21.15.82:0/499532449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000bc00 con 0x7f36100cbe50 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3617917700 1 -- 172.21.15.82:0/499532449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100cbe50 msgr2=0x7f36100c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3617917700 1 --2- 172.21.15.82:0/499532449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100cbe50 0x7f36100c66b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f36000099b0 tx=0x7f3600009250 comp rx=0 tx=0).stop 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3617917700 1 -- 172.21.15.82:0/499532449 shutdown_connections 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3617917700 1 --2- 172.21.15.82:0/499532449 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100c6bf0 0x7f36100ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3617917700 1 --2- 172.21.15.82:0/499532449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100cbe50 0x7f36100c66b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3617917700 1 -- 172.21.15.82:0/499532449 >> 172.21.15.82:0/499532449 conn(0x7f3610099990 msgr2=0x7f36100b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3617917700 1 -- 172.21.15.82:0/499532449 shutdown_connections 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.812+0000 7f3617917700 1 -- 172.21.15.82:0/499532449 wait complete. 2023-10-06T03:17:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.813+0000 7f3617917700 1 Processor -- start 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.814+0000 7f3617917700 1 -- start start 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.814+0000 7f3617917700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100c6bf0 0x7f36100b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.814+0000 7f3617917700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100cbe50 0x7f3610169df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.814+0000 7f3617917700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100cdc00 0x7f361016a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.814+0000 7f3617917700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610067630 con 0x7f36100c6bf0 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.814+0000 7f3617917700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610067910 con 0x7f36100cbe50 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.814+0000 7f3617917700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36100b0c70 con 0x7f36100cdc00 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100c6bf0 0x7f36100b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100c6bf0 0x7f36100b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51076/0 (socket says 172.21.15.82:51076) 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 -- 172.21.15.82:0/3258732954 learned_addr learned my addr 172.21.15.82:0/3258732954 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f3614eb2700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100cbe50 0x7f3610169df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f3615eb4700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100cdc00 0x7f361016a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 -- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100cdc00 msgr2=0x7f361016a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100cdc00 0x7f361016a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 -- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100cbe50 msgr2=0x7f3610169df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100cbe50 0x7f3610169df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 -- 172.21.15.82:0/3258732954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36000094f0 con 0x7f36100c6bf0 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36156b3700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100c6bf0 0x7f36100b02d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f360c00c570 tx=0x7f360c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36057fa700 1 -- 172.21.15.82:0/3258732954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c011590 con 0x7f36100c6bf0 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36057fa700 1 -- 172.21.15.82:0/3258732954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c0116f0 con 0x7f36100c6bf0 2023-10-06T03:17:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36100b0f50 con 0x7f36100c6bf0 2023-10-06T03:17:34.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f36057fa700 1 -- 172.21.15.82:0/3258732954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c011ab0 con 0x7f36100c6bf0 2023-10-06T03:17:34.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.815+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36100b0810 con 0x7f36100c6bf0 2023-10-06T03:17:34.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.816+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36100b0a30 con 0x7f36100c6bf0 2023-10-06T03:17:34.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.817+0000 7f36057fa700 1 -- 172.21.15.82:0/3258732954 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f360c01b3b0 con 0x7f36100c6bf0 2023-10-06T03:17:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.817+0000 7f36057fa700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f35f4066f30 0x7f35f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.817+0000 7f36057fa700 1 -- 172.21.15.82:0/3258732954 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f360c083970 con 0x7f36100c6bf0 2023-10-06T03:17:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.817+0000 7f3614eb2700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f35f4066f30 0x7f35f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.818+0000 7f3614eb2700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f35f4066f30 0x7f35f40693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f36000099b0 tx=0x7f3600017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:34.821+0000 7f36057fa700 1 -- 172.21.15.82:0/3258732954 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36100b0a30 con 0x7f36100c6bf0 2023-10-06T03:17:35.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.047+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36100b0a30 con 0x7f36100c6bf0 2023-10-06T03:17:35.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.048+0000 7f36057fa700 1 -- 172.21.15.82:0/3258732954 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f36100b0a30 con 0x7f36100c6bf0 2023-10-06T03:17:35.050 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f35f4066f30 msgr2=0x7f35f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f35f4066f30 0x7f35f40693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f36000099b0 tx=0x7f3600017000 comp rx=0 tx=0).stop 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100c6bf0 msgr2=0x7f36100b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100c6bf0 0x7f36100b02d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f360c00c570 tx=0x7f360c001070 comp rx=0 tx=0).stop 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 shutdown_connections 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f35f4066f30 0x7f35f40693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100cdc00 0x7f361016a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100c6bf0 0x7f36100b02d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 --2- 172.21.15.82:0/3258732954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36100cbe50 0x7f3610169df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 >> 172.21.15.82:0/3258732954 conn(0x7f3610099990 msgr2=0x7f36101555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:35.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 shutdown_connections 2023-10-06T03:17:35.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:35.050+0000 7f3617917700 1 -- 172.21.15.82:0/3258732954 wait complete. 2023-10-06T03:17:35.063 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:17:35.063 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:17:35.063 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-10-06T03:17:35.063 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:17:35.063 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:35.064 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:17:35.064 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:17:35.064 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:17:35.064 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:17:35.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:35.064 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-10-06T03:17:35.083 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:17:35.083 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:17:35.083 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:17:35.083 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:35.083 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:17:35.084 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42406sec preferred_lft 42406sec 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::942d:80ff:fe6e:b134/64 scope link 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:17:35.085 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 72:74:fe:81:9e:88 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:17:35.086 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::7074:feff:fe81:9e88/64 scope link 2023-10-06T03:17:35.086 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:35.086 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:17:35.086 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether ee:c9:40:4f:89:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:17:35.086 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ecc9:40ff:fe4f:892c/64 scope link 2023-10-06T03:17:35.086 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:17:35.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:35.086 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:17:35.151 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-10-06T03:17:35.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:35.153 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-10-06T03:17:35.212 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-10-06T03:17:35.212 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:17:35.213 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:17:35.213 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:17:35.213 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:17:35.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:35.213 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-10-06T03:17:35.213 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-10-06T03:17:35.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:17:35.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:17:35.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:17:35.214 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-10-06T03:17:35.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:35.320 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:17:35.335 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:17:35.335 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:17:35.336 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:17:35.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:35.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-10-06T03:17:35.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:17:35.401 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:35.457 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:17:35.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:17:35.457 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:35.511 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:17:35.511 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:17:35.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:17:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:17:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:17:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:17:35.600 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:17:35.600 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:17:35.601 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:17:35.601 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:17:35.601 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:17:35.622 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:17:35.623 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:17:35.623 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-10-06T03:17:35.623 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-10-06T03:17:35.623 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:17:35.623 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790" 2023-10-06T03:17:35.623 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.134:6789,172.21.15.134:6790:/ 2023-10-06T03:17:35.623 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=968d6894-b90c-4b96-8e67-09d8a805d810" will pass to kernel 2023-10-06T03:17:35.625 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:17:35.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:35.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:35.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:35.690 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir_files) 2023-10-06T03:17:35.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:35.710 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir_data) 2023-10-06T03:17:35.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:35.767 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 100 ./subdir_files) 2023-10-06T03:17:35.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:35.827 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 104857600 ./subdir_data) 2023-10-06T03:17:35.884 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:17:35.884 DEBUG:teuthology.orchestra.run.smithi134:> import os 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> import uuid 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> n = 20 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> create_hard_links = False 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> if 0 > 0: 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> create_hard_links = True 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> path = "/home/ubuntu/cephtest/mnt.1/subdir_files/file" 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> dpath = os.path.dirname(path) 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> fnameprefix = os.path.basename(path) 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> os.makedirs(dpath, exist_ok=True) 2023-10-06T03:17:35.885 DEBUG:teuthology.orchestra.run.smithi134:> 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> try: 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> for i in range(n): 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> with open(fpath, '"'"'w'"'"') as f: 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> f.write(f"{i}") 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> if False: 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> f.flush() 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> os.fsync(f.fileno()) 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> if False: 2023-10-06T03:17:35.886 DEBUG:teuthology.orchestra.run.smithi134:> os.unlink(fpath) 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> if False: 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> os.fsync(dirfd) 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> if create_hard_links: 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> for j in range(0): 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> if False: 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> os.fsync(dirfd) 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> finally: 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> os.close(dirfd) 2023-10-06T03:17:35.887 DEBUG:teuthology.orchestra.run.smithi134:> ' 2023-10-06T03:17:36.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:36.141 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec dd if=/dev/urandom of=subdir_data/file bs=1M conv=fdatasync count=20 seek=0) 2023-10-06T03:17:36.322 INFO:teuthology.orchestra.run.smithi134.stderr:20+0 records in 2023-10-06T03:17:36.323 INFO:teuthology.orchestra.run.smithi134.stderr:20+0 records out 2023-10-06T03:17:36.323 INFO:teuthology.orchestra.run.smithi134.stderr:20971520 bytes (21 MB, 20 MiB) copied, 0.125669 s, 167 MB/s 2023-10-06T03:17:36.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:36.324 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 10 ./subdir_files) 2023-10-06T03:17:36.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:36.341 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1048576 ./subdir_data) 2023-10-06T03:17:36.398 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:17:36.398 DEBUG:teuthology.orchestra.run.smithi134:> import os 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> import uuid 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> n = 40 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> create_hard_links = False 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> if 0 > 0: 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> create_hard_links = True 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> path = "/home/ubuntu/cephtest/mnt.1/subdir_files/file" 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> 2023-10-06T03:17:36.399 DEBUG:teuthology.orchestra.run.smithi134:> dpath = os.path.dirname(path) 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> fnameprefix = os.path.basename(path) 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> os.makedirs(dpath, exist_ok=True) 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> try: 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> for i in range(n): 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> with open(fpath, '"'"'w'"'"') as f: 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> f.write(f"{i}") 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> if False: 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> f.flush() 2023-10-06T03:17:36.400 DEBUG:teuthology.orchestra.run.smithi134:> os.fsync(f.fileno()) 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> if False: 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> os.unlink(fpath) 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> if False: 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> os.fsync(dirfd) 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> if create_hard_links: 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> for j in range(0): 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> if False: 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> os.fsync(dirfd) 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> finally: 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> os.close(dirfd) 2023-10-06T03:17:36.401 DEBUG:teuthology.orchestra.run.smithi134:> ' 2023-10-06T03:17:36.597 INFO:teuthology.orchestra.run.smithi134.stderr:Traceback (most recent call last): 2023-10-06T03:17:36.598 INFO:teuthology.orchestra.run.smithi134.stderr: File "", line 20, in 2023-10-06T03:17:36.598 INFO:teuthology.orchestra.run.smithi134.stderr:OSError: [Errno 122] Disk quota exceeded: '/home/ubuntu/cephtest/mnt.1/subdir_files/file_20' 2023-10-06T03:17:36.649 INFO:teuthology.orchestra.run.smithi134.stderr:daemon-helper: command failed with exit status 1 2023-10-06T03:17:36.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:17:36.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:36.654 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec dd if=/dev/urandom of=subdir_data/file bs=1M conv=fdatasync count=40 seek=0) 2023-10-06T03:17:36.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:17:36.816 INFO:teuthology.orchestra.run.smithi134.stderr:dd: error writing 'subdir_data/file': Disk quota exceeded 2023-10-06T03:17:36.816 INFO:teuthology.orchestra.run.smithi134.stderr:23+0 records in 2023-10-06T03:17:36.816 INFO:teuthology.orchestra.run.smithi134.stderr:22+0 records out 2023-10-06T03:17:36.816 INFO:teuthology.orchestra.run.smithi134.stderr:23068672 bytes (23 MB, 22 MiB) copied, 0.101969 s, 226 MB/s 2023-10-06T03:17:36.816 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:17:36.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:17:36.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:17:36.901 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:17:36.901 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:17:36.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:36.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:17:36.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:17:36.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:36.949 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:17:36.963 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:17:36.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:17:36.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T03:17:37.162 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:17:37.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:37.162 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:17:37.178 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:37.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.290+0000 7f6ea20ff700 1 Processor -- start 2023-10-06T03:17:37.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.290+0000 7f6ea20ff700 1 -- start start 2023-10-06T03:17:37.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6ea20ff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cbe50 0x7f6e9c0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6ea20ff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6e9c0c6bf0 0x7f6e9c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6ea20ff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c0ae140 con 0x7f6e9c0cdc00 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6ea20ff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c0c7070 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6ea20ff700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0cc2a0 con 0x7f6e9c0cbe50 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6e9b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6e9c0cdc00 0x7f6e9c0d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34722/0 (socket says 172.21.15.82:34722) 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6e9b7fe700 1 -- 172.21.15.82:0/87355759 learned_addr learned my addr 172.21.15.82:0/87355759 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6e9bfff700 1 --2- 172.21.15.82:0/87355759 >> v2:172.21.15.134:3300/0 conn(0x7f6e9c0c6bf0 0x7f6e9c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.291+0000 7f6e9affd700 1 --2- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cbe50 0x7f6e9c0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9a7fc700 1 -- 172.21.15.82:0/87355759 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176602602 0 0) 0x7f6e9c0ae140 con 0x7f6e9c0cdc00 2023-10-06T03:17:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9a7fc700 1 -- 172.21.15.82:0/87355759 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e84003570 con 0x7f6e9c0cdc00 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9bfff700 1 -- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cbe50 msgr2=0x7f6e9c0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9bfff700 1 --2- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cbe50 0x7f6e9c0c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9bfff700 1 -- 172.21.15.82:0/87355759 >> v1:172.21.15.82:6789/0 conn(0x7f6e9c0cdc00 legacy=0x7f6e9c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9bfff700 1 -- 172.21.15.82:0/87355759 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0ad530 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9affd700 1 --2- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cbe50 0x7f6e9c0c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9bfff700 1 --2- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c0ae5d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e940098e0 tx=0x7f6e940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b7792b680a93ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9a7fc700 1 -- 172.21.15.82:0/87355759 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94011630 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9a7fc700 1 -- 172.21.15.82:0/87355759 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e94011790 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.292+0000 7f6e9a7fc700 1 -- 172.21.15.82:0/87355759 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94011b30 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.293+0000 7f6ea20ff700 1 -- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0c6bf0 msgr2=0x7f6e9c0ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.293+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c0ae5d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e940098e0 tx=0x7f6e940091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.293+0000 7f6ea20ff700 1 -- 172.21.15.82:0/87355759 shutdown_connections 2023-10-06T03:17:37.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.293+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c0ae5d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.293+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/87355759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cbe50 0x7f6e9c0c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.293+0000 7f6ea20ff700 1 -- 172.21.15.82:0/87355759 >> 172.21.15.82:0/87355759 conn(0x7f6e9c099990 msgr2=0x7f6e9c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:37.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.293+0000 7f6ea20ff700 1 -- 172.21.15.82:0/87355759 shutdown_connections 2023-10-06T03:17:37.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.293+0000 7f6ea20ff700 1 -- 172.21.15.82:0/87355759 wait complete. 2023-10-06T03:17:37.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.294+0000 7f6ea20ff700 1 Processor -- start 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.294+0000 7f6ea20ff700 1 -- start start 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6ea20ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c166db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6ea20ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0cbe50 0x7f6e9c16c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6ea20ff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cdc00 0x7f6e9c16ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6ea20ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c16b510 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6ea20ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0b27b0 con 0x7f6e9c0cbe50 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6ea20ff700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c16a900 con 0x7f6e9c0cdc00 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c166db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51084/0 (socket says 172.21.15.82:51084) 2023-10-06T03:17:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 -- 172.21.15.82:0/3584539659 learned_addr learned my addr 172.21.15.82:0/3584539659 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9affd700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0cbe50 0x7f6e9c16c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9bfff700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cdc00 0x7f6e9c16ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 -- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cdc00 msgr2=0x7f6e9c16ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cdc00 0x7f6e9c16ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 -- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0cbe50 msgr2=0x7f6e9c16c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0cbe50 0x7f6e9c16c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 -- 172.21.15.82:0/3584539659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90009420 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e9b7fe700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c166db0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c900 tx=0x7f6e8c002740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e837fe700 1 -- 172.21.15.82:0/3584539659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c005d80 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.295+0000 7f6e837fe700 1 -- 172.21.15.82:0/3584539659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c0070f0 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.296+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e94009420 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.296+0000 7f6e837fe700 1 -- 172.21.15.82:0/3584539659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c007470 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.296+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c16aec0 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.297+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9c064050 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.297+0000 7f6e837fe700 1 -- 172.21.15.82:0/3584539659 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e8c0078a0 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.297+0000 7f6e837fe700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6e88066f30 0x7f6e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.297+0000 7f6e837fe700 1 -- 172.21.15.82:0/3584539659 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e8c084340 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.297+0000 7f6e9affd700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6e88066f30 0x7f6e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.298+0000 7f6e9affd700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6e88066f30 0x7f6e880693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c09ae00 tx=0x7f6e900091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.302+0000 7f6e837fe700 1 -- 172.21.15.82:0/3584539659 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e8c0514d0 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.524+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e9c1672f0 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.525+0000 7f6e837fe700 1 -- 172.21.15.82:0/3584539659 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f6e8c054af0 con 0x7f6e9c0c6bf0 2023-10-06T03:17:37.526 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:37.527 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/763820094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":763820094},{"type":"v1","addr":"172.21.15.134:6837","nonce":763820094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/1309129480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1309129480},{"type":"v1","addr":"172.21.15.134:6836","nonce":1309129480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/21148295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":21148295},{"type":"v1","addr":"172.21.15.82:6834","nonce":21148295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:27.187663+0000","modified":"2023-10-06T03:17:30.826288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5706":{"gid":5706,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/598797511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":598797511},{"type":"v1","addr":"172.21.15.82:6835","nonce":598797511}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:17:37.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.526+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6e88066f30 msgr2=0x7f6e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.526+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6e88066f30 0x7f6e880693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c09ae00 tx=0x7f6e900091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.526+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e9c0c6bf0 msgr2=0x7f6e9c166db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.526+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c166db0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c900 tx=0x7f6e8c002740 comp rx=0 tx=0).stop 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.526+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 shutdown_connections 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.527+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6e88066f30 0x7f6e880693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.527+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e9c0cdc00 0x7f6e9c16ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.527+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e9c0c6bf0 0x7f6e9c166db0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.527+0000 7f6ea20ff700 1 --2- 172.21.15.82:0/3584539659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e9c0cbe50 0x7f6e9c16c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.527+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 >> 172.21.15.82:0/3584539659 conn(0x7f6e9c099990 msgr2=0x7f6e9c0d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.527+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 shutdown_connections 2023-10-06T03:17:37.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.527+0000 7f6ea20ff700 1 -- 172.21.15.82:0/3584539659 wait complete. 2023-10-06T03:17:37.530 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-10-06T03:17:37.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:37.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.652+0000 7fc27eac4700 1 Processor -- start 2023-10-06T03:17:37.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.652+0000 7fc27eac4700 1 -- start start 2023-10-06T03:17:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc27eac4700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc278159a90 0x7fc2781647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc27eac4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27815e3a0 con 0x7fc2781596c0 2023-10-06T03:17:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc27eac4700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2780cc470 con 0x7fc2780b09a0 2023-10-06T03:17:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc27eac4700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27815db30 con 0x7fc278159a90 2023-10-06T03:17:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc27c860700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc2781596c0 0x7fc27815d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35868/0 (socket says 172.21.15.82:35868) 2023-10-06T03:17:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc27c860700 1 -- 172.21.15.82:0/668056169 learned_addr learned my addr 172.21.15.82:0/668056169 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455426235 0 0) 0x7fc27815e3a0 con 0x7fc2781596c0 2023-10-06T03:17:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc27d061700 1 --2- 172.21.15.82:0/668056169 >> v2:172.21.15.134:3300/0 conn(0x7fc278159a90 0x7fc2781647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.653+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc260003570 con 0x7fc2781596c0 2023-10-06T03:17:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1636133905 0 0) 0x7fc260003570 con 0x7fc2781596c0 2023-10-06T03:17:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 >> v2:172.21.15.134:3300/0 conn(0x7fc278159a90 msgr2=0x7fc2781647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 --2- 172.21.15.82:0/668056169 >> v2:172.21.15.134:3300/0 conn(0x7fc278159a90 0x7fc2781647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 >> v1:172.21.15.134:6789/0 conn(0x7fc2780b09a0 legacy=0x7fc2780c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27815dde0 con 0x7fc2781596c0 2023-10-06T03:17:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fc274001470 con 0x7fc2781596c0 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 >> v1:172.21.15.82:6789/0 conn(0x7fc2781596c0 legacy=0x7fc27815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc260003a60 0x7fc260003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc260004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2600051c0 0x7fc26000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27815db30 con 0x7fc260004810 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26000c160 con 0x7fc2600051c0 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26000c320 con 0x7fc260003a60 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26ffff700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc260004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc27c860700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc260003a60 0x7fc260003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc27d061700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2600051c0 0x7fc26000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26ffff700 1 -- 172.21.15.82:0/668056169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc260003a60 msgr2=0x7fc260003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26ffff700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc260003a60 0x7fc260003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26ffff700 1 -- 172.21.15.82:0/668056169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2600051c0 msgr2=0x7fc26000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26ffff700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2600051c0 0x7fc26000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26ffff700 1 -- 172.21.15.82:0/668056169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260003570 con 0x7fc260004810 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc27d061700 1 -- 172.21.15.82:0/668056169 reap_dead start 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26ffff700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc260004c80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc268001880 tx=0x7fc268007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed3030a238e0447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268012420 con 0x7fc260004810 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2680125a0 con 0x7fc260004810 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.654+0000 7fc26f7fe700 1 -- 172.21.15.82:0/668056169 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268012960 con 0x7fc260004810 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.655+0000 7fc27eac4700 1 -- 172.21.15.82:0/668056169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 msgr2=0x7fc260004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.655+0000 7fc27eac4700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc260004c80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc268001880 tx=0x7fc268007d30 comp rx=0 tx=0).stop 2023-10-06T03:17:37.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.655+0000 7fc27eac4700 1 -- 172.21.15.82:0/668056169 shutdown_connections 2023-10-06T03:17:37.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.655+0000 7fc27eac4700 1 --2- 172.21.15.82:0/668056169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc260004c80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.655+0000 7fc27eac4700 1 -- 172.21.15.82:0/668056169 >> 172.21.15.82:0/668056169 conn(0x7fc278067630 msgr2=0x7fc278067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:37.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.655+0000 7fc27eac4700 1 -- 172.21.15.82:0/668056169 shutdown_connections 2023-10-06T03:17:37.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.655+0000 7fc27eac4700 1 -- 172.21.15.82:0/668056169 wait complete. 2023-10-06T03:17:37.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.656+0000 7fc27eac4700 1 Processor -- start 2023-10-06T03:17:37.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.656+0000 7fc27eac4700 1 -- start start 2023-10-06T03:17:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27eac4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc278156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27eac4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc27816a4f0 0x7fc27814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27eac4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278159e90 0x7fc2780c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27eac4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27815c920 con 0x7fc260004810 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27eac4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27815c380 con 0x7fc278159e90 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27eac4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27815c640 con 0x7fc27816a4f0 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc278156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc278156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39902/0 (socket says 172.21.15.82:39902) 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 -- 172.21.15.82:0/2717793786 learned_addr learned my addr 172.21.15.82:0/2717793786 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27d061700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278159e90 0x7fc2780c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc26ffff700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc27816a4f0 0x7fc27814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 -- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc27816a4f0 msgr2=0x7fc27814a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc27816a4f0 0x7fc27814a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 -- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278159e90 msgr2=0x7fc2780c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278159e90 0x7fc2780c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 -- 172.21.15.82:0/2717793786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780c1ce0 con 0x7fc260004810 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc26ffff700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc27816a4f0 0x7fc27814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27d061700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278159e90 0x7fc2780c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc27c860700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc278156a20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc274007390 tx=0x7fc274001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.657+0000 7fc26cff9700 1 -- 172.21.15.82:0/2717793786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274018030 con 0x7fc260004810 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.658+0000 7fc26cff9700 1 -- 172.21.15.82:0/2717793786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27400f8d0 con 0x7fc260004810 2023-10-06T03:17:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.658+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2780c1fc0 con 0x7fc260004810 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.658+0000 7fc26cff9700 1 -- 172.21.15.82:0/2717793786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400fc90 con 0x7fc260004810 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.658+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27814ad20 con 0x7fc260004810 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.658+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27814aeb0 con 0x7fc260004810 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.659+0000 7fc26cff9700 1 -- 172.21.15.82:0/2717793786 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc27401b070 con 0x7fc260004810 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.659+0000 7fc26cff9700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc264066f30 0x7fc2640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.659+0000 7fc26cff9700 1 -- 172.21.15.82:0/2717793786 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc274019070 con 0x7fc260004810 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.659+0000 7fc26ffff700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc264066f30 0x7fc2640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.660+0000 7fc26ffff700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc264066f30 0x7fc2640693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc278069f70 tx=0x7fc268015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.663+0000 7fc26cff9700 1 -- 172.21.15.82:0/2717793786 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc27814aeb0 con 0x7fc260004810 2023-10-06T03:17:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.848+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2780c2200 con 0x7fc260004810 2023-10-06T03:17:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.849+0000 7fc26cff9700 1 -- 172.21.15.82:0/2717793786 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16868 (secure 0 0 0) 0x7fc2780c2200 con 0x7fc260004810 2023-10-06T03:17:37.851 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:37.851 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":55,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:28.809576+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:24.832103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:26.150387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:37.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc264066f30 msgr2=0x7fc2640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc264066f30 0x7fc2640693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc278069f70 tx=0x7fc268015000 comp rx=0 tx=0).stop 2023-10-06T03:17:37.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 msgr2=0x7fc278156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc278156a20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc274007390 tx=0x7fc274001e50 comp rx=0 tx=0).stop 2023-10-06T03:17:37.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 shutdown_connections 2023-10-06T03:17:37.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278159e90 0x7fc2780c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc260004810 0x7fc278156a20 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc264066f30 0x7fc2640693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 --2- 172.21.15.82:0/2717793786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc27816a4f0 0x7fc27814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 >> 172.21.15.82:0/2717793786 conn(0x7fc278067630 msgr2=0x7fc2780cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 shutdown_connections 2023-10-06T03:17:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.851+0000 7fc27eac4700 1 -- 172.21.15.82:0/2717793786 wait complete. 2023-10-06T03:17:37.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:15:44.682622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:15:45.177430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:17:24.832103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:17:26.150387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:17:37.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:17:37.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.981+0000 7fd221130700 1 Processor -- start 2023-10-06T03:17:37.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.981+0000 7fd221130700 1 -- start start 2023-10-06T03:17:37.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.982+0000 7fd221130700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd21c069120 0x7fd21c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.982+0000 7fd221130700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd21c0694f0 0x7fd21c0aa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.982+0000 7fd221130700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c0ab0c0 con 0x7fd21c159540 2023-10-06T03:17:37.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.982+0000 7fd221130700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21c0aaeb0 con 0x7fd21c069120 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.982+0000 7fd221130700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21c0ab3a0 con 0x7fd21c0694f0 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.982+0000 7fd21ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd21c069120 0x7fd21c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.982+0000 7fd21b59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd21c159540 0x7fd21c1599c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35880/0 (socket says 172.21.15.82:35880) 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.982+0000 7fd21b59e700 1 -- 172.21.15.82:0/4281450533 learned_addr learned my addr 172.21.15.82:0/4281450533 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21259c700 1 --2- 172.21.15.82:0/4281450533 >> v2:172.21.15.134:3300/0 conn(0x7fd21c0694f0 0x7fd21c0aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21ad9d700 1 -- 172.21.15.82:0/4281450533 >> v2:172.21.15.134:3300/0 conn(0x7fd21c0694f0 msgr2=0x7fd21c0aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21ad9d700 1 --2- 172.21.15.82:0/4281450533 >> v2:172.21.15.134:3300/0 conn(0x7fd21c0694f0 0x7fd21c0aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21ad9d700 1 -- 172.21.15.82:0/4281450533 >> v1:172.21.15.82:6789/0 conn(0x7fd21c159540 legacy=0x7fd21c1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21ad9d700 1 -- 172.21.15.82:0/4281450533 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0ab680 con 0x7fd21c069120 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21a59c700 1 -- 172.21.15.82:0/4281450533 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609670446 0 0) 0x7fd21c0ab0c0 con 0x7fd21c159540 2023-10-06T03:17:37.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21ad9d700 1 --2- 172.21.15.82:0/4281450533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c069120 0x7fd21c15e180 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0098e0 tx=0x7fd20c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4b1adc9277668b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21a59c700 1 -- 172.21.15.82:0/4281450533 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c009e80 con 0x7fd21c069120 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21a59c700 1 -- 172.21.15.82:0/4281450533 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00b820 con 0x7fd21c069120 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd21a59c700 1 -- 172.21.15.82:0/4281450533 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00bba0 con 0x7fd21c069120 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd221130700 1 -- 172.21.15.82:0/4281450533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c069120 msgr2=0x7fd21c15e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.983+0000 7fd221130700 1 --2- 172.21.15.82:0/4281450533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c069120 0x7fd21c15e180 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0098e0 tx=0x7fd20c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.984+0000 7fd221130700 1 -- 172.21.15.82:0/4281450533 shutdown_connections 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.984+0000 7fd221130700 1 --2- 172.21.15.82:0/4281450533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c069120 0x7fd21c15e180 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.984+0000 7fd221130700 1 --2- 172.21.15.82:0/4281450533 >> v2:172.21.15.134:3300/0 conn(0x7fd21c0694f0 0x7fd21c0aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.984+0000 7fd221130700 1 -- 172.21.15.82:0/4281450533 >> 172.21.15.82:0/4281450533 conn(0x7fd21c06e910 msgr2=0x7fd21c06be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.984+0000 7fd221130700 1 -- 172.21.15.82:0/4281450533 shutdown_connections 2023-10-06T03:17:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.984+0000 7fd221130700 1 -- 172.21.15.82:0/4281450533 wait complete. 2023-10-06T03:17:37.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.985+0000 7fd221130700 1 Processor -- start 2023-10-06T03:17:37.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.985+0000 7fd221130700 1 -- start start 2023-10-06T03:17:37.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.985+0000 7fd221130700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd21c069120 0x7fd21c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.985+0000 7fd221130700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd21c0694f0 0x7fd21c15fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.985+0000 7fd221130700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c159540 0x7fd21c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd221130700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c13f4c0 con 0x7fd21c159540 2023-10-06T03:17:37.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd221130700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c153b00 con 0x7fd21c069120 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd221130700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c15ab50 con 0x7fd21c0694f0 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c159540 0x7fd21c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c159540 0x7fd21c15bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39922/0 (socket says 172.21.15.82:39922) 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 -- 172.21.15.82:0/2920312731 learned_addr learned my addr 172.21.15.82:0/2920312731 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21ad9d700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd21c069120 0x7fd21c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21259c700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd21c0694f0 0x7fd21c15fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 -- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd21c0694f0 msgr2=0x7fd21c15fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd21c0694f0 0x7fd21c15fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 -- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd21c069120 msgr2=0x7fd21c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd21c069120 0x7fd21c1535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 -- 172.21.15.82:0/2920312731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c009420 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd21b59e700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c159540 0x7fd21c15bbf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd21400cbf0 tx=0x7fd2140019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd2137fe700 1 -- 172.21.15.82:0/2920312731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400a8b0 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd2137fe700 1 -- 172.21.15.82:0/2920312731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400aa10 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd2137fe700 1 -- 172.21.15.82:0/2920312731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400add0 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c15ae30 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.986+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c15b3f0 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.987+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c064050 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.987+0000 7fd2137fe700 1 -- 172.21.15.82:0/2920312731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd214007300 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.988+0000 7fd2137fe700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd1fc066f30 0x7fd1fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.988+0000 7fd2137fe700 1 -- 172.21.15.82:0/2920312731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd214084970 con 0x7fd21c159540 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.988+0000 7fd21ad9d700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd1fc066f30 0x7fd1fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.989+0000 7fd21ad9d700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd1fc066f30 0x7fd1fc0693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0093f0 tx=0x7fd20c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:37.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:37.992+0000 7fd2137fe700 1 -- 172.21.15.82:0/2920312731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd214051b00 con 0x7fd21c159540 2023-10-06T03:17:38.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.174+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd21c063880 con 0x7fd21c159540 2023-10-06T03:17:38.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.174+0000 7fd2137fe700 1 -- 172.21.15.82:0/2920312731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd214055120 con 0x7fd21c159540 2023-10-06T03:17:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd1fc066f30 msgr2=0x7fd1fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd1fc066f30 0x7fd1fc0693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0093f0 tx=0x7fd20c017000 comp rx=0 tx=0).stop 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c159540 msgr2=0x7fd21c15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c159540 0x7fd21c15bbf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd21400cbf0 tx=0x7fd2140019b0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 shutdown_connections 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c159540 0x7fd21c15bbf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd21c069120 0x7fd21c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fd1fc066f30 0x7fd1fc0693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 --2- 172.21.15.82:0/2920312731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd21c0694f0 0x7fd21c15fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 >> 172.21.15.82:0/2920312731 conn(0x7fd21c06e910 msgr2=0x7fd21c0af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 shutdown_connections 2023-10-06T03:17:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.176+0000 7fd221130700 1 -- 172.21.15.82:0/2920312731 wait complete. 2023-10-06T03:17:38.189 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:17:38.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.304+0000 7f54fd284700 1 Processor -- start 2023-10-06T03:17:38.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.304+0000 7f54fd284700 1 -- start start 2023-10-06T03:17:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54fd284700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54f8142e90 0x7f54f8069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54fd284700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f54f8069d50 0x7f54f815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54fd284700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f8069380 con 0x7f54f815de80 2023-10-06T03:17:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54fd284700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f8068770 con 0x7f54f8142e90 2023-10-06T03:17:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54fd284700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f8068a50 con 0x7f54f8069d50 2023-10-06T03:17:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54f8142e90 0x7f54f8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54fca83700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f54f815de80 0x7f54f80b0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35896/0 (socket says 172.21.15.82:35896) 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54fca83700 1 -- 172.21.15.82:0/3991645112 learned_addr learned my addr 172.21.15.82:0/3991645112 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f77fe700 1 --2- 172.21.15.82:0/3991645112 >> v2:172.21.15.134:3300/0 conn(0x7f54f8069d50 0x7f54f815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f7fff700 1 -- 172.21.15.82:0/3991645112 >> v2:172.21.15.134:3300/0 conn(0x7f54f8069d50 msgr2=0x7f54f815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f7fff700 1 --2- 172.21.15.82:0/3991645112 >> v2:172.21.15.134:3300/0 conn(0x7f54f8069d50 0x7f54f815d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f7fff700 1 -- 172.21.15.82:0/3991645112 >> v1:172.21.15.82:6789/0 conn(0x7f54f815de80 legacy=0x7f54f80b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f7fff700 1 -- 172.21.15.82:0/3991645112 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8068d30 con 0x7f54f8142e90 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f6ffd700 1 -- 172.21.15.82:0/3991645112 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74131582 0 0) 0x7f54f8069380 con 0x7f54f815de80 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f7fff700 1 --2- 172.21.15.82:0/3991645112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f8142e90 0x7f54f8069810 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f54f806fd60 tx=0x7f54e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac6c3b2339cbc78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.305+0000 7f54f6ffd700 1 -- 172.21.15.82:0/3991645112 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e800b6b0 con 0x7f54f8142e90 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54f6ffd700 1 -- 172.21.15.82:0/3991645112 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e800b810 con 0x7f54f8142e90 2023-10-06T03:17:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54f6ffd700 1 -- 172.21.15.82:0/3991645112 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e800bbb0 con 0x7f54f8142e90 2023-10-06T03:17:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54fd284700 1 -- 172.21.15.82:0/3991645112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f8142e90 msgr2=0x7f54f8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54fd284700 1 --2- 172.21.15.82:0/3991645112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f8142e90 0x7f54f8069810 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f54f806fd60 tx=0x7f54e80091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54fd284700 1 -- 172.21.15.82:0/3991645112 shutdown_connections 2023-10-06T03:17:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54fd284700 1 --2- 172.21.15.82:0/3991645112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f8142e90 0x7f54f8069810 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54fd284700 1 --2- 172.21.15.82:0/3991645112 >> v2:172.21.15.134:3300/0 conn(0x7f54f8069d50 0x7f54f815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54fd284700 1 -- 172.21.15.82:0/3991645112 >> 172.21.15.82:0/3991645112 conn(0x7f54f80ccfe0 msgr2=0x7f54f80cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54fd284700 1 -- 172.21.15.82:0/3991645112 shutdown_connections 2023-10-06T03:17:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.306+0000 7f54fd284700 1 -- 172.21.15.82:0/3991645112 wait complete. 2023-10-06T03:17:38.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.307+0000 7f54fd284700 1 Processor -- start 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.307+0000 7f54fd284700 1 -- start start 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fd284700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54f8069d50 0x7f54f80c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fd284700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f815de80 0x7f54f815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fd284700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f815b410 0x7f54f816a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fd284700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f815c810 con 0x7f54f815b410 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fd284700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f815bc00 con 0x7f54f815de80 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fd284700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f815bee0 con 0x7f54f8069d50 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fca83700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f815b410 0x7f54f816a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fca83700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f815b410 0x7f54f816a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39944/0 (socket says 172.21.15.82:39944) 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fca83700 1 -- 172.21.15.82:0/1828162149 learned_addr learned my addr 172.21.15.82:0/1828162149 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54f77fe700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f815de80 0x7f54f815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54f7fff700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54f8069d50 0x7f54f80c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fca83700 1 -- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54f8069d50 msgr2=0x7f54f80c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fca83700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54f8069d50 0x7f54f80c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fca83700 1 -- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f815de80 msgr2=0x7f54f815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fca83700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f815de80 0x7f54f815aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54fca83700 1 -- 172.21.15.82:0/1828162149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e8009420 con 0x7f54f815b410 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.308+0000 7f54f7fff700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54f8069d50 0x7f54f80c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.309+0000 7f54fca83700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f815b410 0x7f54f816a590 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f54f000cbf0 tx=0x7f54f00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.309+0000 7f54dffff700 1 -- 172.21.15.82:0/1828162149 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f000a910 con 0x7f54f815b410 2023-10-06T03:17:38.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.309+0000 7f54dffff700 1 -- 172.21.15.82:0/1828162149 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f000aa70 con 0x7f54f815b410 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.309+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f815c1c0 con 0x7f54f815b410 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.309+0000 7f54dffff700 1 -- 172.21.15.82:0/1828162149 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f000ae30 con 0x7f54f815b410 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.309+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f815b880 con 0x7f54f815b410 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.310+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f804c3c0 con 0x7f54f815b410 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.310+0000 7f54dffff700 1 -- 172.21.15.82:0/1828162149 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54f0007300 con 0x7f54f815b410 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.310+0000 7f54dffff700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f54e4066f30 0x7f54e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.310+0000 7f54dffff700 1 -- 172.21.15.82:0/1828162149 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f54f00849c0 con 0x7f54f815b410 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.311+0000 7f54f7fff700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f54e4066f30 0x7f54e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.311+0000 7f54f7fff700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f54e4066f30 0x7f54e40693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f54f80712e0 tx=0x7f54e8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.314+0000 7f54dffff700 1 -- 172.21.15.82:0/1828162149 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54f0051b50 con 0x7f54f815b410 2023-10-06T03:17:38.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.497+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54f8069010 con 0x7f54f815b410 2023-10-06T03:17:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.497+0000 7f54dffff700 1 -- 172.21.15.82:0/1828162149 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54f0055170 con 0x7f54f815b410 2023-10-06T03:17:38.499 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f54e4066f30 msgr2=0x7f54e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f54e4066f30 0x7f54e40693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f54f80712e0 tx=0x7f54e8017000 comp rx=0 tx=0).stop 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f815b410 msgr2=0x7f54f816a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f815b410 0x7f54f816a590 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f54f000cbf0 tx=0x7f54f00019b0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 shutdown_connections 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f815b410 0x7f54f816a590 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f54e4066f30 0x7f54e40693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54f8069d50 0x7f54f80c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 --2- 172.21.15.82:0/1828162149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f815de80 0x7f54f815aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 >> 172.21.15.82:0/1828162149 conn(0x7f54f80ccfe0 msgr2=0x7f54f813f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 shutdown_connections 2023-10-06T03:17:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.500+0000 7f54fd284700 1 -- 172.21.15.82:0/1828162149 wait complete. 2023-10-06T03:17:38.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:17:38.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.628+0000 7fc10fae4700 1 Processor -- start 2023-10-06T03:17:38.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.628+0000 7fc10fae4700 1 -- start start 2023-10-06T03:17:38.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10fae4700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc1081598d0 0x7fc10815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10fae4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc10815d8e0 0x7fc1080cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10fae4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10815dd20 con 0x7fc108159500 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10fae4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1080b1110 con 0x7fc10815d8e0 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10fae4700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1080b13b0 con 0x7fc1081598d0 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10e081700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc10815d8e0 0x7fc1080cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10d880700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc108159500 0x7fc1080b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35910/0 (socket says 172.21.15.82:35910) 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10d880700 1 -- 172.21.15.82:0/2765368012 learned_addr learned my addr 172.21.15.82:0/2765368012 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10d07f700 1 --2- 172.21.15.82:0/2765368012 >> v2:172.21.15.134:3300/0 conn(0x7fc1081598d0 0x7fc10815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10e081700 1 -- 172.21.15.82:0/2765368012 >> v2:172.21.15.134:3300/0 conn(0x7fc1081598d0 msgr2=0x7fc10815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10e081700 1 --2- 172.21.15.82:0/2765368012 >> v2:172.21.15.134:3300/0 conn(0x7fc1081598d0 0x7fc10815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10e081700 1 -- 172.21.15.82:0/2765368012 >> v1:172.21.15.82:6789/0 conn(0x7fc108159500 legacy=0x7fc1080b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10e081700 1 -- 172.21.15.82:0/2765368012 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080b1690 con 0x7fc10815d8e0 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10c87e700 1 -- 172.21.15.82:0/2765368012 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409849092 0 0) 0x7fc10815dd20 con 0x7fc108159500 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10d07f700 1 --2- 172.21.15.82:0/2765368012 >> v2:172.21.15.134:3300/0 conn(0x7fc1081598d0 0x7fc10815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.629+0000 7fc10e081700 1 --2- 172.21.15.82:0/2765368012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10815d8e0 0x7fc1080cf6c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc108063430 tx=0x7fc0f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0ac5883e357591 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10c87e700 1 -- 172.21.15.82:0/2765368012 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800b6b0 con 0x7fc10815d8e0 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10c87e700 1 -- 172.21.15.82:0/2765368012 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f800b810 con 0x7fc10815d8e0 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10c87e700 1 -- 172.21.15.82:0/2765368012 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800bbb0 con 0x7fc10815d8e0 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10fae4700 1 -- 172.21.15.82:0/2765368012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10815d8e0 msgr2=0x7fc1080cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10fae4700 1 --2- 172.21.15.82:0/2765368012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10815d8e0 0x7fc1080cf6c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc108063430 tx=0x7fc0f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10fae4700 1 -- 172.21.15.82:0/2765368012 shutdown_connections 2023-10-06T03:17:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10fae4700 1 --2- 172.21.15.82:0/2765368012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10815d8e0 0x7fc1080cf6c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10fae4700 1 --2- 172.21.15.82:0/2765368012 >> v2:172.21.15.134:3300/0 conn(0x7fc1081598d0 0x7fc10815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10fae4700 1 -- 172.21.15.82:0/2765368012 >> 172.21.15.82:0/2765368012 conn(0x7fc108067630 msgr2=0x7fc108069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10fae4700 1 -- 172.21.15.82:0/2765368012 shutdown_connections 2023-10-06T03:17:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.630+0000 7fc10fae4700 1 -- 172.21.15.82:0/2765368012 wait complete. 2023-10-06T03:17:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.631+0000 7fc10fae4700 1 Processor -- start 2023-10-06T03:17:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.631+0000 7fc10fae4700 1 -- start start 2023-10-06T03:17:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10fae4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc108159500 0x7fc10814b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10fae4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1081598d0 0x7fc1080b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10fae4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc10815d8e0 0x7fc1080b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10fae4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10814bba0 con 0x7fc1081598d0 2023-10-06T03:17:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10fae4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10815a240 con 0x7fc108159500 2023-10-06T03:17:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10fae4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10815a520 con 0x7fc10815d8e0 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d07f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1081598d0 0x7fc1080b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d07f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1081598d0 0x7fc1080b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39952/0 (socket says 172.21.15.82:39952) 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d07f700 1 -- 172.21.15.82:0/250448148 learned_addr learned my addr 172.21.15.82:0/250448148 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d880700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc108159500 0x7fc10814b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10e081700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc10815d8e0 0x7fc1080b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d07f700 1 -- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc10815d8e0 msgr2=0x7fc1080b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d07f700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc10815d8e0 0x7fc1080b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d07f700 1 -- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc108159500 msgr2=0x7fc10814b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d07f700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc108159500 0x7fc10814b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.632+0000 7fc10d07f700 1 -- 172.21.15.82:0/250448148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8009420 con 0x7fc1081598d0 2023-10-06T03:17:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.633+0000 7fc10d07f700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1081598d0 0x7fc1080b4fa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c830 tx=0x7fc0fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.633+0000 7fc105ffb700 1 -- 172.21.15.82:0/250448148 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc011600 con 0x7fc1081598d0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.633+0000 7fc105ffb700 1 -- 172.21.15.82:0/250448148 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc011760 con 0x7fc1081598d0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.633+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10815a800 con 0x7fc1081598d0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.633+0000 7fc105ffb700 1 -- 172.21.15.82:0/250448148 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc011b20 con 0x7fc1081598d0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.633+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10814c410 con 0x7fc1081598d0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.634+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10814cb70 con 0x7fc1081598d0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.634+0000 7fc105ffb700 1 -- 172.21.15.82:0/250448148 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0fc00a3e0 con 0x7fc1081598d0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.634+0000 7fc105ffb700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc0f4066f30 0x7fc0f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.634+0000 7fc105ffb700 1 -- 172.21.15.82:0/250448148 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc0fc084b50 con 0x7fc1081598d0 2023-10-06T03:17:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.635+0000 7fc10d880700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc0f4066f30 0x7fc0f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.635+0000 7fc10d880700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc0f4066f30 0x7fc0f40693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc100001560 tx=0x7fc100009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.639+0000 7fc105ffb700 1 -- 172.21.15.82:0/250448148 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc10814cb70 con 0x7fc1081598d0 2023-10-06T03:17:38.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.819+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc10814cb70 con 0x7fc1081598d0 2023-10-06T03:17:38.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.819+0000 7fc105ffb700 1 -- 172.21.15.82:0/250448148 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0fc015020 con 0x7fc1081598d0 2023-10-06T03:17:38.821 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-10-06T03:17:38.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc0f4066f30 msgr2=0x7fc0f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc0f4066f30 0x7fc0f40693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc100001560 tx=0x7fc100009040 comp rx=0 tx=0).stop 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1081598d0 msgr2=0x7fc1080b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1081598d0 0x7fc1080b4fa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c830 tx=0x7fc0fc008040 comp rx=0 tx=0).stop 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 shutdown_connections 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc0f4066f30 0x7fc0f40693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc10815d8e0 0x7fc1080b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc108159500 0x7fc10814b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 --2- 172.21.15.82:0/250448148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1081598d0 0x7fc1080b4fa0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 >> 172.21.15.82:0/250448148 conn(0x7fc108067630 msgr2=0x7fc1080ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 shutdown_connections 2023-10-06T03:17:38.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.821+0000 7fc10fae4700 1 -- 172.21.15.82:0/250448148 wait complete. 2023-10-06T03:17:38.835 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:17:38.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.949+0000 7f3d16b06700 1 Processor -- start 2023-10-06T03:17:38.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.949+0000 7f3d16b06700 1 -- start start 2023-10-06T03:17:38.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d16b06700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d1015cb10 0x7f3d100af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d16b06700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3d100b4000 0x7f3d10159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d16b06700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 0x7f3d100b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d16b06700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100698e0 con 0x7f3d1015cb10 2023-10-06T03:17:38.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d16b06700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100b2020 con 0x7f3d100b4000 2023-10-06T03:17:38.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d16b06700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10068fd0 con 0x7f3d100b1690 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d148a2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d1015cb10 0x7f3d100af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d148a2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d1015cb10 0x7f3d100af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39962/0 (socket says 172.21.15.82:39962) 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.950+0000 7f3d148a2700 1 -- 172.21.15.82:0/2660511789 learned_addr learned my addr 172.21.15.82:0/2660511789 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d150a3700 1 --2- 172.21.15.82:0/2660511789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 0x7f3d100b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d07fff700 1 --2- 172.21.15.82:0/2660511789 >> v2:172.21.15.134:3300/0 conn(0x7f3d100b4000 0x7f3d10159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d148a2700 1 -- 172.21.15.82:0/2660511789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 msgr2=0x7f3d100b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d148a2700 1 --2- 172.21.15.82:0/2660511789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 0x7f3d100b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d148a2700 1 -- 172.21.15.82:0/2660511789 >> v2:172.21.15.134:3300/0 conn(0x7f3d100b4000 msgr2=0x7f3d10159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d148a2700 1 --2- 172.21.15.82:0/2660511789 >> v2:172.21.15.134:3300/0 conn(0x7f3d100b4000 0x7f3d10159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d148a2700 1 -- 172.21.15.82:0/2660511789 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d100b0020 con 0x7f3d1015cb10 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d148a2700 1 --2- 172.21.15.82:0/2660511789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d1015cb10 0x7f3d100af780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3d1006f7c0 tx=0x7f3d0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d2faa65141149f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d077fe700 1 -- 172.21.15.82:0/2660511789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00b860 con 0x7f3d1015cb10 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d077fe700 1 -- 172.21.15.82:0/2660511789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c00b9c0 con 0x7f3d1015cb10 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d077fe700 1 -- 172.21.15.82:0/2660511789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00bd60 con 0x7f3d1015cb10 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 -- 172.21.15.82:0/2660511789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d1015cb10 msgr2=0x7f3d100af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2660511789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d1015cb10 0x7f3d100af780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3d1006f7c0 tx=0x7f3d0c009250 comp rx=0 tx=0).stop 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 -- 172.21.15.82:0/2660511789 shutdown_connections 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2660511789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d1015cb10 0x7f3d100af780 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2660511789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 0x7f3d100b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2660511789 >> v2:172.21.15.134:3300/0 conn(0x7f3d100b4000 0x7f3d10159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 -- 172.21.15.82:0/2660511789 >> 172.21.15.82:0/2660511789 conn(0x7f3d1006d890 msgr2=0x7f3d1006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:38.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 -- 172.21.15.82:0/2660511789 shutdown_connections 2023-10-06T03:17:38.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.951+0000 7f3d16b06700 1 -- 172.21.15.82:0/2660511789 wait complete. 2023-10-06T03:17:38.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.952+0000 7f3d16b06700 1 Processor -- start 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.953+0000 7f3d16b06700 1 -- start start 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.953+0000 7f3d16b06700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 0x7f3d10147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.953+0000 7f3d16b06700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d100b4000 0x7f3d100cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.953+0000 7f3d16b06700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1015cb10 0x7f3d100cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.953+0000 7f3d16b06700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100ca7a0 con 0x7f3d100b4000 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.953+0000 7f3d16b06700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100cb5c0 con 0x7f3d1015cb10 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.953+0000 7f3d16b06700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100ca9b0 con 0x7f3d100b1690 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.953+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d100b4000 0x7f3d100cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d100b4000 0x7f3d100cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39972/0 (socket says 172.21.15.82:39972) 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d07fff700 1 -- 172.21.15.82:0/2045595750 learned_addr learned my addr 172.21.15.82:0/2045595750 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d148a2700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 0x7f3d10147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d150a3700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1015cb10 0x7f3d100cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d07fff700 1 -- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 msgr2=0x7f3d10147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d07fff700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 0x7f3d10147da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d07fff700 1 -- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1015cb10 msgr2=0x7f3d100cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d07fff700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1015cb10 0x7f3d100cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d07fff700 1 -- 172.21.15.82:0/2045595750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0094f0 con 0x7f3d100b4000 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d150a3700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1015cb10 0x7f3d100cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:38.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d07fff700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d100b4000 0x7f3d100cd0b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000d890 tx=0x7f3d00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d04ff9700 1 -- 172.21.15.82:0/2045595750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000125f0 con 0x7f3d100b4000 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d04ff9700 1 -- 172.21.15.82:0/2045595750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d00012750 con 0x7f3d100b4000 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d100cac90 con 0x7f3d100b4000 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d04ff9700 1 -- 172.21.15.82:0/2045595750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00012ad0 con 0x7f3d100b4000 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.954+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d100cb250 con 0x7f3d100b4000 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.955+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d100cb750 con 0x7f3d100b4000 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.955+0000 7f3d04ff9700 1 -- 172.21.15.82:0/2045595750 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d0001e460 con 0x7f3d100b4000 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.956+0000 7f3d04ff9700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.956+0000 7f3d04ff9700 1 -- 172.21.15.82:0/2045595750 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d00084cb0 con 0x7f3d100b4000 2023-10-06T03:17:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.956+0000 7f3d148a2700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.957+0000 7f3d148a2700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3cfc066f30 0x7f3cfc0693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3d1006f7c0 tx=0x7f3d0c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:38.960+0000 7f3d04ff9700 1 -- 172.21.15.82:0/2045595750 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d00051dc0 con 0x7f3d100b4000 2023-10-06T03:17:39.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.140+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d10064050 con 0x7f3d100b4000 2023-10-06T03:17:39.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.140+0000 7f3d04ff9700 1 -- 172.21.15.82:0/2045595750 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d000553e0 con 0x7f3d100b4000 2023-10-06T03:17:39.142 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-10-06T03:17:39.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3cfc066f30 msgr2=0x7f3cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3cfc066f30 0x7f3cfc0693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3d1006f7c0 tx=0x7f3d0c017000 comp rx=0 tx=0).stop 2023-10-06T03:17:39.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d100b4000 msgr2=0x7f3d100cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d100b4000 0x7f3d100cd0b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000d890 tx=0x7f3d00008040 comp rx=0 tx=0).stop 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 shutdown_connections 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1015cb10 0x7f3d100cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d100b1690 0x7f3d10147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 --2- 172.21.15.82:0/2045595750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d100b4000 0x7f3d100cd0b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 >> 172.21.15.82:0/2045595750 conn(0x7f3d1006d890 msgr2=0x7f3d10159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 shutdown_connections 2023-10-06T03:17:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.142+0000 7f3d16b06700 1 -- 172.21.15.82:0/2045595750 wait complete. 2023-10-06T03:17:39.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:39.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.268+0000 7f18129f8700 1 Processor -- start 2023-10-06T03:17:39.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.268+0000 7f18129f8700 1 -- start start 2023-10-06T03:17:39.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18129f8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c15d480 0x7f180c069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18129f8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f180c069da0 0x7f180c0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18129f8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f180c15d850 0x7f180c0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18129f8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c0687c0 con 0x7f180c15d850 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18129f8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c068aa0 con 0x7f180c069da0 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18129f8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c068d80 con 0x7f180c15d480 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18121f7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f180c15d850 0x7f180c0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18121f7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f180c15d850 0x7f180c0b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39978/0 (socket says 172.21.15.82:39978) 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18121f7700 1 -- 172.21.15.82:0/2279443530 learned_addr learned my addr 172.21.15.82:0/2279443530 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18119f6700 1 --2- 172.21.15.82:0/2279443530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c15d480 0x7f180c069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.269+0000 7f18111f5700 1 --2- 172.21.15.82:0/2279443530 >> v2:172.21.15.134:3300/0 conn(0x7f180c069da0 0x7f180c0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18121f7700 1 -- 172.21.15.82:0/2279443530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c15d480 msgr2=0x7f180c069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18121f7700 1 --2- 172.21.15.82:0/2279443530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c15d480 0x7f180c069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18121f7700 1 -- 172.21.15.82:0/2279443530 >> v2:172.21.15.134:3300/0 conn(0x7f180c069da0 msgr2=0x7f180c0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18121f7700 1 --2- 172.21.15.82:0/2279443530 >> v2:172.21.15.134:3300/0 conn(0x7f180c069da0 0x7f180c0b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18121f7700 1 -- 172.21.15.82:0/2279443530 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c069060 con 0x7f180c15d850 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18111f5700 1 --2- 172.21.15.82:0/2279443530 >> v2:172.21.15.134:3300/0 conn(0x7f180c069da0 0x7f180c0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18121f7700 1 --2- 172.21.15.82:0/2279443530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c0b0850 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f180c088d70 tx=0x7f1804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c0f2e6de15d36b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18109f4700 1 -- 172.21.15.82:0/2279443530 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804009e70 con 0x7f180c15d850 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18109f4700 1 -- 172.21.15.82:0/2279443530 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180400b860 con 0x7f180c15d850 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18109f4700 1 -- 172.21.15.82:0/2279443530 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180400bc00 con 0x7f180c15d850 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18129f8700 1 -- 172.21.15.82:0/2279443530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 msgr2=0x7f180c0b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18129f8700 1 --2- 172.21.15.82:0/2279443530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c0b0850 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f180c088d70 tx=0x7f1804009250 comp rx=0 tx=0).stop 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18129f8700 1 -- 172.21.15.82:0/2279443530 shutdown_connections 2023-10-06T03:17:39.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18129f8700 1 --2- 172.21.15.82:0/2279443530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c0b0850 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18129f8700 1 --2- 172.21.15.82:0/2279443530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c15d480 0x7f180c069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18129f8700 1 --2- 172.21.15.82:0/2279443530 >> v2:172.21.15.134:3300/0 conn(0x7f180c069da0 0x7f180c0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.270+0000 7f18129f8700 1 -- 172.21.15.82:0/2279443530 >> 172.21.15.82:0/2279443530 conn(0x7f180c0ccf80 msgr2=0x7f180c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:39.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.271+0000 7f18129f8700 1 -- 172.21.15.82:0/2279443530 shutdown_connections 2023-10-06T03:17:39.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.271+0000 7f18129f8700 1 -- 172.21.15.82:0/2279443530 wait complete. 2023-10-06T03:17:39.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.272+0000 7f18129f8700 1 Processor -- start 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.272+0000 7f18129f8700 1 -- start start 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.272+0000 7f18129f8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c069da0 0x7f180c1406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.272+0000 7f18129f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f180c15d480 0x7f180c0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.272+0000 7f18129f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c16a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.272+0000 7f18129f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0c8440 con 0x7f180c15d850 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.272+0000 7f18129f8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c169ed0 con 0x7f180c15d480 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.272+0000 7f18129f8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0c7e80 con 0x7f180c069da0 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c16a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c16a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39980/0 (socket says 172.21.15.82:39980) 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 -- 172.21.15.82:0/2957948176 learned_addr learned my addr 172.21.15.82:0/2957948176 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:39.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 -- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c069da0 msgr2=0x7f180c1406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18119f6700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c069da0 0x7f180c1406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c069da0 0x7f180c1406c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 -- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f180c15d480 msgr2=0x7f180c0c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f180c15d480 0x7f180c0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 -- 172.21.15.82:0/2957948176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040094f0 con 0x7f180c15d850 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18121f7700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c16a360 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f18040094c0 tx=0x7f1804017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f1801ffb700 1 -- 172.21.15.82:0/2957948176 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180401a450 con 0x7f180c15d850 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f1801ffb700 1 -- 172.21.15.82:0/2957948176 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180401a5b0 con 0x7f180c15d850 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c0c8160 con 0x7f180c15d850 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f1801ffb700 1 -- 172.21.15.82:0/2957948176 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180401a970 con 0x7f180c15d850 2023-10-06T03:17:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.273+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c140c00 con 0x7f180c15d850 2023-10-06T03:17:39.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.274+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c16a060 con 0x7f180c15d850 2023-10-06T03:17:39.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.275+0000 7f1801ffb700 1 -- 172.21.15.82:0/2957948176 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f180401b430 con 0x7f180c15d850 2023-10-06T03:17:39.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.275+0000 7f1801ffb700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f17f0066f30 0x7f17f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.275+0000 7f1801ffb700 1 -- 172.21.15.82:0/2957948176 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1804085e70 con 0x7f180c15d850 2023-10-06T03:17:39.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.275+0000 7f18119f6700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f17f0066f30 0x7f17f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.276+0000 7f18119f6700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f17f0066f30 0x7f17f00693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f18080076c0 tx=0x7f180800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.279+0000 7f1801ffb700 1 -- 172.21.15.82:0/2957948176 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1804052f80 con 0x7f180c15d850 2023-10-06T03:17:39.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.512+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f180c04c3c0 con 0x7f180c15d850 2023-10-06T03:17:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.513+0000 7f1801ffb700 1 -- 172.21.15.82:0/2957948176 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f18040565a0 con 0x7f180c15d850 2023-10-06T03:17:39.515 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:39.515 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/763820094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":763820094},{"type":"v1","addr":"172.21.15.134:6837","nonce":763820094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/1309129480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1309129480},{"type":"v1","addr":"172.21.15.134:6836","nonce":1309129480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/21148295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":21148295},{"type":"v1","addr":"172.21.15.82:6834","nonce":21148295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:27.187663+0000","modified":"2023-10-06T03:17:30.826288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5706":{"gid":5706,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/598797511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":598797511},{"type":"v1","addr":"172.21.15.82:6835","nonce":598797511}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:17:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f17f0066f30 msgr2=0x7f17f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f17f0066f30 0x7f17f00693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f18080076c0 tx=0x7f180800b040 comp rx=0 tx=0).stop 2023-10-06T03:17:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 msgr2=0x7f180c16a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c16a360 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f18040094c0 tx=0x7f1804017000 comp rx=0 tx=0).stop 2023-10-06T03:17:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 shutdown_connections 2023-10-06T03:17:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f180c15d850 0x7f180c16a360 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f17f0066f30 0x7f17f00693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f180c069da0 0x7f180c1406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 --2- 172.21.15.82:0/2957948176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f180c15d480 0x7f180c0c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.515+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 >> 172.21.15.82:0/2957948176 conn(0x7f180c0ccf80 msgr2=0x7f180c0b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.516+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 shutdown_connections 2023-10-06T03:17:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.516+0000 7f18129f8700 1 -- 172.21.15.82:0/2957948176 wait complete. 2023-10-06T03:17:39.519 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-10-06T03:17:39.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.641+0000 7f80632de700 1 Processor -- start 2023-10-06T03:17:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.641+0000 7f80632de700 1 -- start start 2023-10-06T03:17:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.642+0000 7f80632de700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f805c0b09a0 0x7f805c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.642+0000 7f80632de700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f805c159a90 0x7f805c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.642+0000 7f80632de700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c15e3a0 con 0x7f805c1596c0 2023-10-06T03:17:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.642+0000 7f80632de700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805c0cc470 con 0x7f805c0b09a0 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.642+0000 7f80632de700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805c15db30 con 0x7f805c159a90 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.642+0000 7f806107a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f805c1596c0 0x7f805c15d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35914/0 (socket says 172.21.15.82:35914) 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.642+0000 7f806107a700 1 -- 172.21.15.82:0/3532838163 learned_addr learned my addr 172.21.15.82:0/3532838163 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.642+0000 7f8060879700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f805c0b09a0 0x7f805c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f806187b700 1 --2- 172.21.15.82:0/3532838163 >> v2:172.21.15.134:3300/0 conn(0x7f805c159a90 0x7f805c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8060879700 1 -- 172.21.15.82:0/3532838163 >> v2:172.21.15.134:3300/0 conn(0x7f805c159a90 msgr2=0x7f805c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8060879700 1 --2- 172.21.15.82:0/3532838163 >> v2:172.21.15.134:3300/0 conn(0x7f805c159a90 0x7f805c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8060879700 1 -- 172.21.15.82:0/3532838163 >> v1:172.21.15.82:6789/0 conn(0x7f805c1596c0 legacy=0x7f805c15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8053fff700 1 -- 172.21.15.82:0/3532838163 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426151122 0 0) 0x7f805c15e3a0 con 0x7f805c1596c0 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8060879700 1 -- 172.21.15.82:0/3532838163 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c15dde0 con 0x7f805c0b09a0 2023-10-06T03:17:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f806187b700 1 --2- 172.21.15.82:0/3532838163 >> v2:172.21.15.134:3300/0 conn(0x7f805c159a90 0x7f805c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8060879700 1 --2- 172.21.15.82:0/3532838163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c0b09a0 0x7f805c0c8a40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f805c06af20 tx=0x7f804c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884e9f86a25e47bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8053fff700 1 -- 172.21.15.82:0/3532838163 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c00b6b0 con 0x7f805c0b09a0 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8053fff700 1 -- 172.21.15.82:0/3532838163 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c00b810 con 0x7f805c0b09a0 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f8053fff700 1 -- 172.21.15.82:0/3532838163 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c00bbb0 con 0x7f805c0b09a0 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f80632de700 1 -- 172.21.15.82:0/3532838163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c0b09a0 msgr2=0x7f805c0c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f80632de700 1 --2- 172.21.15.82:0/3532838163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c0b09a0 0x7f805c0c8a40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f805c06af20 tx=0x7f804c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f80632de700 1 -- 172.21.15.82:0/3532838163 shutdown_connections 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f80632de700 1 --2- 172.21.15.82:0/3532838163 >> v2:172.21.15.134:3300/0 conn(0x7f805c159a90 0x7f805c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.643+0000 7f80632de700 1 --2- 172.21.15.82:0/3532838163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c0b09a0 0x7f805c0c8a40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.644+0000 7f80632de700 1 -- 172.21.15.82:0/3532838163 >> 172.21.15.82:0/3532838163 conn(0x7f805c067630 msgr2=0x7f805c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.644+0000 7f80632de700 1 -- 172.21.15.82:0/3532838163 shutdown_connections 2023-10-06T03:17:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.644+0000 7f80632de700 1 -- 172.21.15.82:0/3532838163 wait complete. 2023-10-06T03:17:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.645+0000 7f80632de700 1 Processor -- start 2023-10-06T03:17:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.645+0000 7f80632de700 1 -- start start 2023-10-06T03:17:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.645+0000 7f80632de700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c1596c0 0x7f805c145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80632de700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f805c159a90 0x7f805c0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80632de700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f805c15c930 0x7f805c0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80632de700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c145990 con 0x7f805c1596c0 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80632de700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0c5b10 con 0x7f805c15c930 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80632de700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0c79c0 con 0x7f805c159a90 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c1596c0 0x7f805c145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c1596c0 0x7f805c145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40004/0 (socket says 172.21.15.82:40004) 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 -- 172.21.15.82:0/2468979878 learned_addr learned my addr 172.21.15.82:0/2468979878 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f8060879700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f805c159a90 0x7f805c0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806187b700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f805c15c930 0x7f805c0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 -- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f805c159a90 msgr2=0x7f805c0c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f805c159a90 0x7f805c0c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 -- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f805c15c930 msgr2=0x7f805c0b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f805c15c930 0x7f805c0b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 -- 172.21.15.82:0/2468979878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c009420 con 0x7f805c1596c0 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f806107a700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c1596c0 0x7f805c145450 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f805800cd80 tx=0x7f8058001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80517fa700 1 -- 172.21.15.82:0/2468979878 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805800ab10 con 0x7f805c1596c0 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80517fa700 1 -- 172.21.15.82:0/2468979878 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805800ac70 con 0x7f805c1596c0 2023-10-06T03:17:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c15d170 con 0x7f805c1596c0 2023-10-06T03:17:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80517fa700 1 -- 172.21.15.82:0/2468979878 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580070f0 con 0x7f805c1596c0 2023-10-06T03:17:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.646+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c0c7370 con 0x7f805c1596c0 2023-10-06T03:17:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.647+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805c064050 con 0x7f805c1596c0 2023-10-06T03:17:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.648+0000 7f80517fa700 1 -- 172.21.15.82:0/2468979878 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80580074e0 con 0x7f805c1596c0 2023-10-06T03:17:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.648+0000 7f80517fa700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8040066f30 0x7f80400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.648+0000 7f80517fa700 1 -- 172.21.15.82:0/2468979878 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f8058084cb0 con 0x7f805c1596c0 2023-10-06T03:17:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.648+0000 7f8060879700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8040066f30 0x7f80400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.649+0000 7f8060879700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8040066f30 0x7f80400693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f805c06af20 tx=0x7f804c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.652+0000 7f80517fa700 1 -- 172.21.15.82:0/2468979878 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8058051db0 con 0x7f805c1596c0 2023-10-06T03:17:39.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.835+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f805c0afe20 con 0x7f805c1596c0 2023-10-06T03:17:39.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.836+0000 7f80517fa700 1 -- 172.21.15.82:0/2468979878 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17108 (secure 0 0 0) 0x7f80580553d0 con 0x7f805c1596c0 2023-10-06T03:17:39.838 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:39.838 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":56,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:39.328554+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:24.832103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:26.150387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.13","mappings":[{"from":1,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.28","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8040066f30 msgr2=0x7f80400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8040066f30 0x7f80400693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f805c06af20 tx=0x7f804c017000 comp rx=0 tx=0).stop 2023-10-06T03:17:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c1596c0 msgr2=0x7f805c145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c1596c0 0x7f805c145450 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f805800cd80 tx=0x7f8058001ae0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 shutdown_connections 2023-10-06T03:17:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f805c15c930 0x7f805c0b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f805c1596c0 0x7f805c145450 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f8040066f30 0x7f80400693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 --2- 172.21.15.82:0/2468979878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f805c159a90 0x7f805c0c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 >> 172.21.15.82:0/2468979878 conn(0x7f805c067630 msgr2=0x7f805c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 shutdown_connections 2023-10-06T03:17:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.838+0000 7f80632de700 1 -- 172.21.15.82:0/2468979878 wait complete. 2023-10-06T03:17:39.852 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:17:39.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:39.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.964+0000 7f7295d45700 1 Processor -- start 2023-10-06T03:17:39.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.964+0000 7f7295d45700 1 -- start start 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.964+0000 7f7295d45700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900b4060 0x7f7290158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.964+0000 7f7295d45700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72900add70 0x7f72900ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.964+0000 7f7295d45700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72901580d0 con 0x7f7290157570 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.964+0000 7f7295d45700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72900ae6d0 con 0x7f72900add70 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.964+0000 7f7295d45700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729015ba40 con 0x7f72900b4060 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72900add70 0x7f72900ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72900add70 0x7f72900ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40014/0 (socket says 172.21.15.82:40014) 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728ffff700 1 -- 172.21.15.82:0/2989894776 learned_addr learned my addr 172.21.15.82:0/2989894776 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728effd700 1 --2- 172.21.15.82:0/2989894776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900b4060 0x7f7290158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728ffff700 1 -- 172.21.15.82:0/2989894776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900b4060 msgr2=0x7f7290158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728ffff700 1 --2- 172.21.15.82:0/2989894776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900b4060 0x7f7290158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728ffff700 1 -- 172.21.15.82:0/2989894776 >> v1:172.21.15.134:6789/0 conn(0x7f7290157570 legacy=0x7f729015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728ffff700 1 -- 172.21.15.82:0/2989894776 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729015bd20 con 0x7f72900add70 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728effd700 1 --2- 172.21.15.82:0/2989894776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900b4060 0x7f7290158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728ffff700 1 --2- 172.21.15.82:0/2989894776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900add70 0x7f72900ae190 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7288009f20 tx=0x7f7288009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab72e8495c502b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728e7fc700 1 -- 172.21.15.82:0/2989894776 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800e070 con 0x7f72900add70 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728e7fc700 1 -- 172.21.15.82:0/2989894776 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728800ba40 con 0x7f72900add70 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.965+0000 7f728e7fc700 1 -- 172.21.15.82:0/2989894776 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880092e0 con 0x7f72900add70 2023-10-06T03:17:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.966+0000 7f7295d45700 1 -- 172.21.15.82:0/2989894776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900add70 msgr2=0x7f72900ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.966+0000 7f7295d45700 1 --2- 172.21.15.82:0/2989894776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900add70 0x7f72900ae190 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7288009f20 tx=0x7f7288009840 comp rx=0 tx=0).stop 2023-10-06T03:17:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.966+0000 7f7295d45700 1 -- 172.21.15.82:0/2989894776 shutdown_connections 2023-10-06T03:17:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.966+0000 7f7295d45700 1 --2- 172.21.15.82:0/2989894776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900add70 0x7f72900ae190 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.966+0000 7f7295d45700 1 --2- 172.21.15.82:0/2989894776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900b4060 0x7f7290158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.966+0000 7f7295d45700 1 -- 172.21.15.82:0/2989894776 >> 172.21.15.82:0/2989894776 conn(0x7f7290067630 msgr2=0x7f7290067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.966+0000 7f7295d45700 1 -- 172.21.15.82:0/2989894776 shutdown_connections 2023-10-06T03:17:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.966+0000 7f7295d45700 1 -- 172.21.15.82:0/2989894776 wait complete. 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.967+0000 7f7295d45700 1 Processor -- start 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.967+0000 7f7295d45700 1 -- start start 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f7295d45700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900add70 0x7f7290153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f7295d45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900b4060 0x7f72900c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f7295d45700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7290157570 0x7f72900b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f7295d45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72900c51f0 con 0x7f72900b4060 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f7295d45700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72900693e0 con 0x7f7290157570 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f7295d45700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7290153f40 con 0x7f72900add70 2023-10-06T03:17:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900b4060 0x7f72900c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900b4060 0x7f72900c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40022/0 (socket says 172.21.15.82:40022) 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728effd700 1 -- 172.21.15.82:0/557249343 learned_addr learned my addr 172.21.15.82:0/557249343 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728f7fe700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900add70 0x7f7290153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728ffff700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7290157570 0x7f72900b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728effd700 1 -- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900add70 msgr2=0x7f7290153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728effd700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900add70 0x7f7290153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728effd700 1 -- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7290157570 msgr2=0x7f72900b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728effd700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7290157570 0x7f72900b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.968+0000 7f728effd700 1 -- 172.21.15.82:0/557249343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288009ae0 con 0x7f72900b4060 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.969+0000 7f728effd700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900b4060 0x7f72900c4230 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f727800c860 tx=0x7f7278008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.969+0000 7f72877fe700 1 -- 172.21.15.82:0/557249343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278011600 con 0x7f72900b4060 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.969+0000 7f72877fe700 1 -- 172.21.15.82:0/557249343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7278011760 con 0x7f72900b4060 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.969+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72900c4c30 con 0x7f72900b4060 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.969+0000 7f72877fe700 1 -- 172.21.15.82:0/557249343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278011b20 con 0x7f72900b4060 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.969+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7290069070 con 0x7f72900b4060 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.970+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7290069570 con 0x7f72900b4060 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.970+0000 7f72877fe700 1 -- 172.21.15.82:0/557249343 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72780193b0 con 0x7f72900b4060 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.970+0000 7f72877fe700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7270066f30 0x7f72700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.971+0000 7f72877fe700 1 -- 172.21.15.82:0/557249343 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f7278084650 con 0x7f72900b4060 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.971+0000 7f728f7fe700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7270066f30 0x7f72700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.971+0000 7f728f7fe700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7270066f30 0x7f72700693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7280009af0 tx=0x7f7280009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:39.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:39.975+0000 7f72877fe700 1 -- 172.21.15.82:0/557249343 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72780516d0 con 0x7f72900b4060 2023-10-06T03:17:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.200+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7290064050 con 0x7f72900b4060 2023-10-06T03:17:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.200+0000 7f72877fe700 1 -- 172.21.15.82:0/557249343 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f7278054cf0 con 0x7f72900b4060 2023-10-06T03:17:40.202 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:40.202 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/763820094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":763820094},{"type":"v1","addr":"172.21.15.134:6837","nonce":763820094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/1309129480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1309129480},{"type":"v1","addr":"172.21.15.134:6836","nonce":1309129480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/21148295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":21148295},{"type":"v1","addr":"172.21.15.82:6834","nonce":21148295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:27.187663+0000","modified":"2023-10-06T03:17:30.826288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5706":{"gid":5706,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/598797511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":598797511},{"type":"v1","addr":"172.21.15.82:6835","nonce":598797511}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:17:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7270066f30 msgr2=0x7f72700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7270066f30 0x7f72700693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7280009af0 tx=0x7f7280009060 comp rx=0 tx=0).stop 2023-10-06T03:17:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900b4060 msgr2=0x7f72900c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900b4060 0x7f72900c4230 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f727800c860 tx=0x7f7278008040 comp rx=0 tx=0).stop 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 shutdown_connections 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7290157570 0x7f72900b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7270066f30 0x7f72700693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72900add70 0x7f7290153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 --2- 172.21.15.82:0/557249343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72900b4060 0x7f72900c4230 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.202+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 >> 172.21.15.82:0/557249343 conn(0x7f7290067630 msgr2=0x7f729015ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.203+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 shutdown_connections 2023-10-06T03:17:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.203+0000 7f7295d45700 1 -- 172.21.15.82:0/557249343 wait complete. 2023-10-06T03:17:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-10-06T03:17:40.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:17:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.329+0000 7f94ca24a700 1 Processor -- start 2023-10-06T03:17:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.329+0000 7f94ca24a700 1 -- start start 2023-10-06T03:17:40.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94ca24a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f94c415d930 0x7f94c40d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94ca24a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c40b2ad0 con 0x7f94c41591b0 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94ca24a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c40b4160 con 0x7f94c415d560 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94ca24a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40b2230 con 0x7f94c415d930 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94c3fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f94c41591b0 0x7f94c4159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35918/0 (socket says 172.21.15.82:35918) 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94c3fff700 1 -- 172.21.15.82:0/2074676397 learned_addr learned my addr 172.21.15.82:0/2074676397 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94c2ffd700 1 --2- 172.21.15.82:0/2074676397 >> v2:172.21.15.134:3300/0 conn(0x7f94c415d930 0x7f94c40d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013821784 0 0) 0x7f94c40b2ad0 con 0x7f94c41591b0 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.330+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94ac003570 con 0x7f94c41591b0 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498794559 0 0) 0x7f94ac003570 con 0x7f94c41591b0 2023-10-06T03:17:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 >> v2:172.21.15.134:3300/0 conn(0x7f94c415d930 msgr2=0x7f94c40d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 --2- 172.21.15.82:0/2074676397 >> v2:172.21.15.134:3300/0 conn(0x7f94c415d930 0x7f94c40d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 >> v1:172.21.15.134:6789/0 conn(0x7f94c415d560 legacy=0x7f94c40b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40b2510 con 0x7f94c41591b0 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f94bc001470 con 0x7f94c41591b0 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 >> v1:172.21.15.82:6789/0 conn(0x7f94c41591b0 legacy=0x7f94c4159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ac003a60 0x7f94ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94ac004810 0x7f94ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40b2230 con 0x7f94ac0051c0 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac00c160 con 0x7f94ac003a60 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac00c320 con 0x7f94ac004810 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c3fff700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c37fe700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ac003a60 0x7f94ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c2ffd700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94ac004810 0x7f94ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c3fff700 1 -- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94ac004810 msgr2=0x7f94ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c3fff700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94ac004810 0x7f94ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c3fff700 1 -- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ac003a60 msgr2=0x7f94ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c3fff700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ac003a60 0x7f94ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c3fff700 1 -- 172.21.15.82:0/2074676397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac003570 con 0x7f94ac0051c0 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c37fe700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94ac003a60 0x7f94ac003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c3fff700 1 -- 172.21.15.82:0/2074676397 reap_dead start 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c3fff700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94ac00ba60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c3c0 tx=0x7f94bc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e701328a669bff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc00cc90 con 0x7f94ac0051c0 2023-10-06T03:17:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc00ce30 con 0x7f94ac0051c0 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.331+0000 7f94c27fc700 1 -- 172.21.15.82:0/2074676397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc005b70 con 0x7f94ac0051c0 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.332+0000 7f94ca24a700 1 -- 172.21.15.82:0/2074676397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 msgr2=0x7f94ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.332+0000 7f94ca24a700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94ac00ba60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c3c0 tx=0x7f94bc001e50 comp rx=0 tx=0).stop 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.332+0000 7f94ca24a700 1 -- 172.21.15.82:0/2074676397 shutdown_connections 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.332+0000 7f94ca24a700 1 --2- 172.21.15.82:0/2074676397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94ac00ba60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.332+0000 7f94ca24a700 1 -- 172.21.15.82:0/2074676397 >> 172.21.15.82:0/2074676397 conn(0x7f94c40d1180 msgr2=0x7f94c4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.332+0000 7f94ca24a700 1 -- 172.21.15.82:0/2074676397 shutdown_connections 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.332+0000 7f94ca24a700 1 -- 172.21.15.82:0/2074676397 wait complete. 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.333+0000 7f94ca24a700 1 Processor -- start 2023-10-06T03:17:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.333+0000 7f94ca24a700 1 -- start start 2023-10-06T03:17:40.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94ca24a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94c415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94ca24a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c413b3b0 0x7f94c413eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94ca24a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c413f3e0 0x7f94c416cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94ca24a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c413f850 con 0x7f94ac0051c0 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94ca24a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c413e340 con 0x7f94c413b3b0 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94ca24a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c413d7c0 con 0x7f94c413f3e0 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94c415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94c415c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40040/0 (socket says 172.21.15.82:40040) 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 -- 172.21.15.82:0/2349255036 learned_addr learned my addr 172.21.15.82:0/2349255036 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 -- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c413f3e0 msgr2=0x7f94c416cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c413f3e0 0x7f94c416cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 -- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c413b3b0 msgr2=0x7f94c413eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c2ffd700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c413b3b0 0x7f94c413eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c413b3b0 0x7f94c413eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 -- 172.21.15.82:0/2349255036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c413daa0 con 0x7f94ac0051c0 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c2ffd700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c413b3b0 0x7f94c413eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.334+0000 7f94c37fe700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94c415c9a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000f80 tx=0x7f94b4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.335+0000 7f94ab7fe700 1 -- 172.21.15.82:0/2349255036 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4018070 con 0x7f94ac0051c0 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.335+0000 7f94ab7fe700 1 -- 172.21.15.82:0/2349255036 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4010040 con 0x7f94ac0051c0 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.335+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c413dd80 con 0x7f94ac0051c0 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.335+0000 7f94ab7fe700 1 -- 172.21.15.82:0/2349255036 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4006dd0 con 0x7f94ac0051c0 2023-10-06T03:17:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.335+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c413b820 con 0x7f94ac0051c0 2023-10-06T03:17:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.336+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c414d660 con 0x7f94ac0051c0 2023-10-06T03:17:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.336+0000 7f94ab7fe700 1 -- 172.21.15.82:0/2349255036 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94b4003030 con 0x7f94ac0051c0 2023-10-06T03:17:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.336+0000 7f94ab7fe700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f94b0066f60 0x7f94b0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.337+0000 7f94ab7fe700 1 -- 172.21.15.82:0/2349255036 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f94b4083c00 con 0x7f94ac0051c0 2023-10-06T03:17:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.337+0000 7f94c2ffd700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f94b0066f60 0x7f94b0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.337+0000 7f94c2ffd700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f94b0066f60 0x7f94b0069410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f94b8006c80 tx=0x7f94b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:40.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.347+0000 7f94ab7fe700 1 -- 172.21.15.82:0/2349255036 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94c414d660 con 0x7f94ac0051c0 2023-10-06T03:17:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.576+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94c414d660 con 0x7f94ac0051c0 2023-10-06T03:17:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.577+0000 7f94ab7fe700 1 -- 172.21.15.82:0/2349255036 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f94c414d660 con 0x7f94ac0051c0 2023-10-06T03:17:40.578 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:40.579 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/763820094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":763820094},{"type":"v1","addr":"172.21.15.134:6837","nonce":763820094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/1309129480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1309129480},{"type":"v1","addr":"172.21.15.134:6836","nonce":1309129480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/21148295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":21148295},{"type":"v1","addr":"172.21.15.82:6834","nonce":21148295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:17:27.187663+0000","modified":"2023-10-06T03:17:30.826288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5706":{"gid":5706,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6835/598797511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":598797511},{"type":"v1","addr":"172.21.15.82:6835","nonce":598797511}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f94b0066f60 msgr2=0x7f94b0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f94b0066f60 0x7f94b0069410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f94b8006c80 tx=0x7f94b8008040 comp rx=0 tx=0).stop 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 msgr2=0x7f94c415c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94c415c9a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000f80 tx=0x7f94b4009040 comp rx=0 tx=0).stop 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 shutdown_connections 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f94b0066f60 0x7f94b0069410 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c413f3e0 0x7f94c416cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94ac0051c0 0x7f94c415c9a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 --2- 172.21.15.82:0/2349255036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c413b3b0 0x7f94c413eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 >> 172.21.15.82:0/2349255036 conn(0x7f94c40d1180 msgr2=0x7f94c4068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:40.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 shutdown_connections 2023-10-06T03:17:40.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.579+0000 7f94ca24a700 1 -- 172.21.15.82:0/2349255036 wait complete. 2023-10-06T03:17:40.582 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-10-06T03:17:40.592 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:40.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.705+0000 7f5b3fa32700 1 Processor -- start 2023-10-06T03:17:40.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.705+0000 7f5b3fa32700 1 -- start start 2023-10-06T03:17:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b3fa32700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3815d560 0x7f5b380d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b3fa32700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380b2ad0 con 0x7f5b3815d930 2023-10-06T03:17:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b3fa32700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380b4160 con 0x7f5b381591b0 2023-10-06T03:17:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b3fa32700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380b2230 con 0x7f5b3815d560 2023-10-06T03:17:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b3cfcd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5b3815d930 0x7f5b380b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35924/0 (socket says 172.21.15.82:35924) 2023-10-06T03:17:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b3cfcd700 1 -- 172.21.15.82:0/1625073901 learned_addr learned my addr 172.21.15.82:0/1625073901 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b3d7ce700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3815d560 0x7f5b380d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663920072 0 0) 0x7f5b380b2ad0 con 0x7f5b3815d930 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b20003570 con 0x7f5b3815d930 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814668075 0 0) 0x7f5b380b4160 con 0x7f5b381591b0 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b380b2ad0 con 0x7f5b381591b0 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3485295878 0 0) 0x7f5b20003570 con 0x7f5b3815d930 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3815d560 msgr2=0x7f5b380d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3815d560 0x7f5b380d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 >> v1:172.21.15.134:6789/0 conn(0x7f5b381591b0 legacy=0x7f5b38159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380b2510 con 0x7f5b3815d930 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.706+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f5b2c001470 con 0x7f5b3815d930 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 >> v1:172.21.15.82:6789/0 conn(0x7f5b3815d930 legacy=0x7f5b380b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20003c20 0x7f5b20004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3815d560 0x7f5b20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20004d50 0x7f5b200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380b2230 con 0x7f5b20004d50 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2000bbf0 con 0x7f5b20003c20 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2000bd60 con 0x7f5b3815d560 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3dfcf700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20004d50 0x7f5b200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3cfcd700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3815d560 0x7f5b20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3d7ce700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20003c20 0x7f5b20004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3dfcf700 1 -- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3815d560 msgr2=0x7f5b20004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3dfcf700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3815d560 0x7f5b20004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3dfcf700 1 -- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20003c20 msgr2=0x7f5b20004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3dfcf700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20003c20 0x7f5b20004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3dfcf700 1 -- 172.21.15.82:0/1625073901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20003570 con 0x7f5b20004d50 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3d7ce700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20003c20 0x7f5b20004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b3dfcf700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20004d50 0x7f5b200051c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5b280020f0 tx=0x7f5b280017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4525492c143522 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28001ab0 con 0x7f5b20004d50 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2800c8b0 con 0x7f5b20004d50 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.707+0000 7f5b37fff700 1 -- 172.21.15.82:0/1625073901 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800cc70 con 0x7f5b20004d50 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.708+0000 7f5b3fa32700 1 -- 172.21.15.82:0/1625073901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20004d50 msgr2=0x7f5b200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.708+0000 7f5b3fa32700 1 --2- 172.21.15.82:0/1625073901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20004d50 0x7f5b200051c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5b280020f0 tx=0x7f5b280017a0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.708+0000 7f5b3dfcf700 1 -- 172.21.15.82:0/1625073901 reap_dead start 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.708+0000 7f5b3fa32700 1 -- 172.21.15.82:0/1625073901 shutdown_connections 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.708+0000 7f5b3fa32700 1 -- 172.21.15.82:0/1625073901 >> 172.21.15.82:0/1625073901 conn(0x7f5b380d1180 msgr2=0x7f5b38069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.708+0000 7f5b3fa32700 1 -- 172.21.15.82:0/1625073901 shutdown_connections 2023-10-06T03:17:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.708+0000 7f5b3fa32700 1 -- 172.21.15.82:0/1625073901 wait complete. 2023-10-06T03:17:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.709+0000 7f5b3fa32700 1 Processor -- start 2023-10-06T03:17:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.709+0000 7f5b3fa32700 1 -- start start 2023-10-06T03:17:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3fa32700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b381557f0 0x7f5b380c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3fa32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b38155bc0 0x7f5b380c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3fa32700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b380c7990 0x7f5b380c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3fa32700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380c6980 con 0x7f5b38155bc0 2023-10-06T03:17:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3fa32700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380c7500 con 0x7f5b381557f0 2023-10-06T03:17:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3fa32700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380c6bd0 con 0x7f5b380c7990 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b38155bc0 0x7f5b380c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b38155bc0 0x7f5b380c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40070/0 (socket says 172.21.15.82:40070) 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 -- 172.21.15.82:0/2720018424 learned_addr learned my addr 172.21.15.82:0/2720018424 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3d7ce700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b381557f0 0x7f5b380c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3dfcf700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b380c7990 0x7f5b380c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 -- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b380c7990 msgr2=0x7f5b380c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b380c7990 0x7f5b380c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 -- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b381557f0 msgr2=0x7f5b380c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b381557f0 0x7f5b380c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 -- 172.21.15.82:0/2720018424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380c6eb0 con 0x7f5b38155bc0 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3cfcd700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b38155bc0 0x7f5b380c5e30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0073c0 tx=0x7f5b380d0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b357fa700 1 -- 172.21.15.82:0/2720018424 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c018030 con 0x7f5b38155bc0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b357fa700 1 -- 172.21.15.82:0/2720018424 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0077a0 con 0x7f5b38155bc0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b380c7190 con 0x7f5b38155bc0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.710+0000 7f5b357fa700 1 -- 172.21.15.82:0/2720018424 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00fb20 con 0x7f5b38155bc0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.711+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b380691f0 con 0x7f5b38155bc0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.711+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b380ce540 con 0x7f5b38155bc0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.712+0000 7f5b357fa700 1 -- 172.21.15.82:0/2720018424 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b2c01b070 con 0x7f5b38155bc0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.712+0000 7f5b357fa700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5b24066f30 0x7f5b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.712+0000 7f5b357fa700 1 -- 172.21.15.82:0/2720018424 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f5b2c019070 con 0x7f5b38155bc0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.712+0000 7f5b3d7ce700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5b24066f30 0x7f5b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.713+0000 7f5b3d7ce700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5b24066f30 0x7f5b240693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009db0 tx=0x7f5b30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.716+0000 7f5b357fa700 1 -- 172.21.15.82:0/2720018424 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b2c051650 con 0x7f5b38155bc0 2023-10-06T03:17:40.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.898+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b38064050 con 0x7f5b38155bc0 2023-10-06T03:17:40.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.899+0000 7f5b357fa700 1 -- 172.21.15.82:0/2720018424 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17108 (secure 0 0 0) 0x7f5b2c054c70 con 0x7f5b38155bc0 2023-10-06T03:17:40.901 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:40.901 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":57,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:40.337022+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:17:24.832103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:17:26.150387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.13","mappings":[{"from":1,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.28","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:40.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5b24066f30 msgr2=0x7f5b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5b24066f30 0x7f5b240693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009db0 tx=0x7f5b30008040 comp rx=0 tx=0).stop 2023-10-06T03:17:40.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b38155bc0 msgr2=0x7f5b380c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:40.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b38155bc0 0x7f5b380c5e30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0073c0 tx=0x7f5b380d0570 comp rx=0 tx=0).stop 2023-10-06T03:17:40.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 shutdown_connections 2023-10-06T03:17:40.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f5b24066f30 0x7f5b240693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b380c7990 0x7f5b380c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b381557f0 0x7f5b380c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 --2- 172.21.15.82:0/2720018424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b38155bc0 0x7f5b380c5e30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:40.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.901+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 >> 172.21.15.82:0/2720018424 conn(0x7f5b380d1180 msgr2=0x7f5b380b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:40.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.902+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 shutdown_connections 2023-10-06T03:17:40.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:40.902+0000 7f5b3fa32700 1 -- 172.21.15.82:0/2720018424 wait complete. 2023-10-06T03:17:40.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:17:41.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.028+0000 7fbaa3df9700 1 Processor -- start 2023-10-06T03:17:41.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.029+0000 7fbaa3df9700 1 -- start start 2023-10-06T03:17:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.029+0000 7fbaa3df9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9c1598d0 0x7fba9c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.029+0000 7fbaa3df9700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c15dd20 con 0x7fba9c159500 2023-10-06T03:17:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.029+0000 7fbaa3df9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c0b1110 con 0x7fba9c15d8e0 2023-10-06T03:17:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.029+0000 7fbaa3df9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0b13b0 con 0x7fba9c1598d0 2023-10-06T03:17:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa1b95700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fba9c159500 0x7fba9c0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35936/0 (socket says 172.21.15.82:35936) 2023-10-06T03:17:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa1b95700 1 -- 172.21.15.82:0/3728983058 learned_addr learned my addr 172.21.15.82:0/3728983058 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720607583 0 0) 0x7fba9c15dd20 con 0x7fba9c159500 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba88003570 con 0x7fba9c159500 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa1394700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9c1598d0 0x7fba9c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 343150489 0 0) 0x7fba88003570 con 0x7fba9c159500 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9c1598d0 msgr2=0x7fba9c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9c1598d0 0x7fba9c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 >> v1:172.21.15.134:6789/0 conn(0x7fba9c15d8e0 legacy=0x7fba9c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0b1690 con 0x7fba9c159500 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fba98001470 con 0x7fba9c159500 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 >> v1:172.21.15.82:6789/0 conn(0x7fba9c159500 legacy=0x7fba9c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba88003a90 0x7fba88003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9c1598d0 0x7fba88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba88004d50 0x7fba880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0b13b0 con 0x7fba88003a90 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800bb70 con 0x7fba88004d50 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800bd30 con 0x7fba9c1598d0 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.030+0000 7fbaa1b95700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba88003a90 0x7fba88003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa2396700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba88004d50 0x7fba880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa1394700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9c1598d0 0x7fba88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa1b95700 1 -- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9c1598d0 msgr2=0x7fba88004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa1b95700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba9c1598d0 0x7fba88004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa1b95700 1 -- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba88004d50 msgr2=0x7fba880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa1b95700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba88004d50 0x7fba880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa1b95700 1 -- 172.21.15.82:0/3728983058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88003570 con 0x7fba88003a90 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa2396700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba88004d50 0x7fba880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa1b95700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba88003a90 0x7fba88003ea0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fba9800c390 tx=0x7fba9c0b12a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f88daa6259940f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800cc60 con 0x7fba88003a90 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800cdc0 con 0x7fba88003a90 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa0b93700 1 -- 172.21.15.82:0/3728983058 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98005b70 con 0x7fba88003a90 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa3df9700 1 -- 172.21.15.82:0/3728983058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba88003a90 msgr2=0x7fba88003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa3df9700 1 --2- 172.21.15.82:0/3728983058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba88003a90 0x7fba88003ea0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fba9800c390 tx=0x7fba9c0b12a0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.031+0000 7fbaa2396700 1 -- 172.21.15.82:0/3728983058 reap_dead start 2023-10-06T03:17:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.032+0000 7fbaa3df9700 1 -- 172.21.15.82:0/3728983058 shutdown_connections 2023-10-06T03:17:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.032+0000 7fbaa3df9700 1 -- 172.21.15.82:0/3728983058 >> 172.21.15.82:0/3728983058 conn(0x7fba9c067630 msgr2=0x7fba9c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.032+0000 7fbaa3df9700 1 -- 172.21.15.82:0/3728983058 shutdown_connections 2023-10-06T03:17:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.032+0000 7fbaa3df9700 1 -- 172.21.15.82:0/3728983058 wait complete. 2023-10-06T03:17:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa3df9700 1 Processor -- start 2023-10-06T03:17:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa3df9700 1 -- start start 2023-10-06T03:17:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa3df9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba88003a90 0x7fba9c13b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa3df9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c13bea0 0x7fba9c15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa3df9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c15bca0 0x7fba9c16d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa3df9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c15c110 con 0x7fba9c13bea0 2023-10-06T03:17:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa3df9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c16b630 con 0x7fba9c15bca0 2023-10-06T03:17:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa3df9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c16e380 con 0x7fba88003a90 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa1394700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c13bea0 0x7fba9c15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.033+0000 7fbaa1394700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c13bea0 0x7fba9c15b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40088/0 (socket says 172.21.15.82:40088) 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa1394700 1 -- 172.21.15.82:0/4150326575 learned_addr learned my addr 172.21.15.82:0/4150326575 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa1b95700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba88003a90 0x7fba9c13b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa2396700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c15bca0 0x7fba9c16d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa1394700 1 -- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba88003a90 msgr2=0x7fba9c13b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa1394700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba88003a90 0x7fba9c13b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa1394700 1 -- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c15bca0 msgr2=0x7fba9c16d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa1394700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c15bca0 0x7fba9c16d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa1394700 1 -- 172.21.15.82:0/4150326575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c15c320 con 0x7fba9c13bea0 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa2396700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c15bca0 0x7fba9c16d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa1394700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c13bea0 0x7fba9c15b760 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fba8c011d40 tx=0x7fba8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fba91ffb700 1 -- 172.21.15.82:0/4150326575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00fac0 con 0x7fba9c13bea0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fba91ffb700 1 -- 172.21.15.82:0/4150326575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c00fc20 con 0x7fba9c13bea0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fba91ffb700 1 -- 172.21.15.82:0/4150326575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c014440 con 0x7fba9c13bea0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c15c600 con 0x7fba9c13bea0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.034+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c16dab0 con 0x7fba9c13bea0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.035+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c16b7a0 con 0x7fba9c13bea0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.036+0000 7fba91ffb700 1 -- 172.21.15.82:0/4150326575 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba8c014870 con 0x7fba9c13bea0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.036+0000 7fba91ffb700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba80066f30 0x7fba800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.036+0000 7fba91ffb700 1 -- 172.21.15.82:0/4150326575 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fba8c018030 con 0x7fba9c13bea0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.036+0000 7fbaa1b95700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba80066f30 0x7fba800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.037+0000 7fbaa1b95700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba80066f30 0x7fba800693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fba98007cd0 tx=0x7fba98015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:41.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.040+0000 7fba91ffb700 1 -- 172.21.15.82:0/4150326575 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba8c0521c0 con 0x7fba9c13bea0 2023-10-06T03:17:41.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.265+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fba9c15c7f0 con 0x7fba9c13bea0 2023-10-06T03:17:41.267 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-10-06T03:17:41.266+0000 7fbfe891d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.271+0000 7fba91ffb700 1 -- 172.21.15.82:0/4150326575 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7fba8c0557e0 con 0x7fba9c13bea0 2023-10-06T03:17:41.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba80066f30 msgr2=0x7fba800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba80066f30 0x7fba800693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fba98007cd0 tx=0x7fba98015000 comp rx=0 tx=0).stop 2023-10-06T03:17:41.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c13bea0 msgr2=0x7fba9c15b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c13bea0 0x7fba9c15b760 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fba8c011d40 tx=0x7fba8c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 shutdown_connections 2023-10-06T03:17:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c15bca0 0x7fba9c16d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fba80066f30 0x7fba800693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba88003a90 0x7fba9c13b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 --2- 172.21.15.82:0/4150326575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c13bea0 0x7fba9c15b760 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 >> 172.21.15.82:0/4150326575 conn(0x7fba9c067630 msgr2=0x7fba9c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 shutdown_connections 2023-10-06T03:17:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.273+0000 7fbaa3df9700 1 -- 172.21.15.82:0/4150326575 wait complete. 2023-10-06T03:17:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:17:41.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:17:41.306 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-10-06T03:17:41.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.406+0000 7fcb0c23b700 1 Processor -- start 2023-10-06T03:17:41.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.406+0000 7fcb0c23b700 1 -- start start 2023-10-06T03:17:41.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb0c23b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb041598d0 0x7fcb0415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb0c23b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 0x7fcb040cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb0c23b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0415dd20 con 0x7fcb04159500 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb0c23b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb040b1110 con 0x7fcb041598d0 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb0c23b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040b13b0 con 0x7fcb0415d8e0 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb097d6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb041598d0 0x7fcb0415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb097d6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb041598d0 0x7fcb0415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40116/0 (socket says 172.21.15.82:40116) 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb097d6700 1 -- 172.21.15.82:0/2557426282 learned_addr learned my addr 172.21.15.82:0/2557426282 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb0a7d8700 1 --2- 172.21.15.82:0/2557426282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 0x7fcb040cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb097d6700 1 -- 172.21.15.82:0/2557426282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 msgr2=0x7fcb040cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb097d6700 1 --2- 172.21.15.82:0/2557426282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 0x7fcb040cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb097d6700 1 -- 172.21.15.82:0/2557426282 >> v1:172.21.15.134:6789/0 conn(0x7fcb04159500 legacy=0x7fcb040b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb097d6700 1 -- 172.21.15.82:0/2557426282 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040b1690 con 0x7fcb041598d0 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb097d6700 1 --2- 172.21.15.82:0/2557426282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb0415d3a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40099b0 tx=0x7fcaf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9e999a0e73ec2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb08fd5700 1 -- 172.21.15.82:0/2557426282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400b860 con 0x7fcb041598d0 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb08fd5700 1 -- 172.21.15.82:0/2557426282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf400b9c0 con 0x7fcb041598d0 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.407+0000 7fcb08fd5700 1 -- 172.21.15.82:0/2557426282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400bd60 con 0x7fcb041598d0 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.408+0000 7fcb0c23b700 1 -- 172.21.15.82:0/2557426282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 msgr2=0x7fcb0415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.408+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/2557426282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb0415d3a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40099b0 tx=0x7fcaf4009250 comp rx=0 tx=0).stop 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.408+0000 7fcb0c23b700 1 -- 172.21.15.82:0/2557426282 shutdown_connections 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.408+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/2557426282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 0x7fcb040cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.408+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/2557426282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb0415d3a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.408+0000 7fcb0c23b700 1 -- 172.21.15.82:0/2557426282 >> 172.21.15.82:0/2557426282 conn(0x7fcb04067630 msgr2=0x7fcb04069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:41.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.408+0000 7fcb0c23b700 1 -- 172.21.15.82:0/2557426282 shutdown_connections 2023-10-06T03:17:41.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.408+0000 7fcb0c23b700 1 -- 172.21.15.82:0/2557426282 wait complete. 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.409+0000 7fcb0c23b700 1 Processor -- start 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.409+0000 7fcb0c23b700 1 -- start start 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb0c23b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb04159500 0x7fcb0413d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb0c23b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb041503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb0c23b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 0x7fcb041399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb0c23b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0413c000 con 0x7fcb041598d0 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb0c23b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0413b3f0 con 0x7fcb04159500 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb0c23b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0413b6d0 con 0x7fcb0415d8e0 2023-10-06T03:17:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb041503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb041503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40120/0 (socket says 172.21.15.82:40120) 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 -- 172.21.15.82:0/1098263192 learned_addr learned my addr 172.21.15.82:0/1098263192 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb09fd7700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb04159500 0x7fcb0413d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb0a7d8700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 0x7fcb041399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 -- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 msgr2=0x7fcb041399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 0x7fcb041399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 -- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb04159500 msgr2=0x7fcb0413d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb04159500 0x7fcb0413d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 -- 172.21.15.82:0/1098263192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40094f0 con 0x7fcb041598d0 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.410+0000 7fcb097d6700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb041503c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcb0415e4d0 tx=0x7fcaf4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.411+0000 7fcaf9ffb700 1 -- 172.21.15.82:0/1098263192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011e40 con 0x7fcb041598d0 2023-10-06T03:17:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.411+0000 7fcaf9ffb700 1 -- 172.21.15.82:0/1098263192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4024440 con 0x7fcb041598d0 2023-10-06T03:17:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.411+0000 7fcaf9ffb700 1 -- 172.21.15.82:0/1098263192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4024800 con 0x7fcb041598d0 2023-10-06T03:17:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.411+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0413b9b0 con 0x7fcb041598d0 2023-10-06T03:17:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.411+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb04139f10 con 0x7fcb041598d0 2023-10-06T03:17:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.412+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb04064050 con 0x7fcb041598d0 2023-10-06T03:17:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.412+0000 7fcaf9ffb700 1 -- 172.21.15.82:0/1098263192 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcaf401a420 con 0x7fcb041598d0 2023-10-06T03:17:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.413+0000 7fcaf9ffb700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcae8066f30 0x7fcae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.413+0000 7fcaf9ffb700 1 -- 172.21.15.82:0/1098263192 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6289+0+0 (secure 0 0 0) 0x7fcaf4086530 con 0x7fcb041598d0 2023-10-06T03:17:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.413+0000 7fcb09fd7700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcae8066f30 0x7fcae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.413+0000 7fcb09fd7700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcae8066f30 0x7fcae80693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb00003a80 tx=0x7fcb00007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.417+0000 7fcaf9ffb700 1 -- 172.21.15.82:0/1098263192 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaf4053550 con 0x7fcb041598d0 2023-10-06T03:17:41.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:41.642+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb040b1970 con 0x7fcb041598d0 2023-10-06T03:17:42.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.271+0000 7fcaf9ffb700 1 -- 172.21.15.82:0/1098263192 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcaf4056b70 con 0x7fcb041598d0 2023-10-06T03:17:42.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcae8066f30 msgr2=0x7fcae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:42.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcae8066f30 0x7fcae80693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb00003a80 tx=0x7fcb00007ec0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 msgr2=0x7fcb041503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:42.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb041503c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcb0415e4d0 tx=0x7fcaf4017000 comp rx=0 tx=0).stop 2023-10-06T03:17:42.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 shutdown_connections 2023-10-06T03:17:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcae8066f30 0x7fcae80693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0415d8e0 0x7fcb041399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb04159500 0x7fcb0413d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 --2- 172.21.15.82:0/1098263192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb041598d0 0x7fcb041503c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 >> 172.21.15.82:0/1098263192 conn(0x7fcb04067630 msgr2=0x7fcb0414bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 shutdown_connections 2023-10-06T03:17:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.273+0000 7fcb0c23b700 1 -- 172.21.15.82:0/1098263192 wait complete. 2023-10-06T03:17:42.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:17:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.449+0000 7facb0f18700 1 Processor -- start 2023-10-06T03:17:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.449+0000 7facb0f18700 1 -- start start 2023-10-06T03:17:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facb0f18700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7facac0b55b0 0x7facac0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facb0f18700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7facac0cf800 0x7facac0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facb0f18700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac0cbed0 con 0x7facac0d0f00 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facb0f18700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac159d40 con 0x7facac0b55b0 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facb0f18700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac0cc750 con 0x7facac0cf800 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facaa59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7facac0b55b0 0x7facac0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facaa59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7facac0b55b0 0x7facac0ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40128/0 (socket says 172.21.15.82:40128) 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facaa59c700 1 -- 172.21.15.82:0/808130638 learned_addr learned my addr 172.21.15.82:0/808130638 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7faca9d9b700 1 --2- 172.21.15.82:0/808130638 >> v2:172.21.15.134:3300/0 conn(0x7facac0cf800 0x7facac0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facaa59c700 1 -- 172.21.15.82:0/808130638 >> v2:172.21.15.134:3300/0 conn(0x7facac0cf800 msgr2=0x7facac0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facaa59c700 1 --2- 172.21.15.82:0/808130638 >> v2:172.21.15.134:3300/0 conn(0x7facac0cf800 0x7facac0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facaa59c700 1 -- 172.21.15.82:0/808130638 >> v1:172.21.15.134:6789/0 conn(0x7facac0d0f00 legacy=0x7facac0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facaa59c700 1 -- 172.21.15.82:0/808130638 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0b5ec0 con 0x7facac0b55b0 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7facaa59c700 1 --2- 172.21.15.82:0/808130638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0b55b0 0x7facac0ccbe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7facac0b66a0 tx=0x7fac9c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c7864adb66f2b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7faca959a700 1 -- 172.21.15.82:0/808130638 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c005c10 con 0x7facac0b55b0 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7faca959a700 1 -- 172.21.15.82:0/808130638 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c005d70 con 0x7facac0b55b0 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.450+0000 7faca959a700 1 -- 172.21.15.82:0/808130638 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00b8a0 con 0x7facac0b55b0 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.451+0000 7facb0f18700 1 -- 172.21.15.82:0/808130638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0b55b0 msgr2=0x7facac0ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.451+0000 7facb0f18700 1 --2- 172.21.15.82:0/808130638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0b55b0 0x7facac0ccbe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7facac0b66a0 tx=0x7fac9c009220 comp rx=0 tx=0).stop 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.451+0000 7facb0f18700 1 -- 172.21.15.82:0/808130638 shutdown_connections 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.451+0000 7facb0f18700 1 --2- 172.21.15.82:0/808130638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0b55b0 0x7facac0ccbe0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.451+0000 7facb0f18700 1 --2- 172.21.15.82:0/808130638 >> v2:172.21.15.134:3300/0 conn(0x7facac0cf800 0x7facac0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.451+0000 7facb0f18700 1 -- 172.21.15.82:0/808130638 >> 172.21.15.82:0/808130638 conn(0x7facac08a050 msgr2=0x7facac099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:42.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.451+0000 7facb0f18700 1 -- 172.21.15.82:0/808130638 shutdown_connections 2023-10-06T03:17:42.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.451+0000 7facb0f18700 1 -- 172.21.15.82:0/808130638 wait complete. 2023-10-06T03:17:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.452+0000 7facb0f18700 1 Processor -- start 2023-10-06T03:17:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.452+0000 7facb0f18700 1 -- start start 2023-10-06T03:17:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facb0f18700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facac0b55b0 0x7facac0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facb0f18700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facac0cf800 0x7facac157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facb0f18700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0d0f00 0x7facac0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facb0f18700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac15c4e0 con 0x7facac0d0f00 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facb0f18700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac0b2400 con 0x7facac0b55b0 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facb0f18700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac0b2dd0 con 0x7facac0cf800 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0d0f00 0x7facac0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0d0f00 0x7facac0ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40144/0 (socket says 172.21.15.82:40144) 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 -- 172.21.15.82:0/3319181953 learned_addr learned my addr 172.21.15.82:0/3319181953 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaa59c700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facac0b55b0 0x7facac0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7faca9d9b700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facac0cf800 0x7facac157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 -- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facac0cf800 msgr2=0x7facac157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facac0cf800 0x7facac157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 -- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facac0b55b0 msgr2=0x7facac0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facac0b55b0 0x7facac0b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 -- 172.21.15.82:0/3319181953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c009480 con 0x7facac0d0f00 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.453+0000 7facaad9d700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0d0f00 0x7facac0ce230 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faca400c840 tx=0x7faca4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.454+0000 7fac9a7fc700 1 -- 172.21.15.82:0/3319181953 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4012630 con 0x7facac0d0f00 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.454+0000 7fac9a7fc700 1 -- 172.21.15.82:0/3319181953 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca40127b0 con 0x7facac0d0f00 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.454+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac1576d0 con 0x7facac0d0f00 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.454+0000 7fac9a7fc700 1 -- 172.21.15.82:0/3319181953 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4012b70 con 0x7facac0d0f00 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.454+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac0b1db0 con 0x7facac0d0f00 2023-10-06T03:17:42.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.455+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac0b2570 con 0x7facac0d0f00 2023-10-06T03:17:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.455+0000 7fac9a7fc700 1 -- 172.21.15.82:0/3319181953 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faca401a3a0 con 0x7facac0d0f00 2023-10-06T03:17:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.455+0000 7fac9a7fc700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac8c066f30 0x7fac8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.455+0000 7fac9a7fc700 1 -- 172.21.15.82:0/3319181953 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6289+0+0 (secure 0 0 0) 0x7faca40848a0 con 0x7facac0d0f00 2023-10-06T03:17:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.456+0000 7facaa59c700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac8c066f30 0x7fac8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.456+0000 7facaa59c700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac8c066f30 0x7fac8c0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fac9c007fd0 tx=0x7fac9c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:42.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.459+0000 7fac9a7fc700 1 -- 172.21.15.82:0/3319181953 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faca40518c0 con 0x7facac0d0f00 2023-10-06T03:17:42.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:42.641+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7facac0717c0 con 0x7facac0d0f00 2023-10-06T03:17:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.365+0000 7fac9a7fc700 1 -- 172.21.15.82:0/3319181953 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) v1 ==== 181+0+0 (secure 0 0 0) 0x7faca4054ee0 con 0x7facac0d0f00 2023-10-06T03:17:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac8c066f30 msgr2=0x7fac8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac8c066f30 0x7fac8c0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fac9c007fd0 tx=0x7fac9c016000 comp rx=0 tx=0).stop 2023-10-06T03:17:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0d0f00 msgr2=0x7facac0ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0d0f00 0x7facac0ce230 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faca400c840 tx=0x7faca4001670 comp rx=0 tx=0).stop 2023-10-06T03:17:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 shutdown_connections 2023-10-06T03:17:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facac0d0f00 0x7facac0ce230 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facac0b55b0 0x7facac0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fac8c066f30 0x7fac8c0693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 --2- 172.21.15.82:0/3319181953 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facac0cf800 0x7facac157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 >> 172.21.15.82:0/3319181953 conn(0x7facac08a050 msgr2=0x7facac159290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 shutdown_connections 2023-10-06T03:17:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.369+0000 7facb0f18700 1 -- 172.21.15.82:0/3319181953 wait complete. 2023-10-06T03:17:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:17:43.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:17:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.502+0000 7f67b1dc3700 1 Processor -- start 2023-10-06T03:17:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.502+0000 7f67b1dc3700 1 -- start start 2023-10-06T03:17:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.503+0000 7f67b1dc3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67ac157410 0x7f67ac0b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.503+0000 7f67b1dc3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ac0b2fc0 con 0x7f67ac1577e0 2023-10-06T03:17:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.503+0000 7f67b1dc3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ac0cd320 con 0x7f67ac0ccd60 2023-10-06T03:17:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.503+0000 7f67b1dc3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ac0cd8e0 con 0x7f67ac157410 2023-10-06T03:17:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.503+0000 7f67aaffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f67ac1577e0 0x7f67ac0b1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35950/0 (socket says 172.21.15.82:35950) 2023-10-06T03:17:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.503+0000 7f67ab7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67ac157410 0x7f67ac0b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.503+0000 7f67aaffd700 1 -- 172.21.15.82:0/3920840090 learned_addr learned my addr 172.21.15.82:0/3920840090 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.504+0000 7f67ab7fe700 1 -- 172.21.15.82:0/3920840090 >> v1:172.21.15.134:6789/0 conn(0x7f67ac0ccd60 legacy=0x7f67ac0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.504+0000 7f67ab7fe700 1 -- 172.21.15.82:0/3920840090 >> v1:172.21.15.82:6789/0 conn(0x7f67ac1577e0 legacy=0x7f67ac0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.504+0000 7f67ab7fe700 1 -- 172.21.15.82:0/3920840090 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac0cd600 con 0x7f67ac157410 2023-10-06T03:17:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.504+0000 7f67aa7fc700 1 -- 172.21.15.82:0/3920840090 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018022542 0 0) 0x7f67ac0b2fc0 con 0x7f67ac1577e0 2023-10-06T03:17:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.504+0000 7f67ab7fe700 1 --2- 172.21.15.82:0/3920840090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac157410 0x7f67ac0b16d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f679c009e60 tx=0x7f679c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607be81ccb9958f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.504+0000 7f67aa7fc700 1 -- 172.21.15.82:0/3920840090 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c00e070 con 0x7f67ac157410 2023-10-06T03:17:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.504+0000 7f67aa7fc700 1 -- 172.21.15.82:0/3920840090 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c00bbf0 con 0x7f67ac157410 2023-10-06T03:17:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.504+0000 7f67aa7fc700 1 -- 172.21.15.82:0/3920840090 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c012430 con 0x7f67ac157410 2023-10-06T03:17:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.505+0000 7f67b1dc3700 1 -- 172.21.15.82:0/3920840090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac157410 msgr2=0x7f67ac0b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.505+0000 7f67b1dc3700 1 --2- 172.21.15.82:0/3920840090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac157410 0x7f67ac0b16d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f679c009e60 tx=0x7f679c009780 comp rx=0 tx=0).stop 2023-10-06T03:17:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.505+0000 7f67b1dc3700 1 -- 172.21.15.82:0/3920840090 shutdown_connections 2023-10-06T03:17:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.505+0000 7f67b1dc3700 1 --2- 172.21.15.82:0/3920840090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac157410 0x7f67ac0b16d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.505+0000 7f67b1dc3700 1 -- 172.21.15.82:0/3920840090 >> 172.21.15.82:0/3920840090 conn(0x7f67ac0ce4c0 msgr2=0x7f67ac0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.505+0000 7f67b1dc3700 1 -- 172.21.15.82:0/3920840090 shutdown_connections 2023-10-06T03:17:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.505+0000 7f67b1dc3700 1 -- 172.21.15.82:0/3920840090 wait complete. 2023-10-06T03:17:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.506+0000 7f67b1dc3700 1 Processor -- start 2023-10-06T03:17:43.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.506+0000 7f67b1dc3700 1 -- start start 2023-10-06T03:17:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67b1dc3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0ccd60 0x7f67ac15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67b1dc3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67ac157410 0x7f67ac15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67b1dc3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67ac1577e0 0x7f67ac15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67b1dc3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac15d090 con 0x7f67ac0ccd60 2023-10-06T03:17:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67b1dc3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac15b910 con 0x7f67ac157410 2023-10-06T03:17:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67b1dc3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac15ad00 con 0x7f67ac1577e0 2023-10-06T03:17:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0ccd60 0x7f67ac15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:43.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0ccd60 0x7f67ac15a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40158/0 (socket says 172.21.15.82:40158) 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 -- 172.21.15.82:0/312616165 learned_addr learned my addr 172.21.15.82:0/312616165 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67aaffd700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67ac157410 0x7f67ac15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67abfff700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67ac1577e0 0x7f67ac15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 -- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67ac1577e0 msgr2=0x7f67ac15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67ac1577e0 0x7f67ac15bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 -- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67ac157410 msgr2=0x7f67ac15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67ac157410 0x7f67ac15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 -- 172.21.15.82:0/312616165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c009a20 con 0x7f67ac0ccd60 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67ab7fe700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0ccd60 0x7f67ac15a600 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f679c00b6c0 tx=0x7f679c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67937fe700 1 -- 172.21.15.82:0/312616165 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c012d90 con 0x7f67ac0ccd60 2023-10-06T03:17:43.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67937fe700 1 -- 172.21.15.82:0/312616165 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c021070 con 0x7f67ac0ccd60 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac15afe0 con 0x7f67ac0ccd60 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67937fe700 1 -- 172.21.15.82:0/312616165 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c026680 con 0x7f67ac0ccd60 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.507+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac15b5a0 con 0x7f67ac0ccd60 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.508+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac0717c0 con 0x7f67ac0ccd60 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.509+0000 7f67937fe700 1 -- 172.21.15.82:0/312616165 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f679c023030 con 0x7f67ac0ccd60 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.509+0000 7f67937fe700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6798066f30 0x7f67980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.509+0000 7f67937fe700 1 -- 172.21.15.82:0/312616165 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5822+0+0 (secure 0 0 0) 0x7f679c086700 con 0x7f67ac0ccd60 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.509+0000 7f67aaffd700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6798066f30 0x7f67980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:43.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.510+0000 7f67aaffd700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6798066f30 0x7f67980693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f67ac15e2a0 tx=0x7f67a0007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:43.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.513+0000 7f67937fe700 1 -- 172.21.15.82:0/312616165 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f679c053900 con 0x7f67ac0ccd60 2023-10-06T03:17:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:43.697+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67ac15bbf0 con 0x7f67ac0ccd60 2023-10-06T03:17:44.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.370+0000 7f67937fe700 1 -- 172.21.15.82:0/312616165 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) v1 ==== 169+0+0 (secure 0 0 0) 0x7f679c056f20 con 0x7f67ac0ccd60 2023-10-06T03:17:44.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.373+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6798066f30 msgr2=0x7f67980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.373+0000 7f67b1dc3700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6798066f30 0x7f67980693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f67ac15e2a0 tx=0x7f67a0007d30 comp rx=0 tx=0).stop 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.373+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0ccd60 msgr2=0x7f67ac15a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.373+0000 7f67b1dc3700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0ccd60 0x7f67ac15a600 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f679c00b6c0 tx=0x7f679c018000 comp rx=0 tx=0).stop 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.374+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 shutdown_connections 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.374+0000 7f67b1dc3700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6798066f30 0x7f67980693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.374+0000 7f67b1dc3700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67ac1577e0 0x7f67ac15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.374+0000 7f67b1dc3700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67ac0ccd60 0x7f67ac15a600 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.374+0000 7f67b1dc3700 1 --2- 172.21.15.82:0/312616165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67ac157410 0x7f67ac15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.374+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 >> 172.21.15.82:0/312616165 conn(0x7f67ac0ce4c0 msgr2=0x7f67ac154e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.374+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 shutdown_connections 2023-10-06T03:17:44.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.374+0000 7f67b1dc3700 1 -- 172.21.15.82:0/312616165 wait complete. 2023-10-06T03:17:44.377 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-10-06T03:17:44.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:17:44.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.514+0000 7fc5a30d7700 1 Processor -- start 2023-10-06T03:17:44.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.514+0000 7fc5a30d7700 1 -- start start 2023-10-06T03:17:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a30d7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc59c15de80 0x7fc59c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a30d7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc59c0b61d0 0x7fc59c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a30d7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c069380 con 0x7fc59c142e90 2023-10-06T03:17:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a30d7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c069f20 con 0x7fc59c0b61d0 2023-10-06T03:17:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a30d7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c068770 con 0x7fc59c15de80 2023-10-06T03:17:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a28d6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc59c0b61d0 0x7fc59c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a20d5700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc59c142e90 0x7fc59c069810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35954/0 (socket says 172.21.15.82:35954) 2023-10-06T03:17:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a20d5700 1 -- 172.21.15.82:0/2219673146 learned_addr learned my addr 172.21.15.82:0/2219673146 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a18d4700 1 --2- 172.21.15.82:0/2219673146 >> v2:172.21.15.134:3300/0 conn(0x7fc59c15de80 0x7fc59c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a28d6700 1 -- 172.21.15.82:0/2219673146 >> v2:172.21.15.134:3300/0 conn(0x7fc59c15de80 msgr2=0x7fc59c0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a28d6700 1 --2- 172.21.15.82:0/2219673146 >> v2:172.21.15.134:3300/0 conn(0x7fc59c15de80 0x7fc59c0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a28d6700 1 -- 172.21.15.82:0/2219673146 >> v1:172.21.15.82:6789/0 conn(0x7fc59c142e90 legacy=0x7fc59c069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a28d6700 1 -- 172.21.15.82:0/2219673146 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c068a50 con 0x7fc59c0b61d0 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a10d3700 1 -- 172.21.15.82:0/2219673146 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480046658 0 0) 0x7fc59c069380 con 0x7fc59c142e90 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a18d4700 1 --2- 172.21.15.82:0/2219673146 >> v2:172.21.15.134:3300/0 conn(0x7fc59c15de80 0x7fc59c0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.515+0000 7fc5a28d6700 1 --2- 172.21.15.82:0/2219673146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c0b61d0 0x7fc59c15d290 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc59c06fd30 tx=0x7fc5940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc87cb6a9c98754 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a10d3700 1 -- 172.21.15.82:0/2219673146 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400b6b0 con 0x7fc59c0b61d0 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a10d3700 1 -- 172.21.15.82:0/2219673146 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400b810 con 0x7fc59c0b61d0 2023-10-06T03:17:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a10d3700 1 -- 172.21.15.82:0/2219673146 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400bbb0 con 0x7fc59c0b61d0 2023-10-06T03:17:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2219673146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c0b61d0 msgr2=0x7fc59c15d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2219673146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c0b61d0 0x7fc59c15d290 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc59c06fd30 tx=0x7fc5940091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2219673146 shutdown_connections 2023-10-06T03:17:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2219673146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c0b61d0 0x7fc59c15d290 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2219673146 >> v2:172.21.15.134:3300/0 conn(0x7fc59c15de80 0x7fc59c0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2219673146 >> 172.21.15.82:0/2219673146 conn(0x7fc59c0ccfe0 msgr2=0x7fc59c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2219673146 shutdown_connections 2023-10-06T03:17:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.516+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2219673146 wait complete. 2023-10-06T03:17:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.517+0000 7fc5a30d7700 1 Processor -- start 2023-10-06T03:17:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.517+0000 7fc5a30d7700 1 -- start start 2023-10-06T03:17:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a30d7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c0b61d0 0x7fc59c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a30d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c142e90 0x7fc59c0c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a30d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c15de80 0x7fc59c1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a30d7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0c5ec0 con 0x7fc59c142e90 2023-10-06T03:17:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a30d7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0c60f0 con 0x7fc59c15de80 2023-10-06T03:17:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a30d7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0c63d0 con 0x7fc59c0b61d0 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a18d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c142e90 0x7fc59c0c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a18d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c142e90 0x7fc59c0c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40174/0 (socket says 172.21.15.82:40174) 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a18d4700 1 -- 172.21.15.82:0/2828049563 learned_addr learned my addr 172.21.15.82:0/2828049563 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a28d6700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c15de80 0x7fc59c1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a20d5700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c0b61d0 0x7fc59c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a18d4700 1 -- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c0b61d0 msgr2=0x7fc59c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a18d4700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c0b61d0 0x7fc59c15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a18d4700 1 -- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c15de80 msgr2=0x7fc59c1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a18d4700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c15de80 0x7fc59c1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a18d4700 1 -- 172.21.15.82:0/2828049563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594009420 con 0x7fc59c142e90 2023-10-06T03:17:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.518+0000 7fc5a28d6700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c15de80 0x7fc59c1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.519+0000 7fc5a18d4700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c142e90 0x7fc59c0c5980 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c880 tx=0x7fc590008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.519+0000 7fc59a7fc700 1 -- 172.21.15.82:0/2828049563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590011600 con 0x7fc59c142e90 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.519+0000 7fc59a7fc700 1 -- 172.21.15.82:0/2828049563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590011760 con 0x7fc59c142e90 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.519+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c0c66b0 con 0x7fc59c142e90 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.519+0000 7fc59a7fc700 1 -- 172.21.15.82:0/2828049563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590011b20 con 0x7fc59c142e90 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.519+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c0c6c70 con 0x7fc59c142e90 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.520+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c169c20 con 0x7fc59c142e90 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.520+0000 7fc59a7fc700 1 -- 172.21.15.82:0/2828049563 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5900193b0 con 0x7fc59c142e90 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.520+0000 7fc59a7fc700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.521+0000 7fc59a7fc700 1 -- 172.21.15.82:0/2828049563 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc5900843f0 con 0x7fc59c142e90 2023-10-06T03:17:44.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.521+0000 7fc5a20d5700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.521+0000 7fc5a20d5700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc588066f30 0x7fc5880693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc58c001560 tx=0x7fc58c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.525+0000 7fc59a7fc700 1 -- 172.21.15.82:0/2828049563 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc59c169c20 con 0x7fc59c142e90 2023-10-06T03:17:44.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.706+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc59c169c20 con 0x7fc59c142e90 2023-10-06T03:17:44.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.709+0000 7fc59a7fc700 1 -- 172.21.15.82:0/2828049563 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc59c169c20 con 0x7fc59c142e90 2023-10-06T03:17:44.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.711+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc588066f30 msgr2=0x7fc5880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.711+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc588066f30 0x7fc5880693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc58c001560 tx=0x7fc58c009040 comp rx=0 tx=0).stop 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.711+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c142e90 msgr2=0x7fc59c0c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.711+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c142e90 0x7fc59c0c5980 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c880 tx=0x7fc590008040 comp rx=0 tx=0).stop 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.711+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 shutdown_connections 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.711+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c15de80 0x7fc59c1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.711+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.711+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c0b61d0 0x7fc59c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.712+0000 7fc5a30d7700 1 --2- 172.21.15.82:0/2828049563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc59c142e90 0x7fc59c0c5980 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.712+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 >> 172.21.15.82:0/2828049563 conn(0x7fc59c0ccfe0 msgr2=0x7fc59c1407c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.712+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 shutdown_connections 2023-10-06T03:17:44.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.712+0000 7fc5a30d7700 1 -- 172.21.15.82:0/2828049563 wait complete. 2023-10-06T03:17:44.725 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write' 2023-10-06T03:17:44.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.837+0000 7fb99cc2b700 1 Processor -- start 2023-10-06T03:17:44.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.837+0000 7fb99cc2b700 1 -- start start 2023-10-06T03:17:44.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99cc2b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb99815d930 0x7fb9980d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99cc2b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9981591b0 0x7fb998159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99cc2b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9980b2ad0 con 0x7fb99815d560 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99cc2b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980b4160 con 0x7fb99815d930 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99cc2b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb998159b70 con 0x7fb9981591b0 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb995d9b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb99815d930 0x7fb9980d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb996d9d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9981591b0 0x7fb998159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99659c700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb99815d560 0x7fb9980b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:47412/0 (socket says 172.21.15.82:47412) 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99659c700 1 -- 172.21.15.82:0/1859127419 learned_addr learned my addr 172.21.15.82:0/1859127419 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99559a700 1 -- 172.21.15.82:0/1859127419 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582357349 0 0) 0x7fb9980b2ad0 con 0x7fb99815d560 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb99559a700 1 -- 172.21.15.82:0/1859127419 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb984003570 con 0x7fb99815d560 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb996d9d700 1 -- 172.21.15.82:0/1859127419 >> v2:172.21.15.134:3300/0 conn(0x7fb99815d930 msgr2=0x7fb9980d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb996d9d700 1 --2- 172.21.15.82:0/1859127419 >> v2:172.21.15.134:3300/0 conn(0x7fb99815d930 0x7fb9980d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb996d9d700 1 -- 172.21.15.82:0/1859127419 >> v1:172.21.15.134:6789/0 conn(0x7fb99815d560 legacy=0x7fb9980b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb996d9d700 1 -- 172.21.15.82:0/1859127419 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980b2230 con 0x7fb9981591b0 2023-10-06T03:17:44.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.838+0000 7fb995d9b700 1 --2- 172.21.15.82:0/1859127419 >> v2:172.21.15.134:3300/0 conn(0x7fb99815d930 0x7fb9980d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:44.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb996d9d700 1 --2- 172.21.15.82:0/1859127419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9981591b0 0x7fb998159630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb9880098e0 tx=0x7fb9880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56ff04b92523a9f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:44.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99559a700 1 -- 172.21.15.82:0/1859127419 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988011630 con 0x7fb9981591b0 2023-10-06T03:17:44.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99559a700 1 -- 172.21.15.82:0/1859127419 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988011790 con 0x7fb9981591b0 2023-10-06T03:17:44.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99559a700 1 -- 172.21.15.82:0/1859127419 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988011b10 con 0x7fb9981591b0 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99cc2b700 1 -- 172.21.15.82:0/1859127419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9981591b0 msgr2=0x7fb998159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/1859127419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9981591b0 0x7fb998159630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb9880098e0 tx=0x7fb9880091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99cc2b700 1 -- 172.21.15.82:0/1859127419 shutdown_connections 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/1859127419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9981591b0 0x7fb998159630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/1859127419 >> v2:172.21.15.134:3300/0 conn(0x7fb99815d930 0x7fb9980d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99cc2b700 1 -- 172.21.15.82:0/1859127419 >> 172.21.15.82:0/1859127419 conn(0x7fb9980d1180 msgr2=0x7fb998069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99cc2b700 1 -- 172.21.15.82:0/1859127419 shutdown_connections 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.839+0000 7fb99cc2b700 1 -- 172.21.15.82:0/1859127419 wait complete. 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99cc2b700 1 Processor -- start 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99cc2b700 1 -- start start 2023-10-06T03:17:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99cc2b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9981591b0 0x7fb9980a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99cc2b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb99815d560 0x7fb9980acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99cc2b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb99815d930 0x7fb998143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99cc2b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980adde0 con 0x7fb9981591b0 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99cc2b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981441d0 con 0x7fb99815d560 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99cc2b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980ad1d0 con 0x7fb99815d930 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9981591b0 0x7fb9980a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9981591b0 0x7fb9980a8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40176/0 (socket says 172.21.15.82:40176) 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.841+0000 7fb99659c700 1 -- 172.21.15.82:0/361420584 learned_addr learned my addr 172.21.15.82:0/361420584 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb995d9b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb99815d560 0x7fb9980acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb996d9d700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb99815d930 0x7fb998143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb99659c700 1 -- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb99815d930 msgr2=0x7fb998143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb99659c700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb99815d930 0x7fb998143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb99659c700 1 -- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb99815d560 msgr2=0x7fb9980acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb99659c700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb99815d560 0x7fb9980acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb99659c700 1 -- 172.21.15.82:0/361420584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980009420 con 0x7fb9981591b0 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb995d9b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb99815d560 0x7fb9980acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb99659c700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9981591b0 0x7fb9980a8150 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb99000cd00 tx=0x7fb990001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb98e7fc700 1 -- 172.21.15.82:0/361420584 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000ab10 con 0x7fb9981591b0 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb98e7fc700 1 -- 172.21.15.82:0/361420584 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99000ac70 con 0x7fb9981591b0 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb988009420 con 0x7fb9981591b0 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb98e7fc700 1 -- 172.21.15.82:0/361420584 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900070f0 con 0x7fb9981591b0 2023-10-06T03:17:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.842+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9980ad790 con 0x7fb9981591b0 2023-10-06T03:17:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.843+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb998064050 con 0x7fb9981591b0 2023-10-06T03:17:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.843+0000 7fb98e7fc700 1 -- 172.21.15.82:0/361420584 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9900074a0 con 0x7fb9981591b0 2023-10-06T03:17:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.844+0000 7fb98e7fc700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb978066f30 0x7fb9780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.844+0000 7fb98e7fc700 1 -- 172.21.15.82:0/361420584 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb990084940 con 0x7fb9981591b0 2023-10-06T03:17:44.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.844+0000 7fb995d9b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb978066f30 0x7fb9780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:44.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.844+0000 7fb995d9b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb978066f30 0x7fb9780693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb9800093f0 tx=0x7fb980008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:44.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:44.848+0000 7fb98e7fc700 1 -- 172.21.15.82:0/361420584 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb990051d50 con 0x7fb9981591b0 2023-10-06T03:17:45.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.105+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]} v 0) v1 -- 0x7fb9980b2510 con 0x7fb9981591b0 2023-10-06T03:17:45.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.371+0000 7fb98e7fc700 1 -- 172.21.15.82:0/361420584 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]}]=0 v128) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb990055370 con 0x7fb9981591b0 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb978066f30 msgr2=0x7fb9780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb978066f30 0x7fb9780693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb9800093f0 tx=0x7fb980008040 comp rx=0 tx=0).stop 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9981591b0 msgr2=0x7fb9980a8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9981591b0 0x7fb9980a8150 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb99000cd00 tx=0x7fb990001b00 comp rx=0 tx=0).stop 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 shutdown_connections 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb978066f30 0x7fb9780693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb99815d930 0x7fb998143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9981591b0 0x7fb9980a8150 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 --2- 172.21.15.82:0/361420584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb99815d560 0x7fb9980acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 >> 172.21.15.82:0/361420584 conn(0x7fb9980d1180 msgr2=0x7fb9981562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 shutdown_connections 2023-10-06T03:17:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:45.374+0000 7fb99cc2b700 1 -- 172.21.15.82:0/361420584 wait complete. 2023-10-06T03:17:45.388 INFO:tasks.cephfs_test_runner:That when a client modifies the quota on a directory used ... ok 2023-10-06T03:17:45.388 INFO:tasks.cephfs_test_runner: 2023-10-06T03:17:45.388 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T03:17:45.388 INFO:tasks.cephfs_test_runner:Ran 3 tests in 84.559s 2023-10-06T03:17:45.389 INFO:tasks.cephfs_test_runner: 2023-10-06T03:17:45.389 INFO:tasks.cephfs_test_runner:OK 2023-10-06T03:17:45.389 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T03:17:45.400 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T03:17:45.414 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T03:17:45.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.415 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:17:45.429 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:17:45.430 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:17:45.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.430 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:17:45.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.504 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:17:45.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-10-06T03:17:45.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.680 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-10-06T03:17:45.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.695 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-10-06T03:17:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-10-06T03:17:45.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:17:45.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.764 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:17:45.782 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:17:45.783 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:17:45.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.783 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:17:45.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:17:45.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:45.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2023-10-06T03:17:46.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:46.043 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-10-06T03:17:46.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:17:46.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2023-10-06T03:17:46.127 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2023-10-06T03:17:46.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:17:46.128 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T03:17:46.136 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T03:17:46.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:46.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.250+0000 7f239d031700 1 Processor -- start 2023-10-06T03:17:46.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.250+0000 7f239d031700 1 -- start start 2023-10-06T03:17:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f239d031700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2398156680 0x7f23980ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f239d031700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23980c8310 0x7f23980ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f239d031700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23980c1110 con 0x7f23981562b0 2023-10-06T03:17:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f239d031700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239806eb90 con 0x7f2398156680 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f239d031700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239806ee60 con 0x7f23980c8310 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f23977fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2398156680 0x7f23980ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f2397fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f23981562b0 0x7f239806e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35958/0 (socket says 172.21.15.82:35958) 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f2397fff700 1 -- 172.21.15.82:0/212315925 learned_addr learned my addr 172.21.15.82:0/212315925 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f239c830700 1 --2- 172.21.15.82:0/212315925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23980c8310 0x7f23980ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f23977fe700 1 -- 172.21.15.82:0/212315925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23980c8310 msgr2=0x7f23980ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f2396ffd700 1 -- 172.21.15.82:0/212315925 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121601583 0 0) 0x7f23980c1110 con 0x7f23981562b0 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f23977fe700 1 --2- 172.21.15.82:0/212315925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23980c8310 0x7f23980ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f23977fe700 1 -- 172.21.15.82:0/212315925 >> v1:172.21.15.82:6789/0 conn(0x7f23981562b0 legacy=0x7f239806e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f23977fe700 1 -- 172.21.15.82:0/212315925 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239806f140 con 0x7f2398156680 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f239c830700 1 --2- 172.21.15.82:0/212315925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23980c8310 0x7f23980ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.251+0000 7f23977fe700 1 --2- 172.21.15.82:0/212315925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2398156680 0x7f23980ae040 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f238c0098e0 tx=0x7f238c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ee6bf76c2b363e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f2396ffd700 1 -- 172.21.15.82:0/212315925 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c009e80 con 0x7f2398156680 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f2396ffd700 1 -- 172.21.15.82:0/212315925 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00b860 con 0x7f2398156680 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f2396ffd700 1 -- 172.21.15.82:0/212315925 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00bbe0 con 0x7f2398156680 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f239d031700 1 -- 172.21.15.82:0/212315925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2398156680 msgr2=0x7f23980ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f239d031700 1 --2- 172.21.15.82:0/212315925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2398156680 0x7f23980ae040 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f238c0098e0 tx=0x7f238c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f239d031700 1 -- 172.21.15.82:0/212315925 shutdown_connections 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f239d031700 1 --2- 172.21.15.82:0/212315925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23980c8310 0x7f23980ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f239d031700 1 --2- 172.21.15.82:0/212315925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2398156680 0x7f23980ae040 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f239d031700 1 -- 172.21.15.82:0/212315925 >> 172.21.15.82:0/212315925 conn(0x7f23980c95d0 msgr2=0x7f2398067630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f239d031700 1 -- 172.21.15.82:0/212315925 shutdown_connections 2023-10-06T03:17:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.252+0000 7f239d031700 1 -- 172.21.15.82:0/212315925 wait complete. 2023-10-06T03:17:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.253+0000 7f239d031700 1 Processor -- start 2023-10-06T03:17:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f239d031700 1 -- start start 2023-10-06T03:17:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f239d031700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23980c8310 0x7f239815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f239d031700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23981562b0 0x7f239815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f239d031700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2398156680 0x7f239816a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f239d031700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239815bf40 con 0x7f23980c8310 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f239d031700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239815aea0 con 0x7f23981562b0 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f239d031700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239815b180 con 0x7f2398156680 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f2397fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23980c8310 0x7f239815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f2397fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23980c8310 0x7f239815d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40198/0 (socket says 172.21.15.82:40198) 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.254+0000 7f2397fff700 1 -- 172.21.15.82:0/2203219830 learned_addr learned my addr 172.21.15.82:0/2203219830 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f239c830700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2398156680 0x7f239816a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f23977fe700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23981562b0 0x7f239815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f2397fff700 1 -- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2398156680 msgr2=0x7f239816a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f2397fff700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2398156680 0x7f239816a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f2397fff700 1 -- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23981562b0 msgr2=0x7f239815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f2397fff700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23981562b0 0x7f239815a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f2397fff700 1 -- 172.21.15.82:0/2203219830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c009420 con 0x7f23980c8310 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f23977fe700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23981562b0 0x7f239815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f2397fff700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23980c8310 0x7f239815d7f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f238800c7e0 tx=0x7f2388007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f237ffff700 1 -- 172.21.15.82:0/2203219830 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388005b30 con 0x7f23980c8310 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f237ffff700 1 -- 172.21.15.82:0/2203219830 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388005c90 con 0x7f23980c8310 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239815b460 con 0x7f23980c8310 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f237ffff700 1 -- 172.21.15.82:0/2203219830 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388007300 con 0x7f23980c8310 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.255+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239815baa0 con 0x7f23980c8310 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.256+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239815bc30 con 0x7f23980c8310 2023-10-06T03:17:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.256+0000 7f237ffff700 1 -- 172.21.15.82:0/2203219830 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2388007670 con 0x7f23980c8310 2023-10-06T03:17:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.257+0000 7f237ffff700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2384066f30 0x7f23840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.257+0000 7f237ffff700 1 -- 172.21.15.82:0/2203219830 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2388083910 con 0x7f23980c8310 2023-10-06T03:17:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.257+0000 7f23977fe700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2384066f30 0x7f23840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.257+0000 7f23977fe700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2384066f30 0x7f23840693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f238c0091e0 tx=0x7f238c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.261+0000 7f237ffff700 1 -- 172.21.15.82:0/2203219830 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2388050d20 con 0x7f23980c8310 2023-10-06T03:17:46.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.446+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f239815abf0 con 0x7f23980c8310 2023-10-06T03:17:46.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.447+0000 7f237ffff700 1 -- 172.21.15.82:0/2203219830 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13778 (secure 0 0 0) 0x7f2388017020 con 0x7f23980c8310 2023-10-06T03:17:46.448 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:46.449 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":60,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:44.365474+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6835/598797511":"2023-10-07T03:17:41.267435+0000","172.21.15.82:6833/598797511":"2023-10-07T03:17:41.267435+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2384066f30 msgr2=0x7f23840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2384066f30 0x7f23840693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f238c0091e0 tx=0x7f238c017000 comp rx=0 tx=0).stop 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23980c8310 msgr2=0x7f239815d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23980c8310 0x7f239815d7f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f238800c7e0 tx=0x7f2388007df0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 shutdown_connections 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2384066f30 0x7f23840693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2398156680 0x7f239816a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23980c8310 0x7f239815d7f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 --2- 172.21.15.82:0/2203219830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23981562b0 0x7f239815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 >> 172.21.15.82:0/2203219830 conn(0x7f23980c95d0 msgr2=0x7f239806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:46.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 shutdown_connections 2023-10-06T03:17:46.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.449+0000 7f239d031700 1 -- 172.21.15.82:0/2203219830 wait complete. 2023-10-06T03:17:46.463 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:17:46.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:17:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.575+0000 7f6bb8dee700 1 Processor -- start 2023-10-06T03:17:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.576+0000 7f6bb8dee700 1 -- start start 2023-10-06T03:17:46.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.576+0000 7f6bb8dee700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6bb40cdc00 0x7f6bb40cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.576+0000 7f6bb8dee700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6bb40d1030 0x7f6bb40c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.576+0000 7f6bb8dee700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40ae140 con 0x7f6bb40c6bf0 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.576+0000 7f6bb8dee700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb40cc390 con 0x7f6bb40d1030 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.576+0000 7f6bb8dee700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb40c7020 con 0x7f6bb40cdc00 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.576+0000 7f6ba9d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6bb40d1030 0x7f6bb40c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.576+0000 7f6bb2d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6bb40c6bf0 0x7f6bb40ae5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35974/0 (socket says 172.21.15.82:35974) 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6bb2d9d700 1 -- 172.21.15.82:0/296735406 learned_addr learned my addr 172.21.15.82:0/296735406 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6bb259c700 1 --2- 172.21.15.82:0/296735406 >> v2:172.21.15.134:3300/0 conn(0x7f6bb40cdc00 0x7f6bb40cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6ba9d9b700 1 -- 172.21.15.82:0/296735406 >> v2:172.21.15.134:3300/0 conn(0x7f6bb40cdc00 msgr2=0x7f6bb40cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6ba9d9b700 1 --2- 172.21.15.82:0/296735406 >> v2:172.21.15.134:3300/0 conn(0x7f6bb40cdc00 0x7f6bb40cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6ba9d9b700 1 -- 172.21.15.82:0/296735406 >> v1:172.21.15.82:6789/0 conn(0x7f6bb40c6bf0 legacy=0x7f6bb40ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6ba9d9b700 1 -- 172.21.15.82:0/296735406 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40ad530 con 0x7f6bb40d1030 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6bb1d9b700 1 -- 172.21.15.82:0/296735406 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51565001 0 0) 0x7f6bb40ae140 con 0x7f6bb40c6bf0 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6ba9d9b700 1 --2- 172.21.15.82:0/296735406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb40c66b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4088f20 tx=0x7f6b9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e53048f9f571d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6bb1d9b700 1 -- 172.21.15.82:0/296735406 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c011630 con 0x7f6bb40d1030 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6bb1d9b700 1 -- 172.21.15.82:0/296735406 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c011790 con 0x7f6bb40d1030 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.577+0000 7f6bb1d9b700 1 -- 172.21.15.82:0/296735406 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c011b30 con 0x7f6bb40d1030 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.578+0000 7f6bb8dee700 1 -- 172.21.15.82:0/296735406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 msgr2=0x7f6bb40c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.578+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/296735406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb40c66b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4088f20 tx=0x7f6b9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.578+0000 7f6bb8dee700 1 -- 172.21.15.82:0/296735406 shutdown_connections 2023-10-06T03:17:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.578+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/296735406 >> v2:172.21.15.134:3300/0 conn(0x7f6bb40cdc00 0x7f6bb40cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.578+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/296735406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb40c66b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.578+0000 7f6bb8dee700 1 -- 172.21.15.82:0/296735406 >> 172.21.15.82:0/296735406 conn(0x7f6bb4099990 msgr2=0x7f6bb40b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.578+0000 7f6bb8dee700 1 -- 172.21.15.82:0/296735406 shutdown_connections 2023-10-06T03:17:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.578+0000 7f6bb8dee700 1 -- 172.21.15.82:0/296735406 wait complete. 2023-10-06T03:17:46.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.579+0000 7f6bb8dee700 1 Processor -- start 2023-10-06T03:17:46.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.579+0000 7f6bb8dee700 1 -- start start 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb8dee700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bb40c6bf0 0x7f6bb4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb8dee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bb40cdc00 0x7f6bb4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb8dee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb4069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb8dee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb41589d0 con 0x7f6bb40d1030 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb8dee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40692b0 con 0x7f6bb40cdc00 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb8dee700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4068e20 con 0x7f6bb40c6bf0 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb4069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb4069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40220/0 (socket says 172.21.15.82:40220) 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 -- 172.21.15.82:0/2795376617 learned_addr learned my addr 172.21.15.82:0/2795376617 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb259c700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bb40c6bf0 0x7f6bb4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6ba9d9b700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bb40cdc00 0x7f6bb4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 -- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bb40c6bf0 msgr2=0x7f6bb4067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bb40c6bf0 0x7f6bb4067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 -- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bb40cdc00 msgr2=0x7f6bb4067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bb40cdc00 0x7f6bb4067b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 -- 172.21.15.82:0/2795376617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009420 con 0x7f6bb40d1030 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb2d9d700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb4069850 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00cc90 tx=0x7f6bac001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6baaffd700 1 -- 172.21.15.82:0/2795376617 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00a870 con 0x7f6bb40d1030 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6baaffd700 1 -- 172.21.15.82:0/2795376617 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac00a9d0 con 0x7f6bb40d1030 2023-10-06T03:17:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb4068210 con 0x7f6bb40d1030 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6baaffd700 1 -- 172.21.15.82:0/2795376617 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00ad90 con 0x7f6bb40d1030 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.580+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb40687d0 con 0x7f6bb40d1030 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.581+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb4064050 con 0x7f6bb40d1030 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.582+0000 7f6baaffd700 1 -- 172.21.15.82:0/2795376617 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bac007300 con 0x7f6bb40d1030 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.582+0000 7f6baaffd700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6b94066f30 0x7f6b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.582+0000 7f6baaffd700 1 -- 172.21.15.82:0/2795376617 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6bac0846e0 con 0x7f6bb40d1030 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.582+0000 7f6bb259c700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6b94066f30 0x7f6b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.583+0000 7f6bb259c700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6b94066f30 0x7f6b940693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009da0 tx=0x7f6ba4009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.586+0000 7f6baaffd700 1 -- 172.21.15.82:0/2795376617 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bac051af0 con 0x7f6bb40d1030 2023-10-06T03:17:46.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.764+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bb4158bf0 con 0x7f6b94066f30 2023-10-06T03:17:46.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.768+0000 7f6baaffd700 1 -- 172.21.15.82:0/2795376617 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73231 (secure 0 0 0) 0x7f6bb4158bf0 con 0x7f6b94066f30 2023-10-06T03:17:46.770 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:46.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6b94066f30 msgr2=0x7f6b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6b94066f30 0x7f6b940693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009da0 tx=0x7f6ba4009120 comp rx=0 tx=0).stop 2023-10-06T03:17:46.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 msgr2=0x7f6bb4069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb4069850 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00cc90 tx=0x7f6bac001a20 comp rx=0 tx=0).stop 2023-10-06T03:17:46.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 shutdown_connections 2023-10-06T03:17:46.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb40d1030 0x7f6bb4069850 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6b94066f30 0x7f6b940693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bb40c6bf0 0x7f6bb4067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 --2- 172.21.15.82:0/2795376617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bb40cdc00 0x7f6bb4067b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 >> 172.21.15.82:0/2795376617 conn(0x7f6bb4099990 msgr2=0x7f6bb40cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:46.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 shutdown_connections 2023-10-06T03:17:46.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.769+0000 7f6bb8dee700 1 -- 172.21.15.82:0/2795376617 wait complete. 2023-10-06T03:17:46.772 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:17:46.783 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-10-06T03:17:45.175231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430520,"kb_used_data":52216,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752544200,"statfs":{"total":773094113280,"available":770605260800,"internally_reserved":0,"allocated":53469184,"data_stored":50103488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23375051,"num_objects":-48,"num_object_clones":0,"num_object_copies":-96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-165,"num_write_kb":-43408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.836298"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.273004+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:17:41.273004+0000","last_peered":"2023-10-06T03:17:41.273004+0000","last_clean":"2023-10-06T03:17:41.273004+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:41.273004+0000","last_undegraded":"2023-10-06T03:17:41.273004+0000","last_fullsized":"2023-10-06T03:17:41.273004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099756+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:17:42.099756+0000","last_peered":"2023-10-06T03:17:42.099756+0000","last_clean":"2023-10-06T03:17:42.099756+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:42.099756+0000","last_undegraded":"2023-10-06T03:17:42.099756+0000","last_fullsized":"2023-10-06T03:17:42.099756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099696+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:17:42.099696+0000","last_peered":"2023-10-06T03:17:42.099696+0000","last_clean":"2023-10-06T03:17:42.099696+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:42.099696+0000","last_undegraded":"2023-10-06T03:17:42.099696+0000","last_fullsized":"2023-10-06T03:17:42.099696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":195,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.420912+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:17:41.420912+0000","last_peered":"2023-10-06T03:17:41.420912+0000","last_clean":"2023-10-06T03:17:41.420912+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:17:41.420912+0000","last_undegraded":"2023-10-06T03:17:41.420912+0000","last_fullsized":"2023-10-06T03:17:41.420912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.421533+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:17:41.421533+0000","last_peered":"2023-10-06T03:17:41.421533+0000","last_clean":"2023-10-06T03:17:41.421533+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:41.421533+0000","last_undegraded":"2023-10-06T03:17:41.421533+0000","last_fullsized":"2023-10-06T03:17:41.421533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.421002+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:17:41.421002+0000","last_peered":"2023-10-06T03:17:41.421002+0000","last_clean":"2023-10-06T03:17:41.421002+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:41.421002+0000","last_undegraded":"2023-10-06T03:17:41.421002+0000","last_fullsized":"2023-10-06T03:17:41.421002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099339+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:17:42.099339+0000","last_peered":"2023-10-06T03:17:42.099339+0000","last_clean":"2023-10-06T03:17:42.099339+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:42.099339+0000","last_undegraded":"2023-10-06T03:17:42.099339+0000","last_fullsized":"2023-10-06T03:17:42.099339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.272991+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:17:41.272991+0000","last_peered":"2023-10-06T03:17:41.272991+0000","last_clean":"2023-10-06T03:17:41.272991+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:41.272991+0000","last_undegraded":"2023-10-06T03:17:41.272991+0000","last_fullsized":"2023-10-06T03:17:41.272991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.272320+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:17:41.272320+0000","last_peered":"2023-10-06T03:17:41.272320+0000","last_clean":"2023-10-06T03:17:41.272320+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:41.272320+0000","last_undegraded":"2023-10-06T03:17:41.272320+0000","last_fullsized":"2023-10-06T03:17:41.272320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306764,"kb_used_data":9476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065076,"statfs":{"total":96636764160,"available":96322637824,"internally_reserved":0,"allocated":9703424,"data_stored":9289973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304132,"kb_used_data":6844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067708,"statfs":{"total":96636764160,"available":96325332992,"internally_reserved":0,"allocated":7008256,"data_stored":6602450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.66900000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.627},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.50800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298896,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072944,"statfs":{"total":96636764160,"available":96330694656,"internally_reserved":0,"allocated":1646592,"data_stored":1202559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.20799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.222},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.23899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.315},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.503}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.442},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":4828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":4943872,"data_stored":4505310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.433},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306204,"kb_used_data":8916,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065636,"statfs":{"total":96636764160,"available":96323211264,"internally_reserved":0,"allocated":9129984,"data_stored":8699610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.308},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.27200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.214},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.253}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":4780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":4894720,"data_stored":4498820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.6960000000000002,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.247}]},{"osd":2,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304148,"kb_used_data":6860,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067692,"statfs":{"total":96636764160,"available":96325316608,"internally_reserved":0,"allocated":7024640,"data_stored":6603808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.53500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306192,"kb_used_data":8904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065648,"statfs":{"total":96636764160,"available":96323223552,"internally_reserved":0,"allocated":9117696,"data_stored":8700958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.433}]},{"osd":1,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:17:46.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:17:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.897+0000 7fd006f5d700 1 Processor -- start 2023-10-06T03:17:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.897+0000 7fd006f5d700 1 -- start start 2023-10-06T03:17:46.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fd006f5d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d560 0x7fd0000d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fd006f5d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd00015d930 0x7fd0000b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fd006f5d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0000b2ad0 con 0x7fd0001591b0 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fd006f5d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000b4160 con 0x7fd00015d930 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fd006f5d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000b1f80 con 0x7fd00015d560 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fcff7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd00015d930 0x7fd0000b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fd0054fa700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd0001591b0 0x7fd000159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35978/0 (socket says 172.21.15.82:35978) 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fd0054fa700 1 -- 172.21.15.82:0/1654830431 learned_addr learned my addr 172.21.15.82:0/1654830431 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.898+0000 7fd004cf9700 1 --2- 172.21.15.82:0/1654830431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d560 0x7fd0000d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff7fff700 1 -- 172.21.15.82:0/1654830431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d560 msgr2=0x7fd0000d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff7fff700 1 --2- 172.21.15.82:0/1654830431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d560 0x7fd0000d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff7fff700 1 -- 172.21.15.82:0/1654830431 >> v1:172.21.15.82:6789/0 conn(0x7fd0001591b0 legacy=0x7fd000159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff7fff700 1 -- 172.21.15.82:0/1654830431 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000b2230 con 0x7fd00015d930 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff77fe700 1 -- 172.21.15.82:0/1654830431 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176309142 0 0) 0x7fd0000b2ad0 con 0x7fd0001591b0 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff7fff700 1 --2- 172.21.15.82:0/1654830431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00015d930 0x7fd0000b1a40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcff00098e0 tx=0x7fcff00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0e76fc5918719 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff77fe700 1 -- 172.21.15.82:0/1654830431 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0009e80 con 0x7fd00015d930 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff77fe700 1 -- 172.21.15.82:0/1654830431 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000b860 con 0x7fd00015d930 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fcff77fe700 1 -- 172.21.15.82:0/1654830431 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000bbe0 con 0x7fd00015d930 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fd006f5d700 1 -- 172.21.15.82:0/1654830431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00015d930 msgr2=0x7fd0000b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fd006f5d700 1 --2- 172.21.15.82:0/1654830431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00015d930 0x7fd0000b1a40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcff00098e0 tx=0x7fcff00091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fd006f5d700 1 -- 172.21.15.82:0/1654830431 shutdown_connections 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fd006f5d700 1 --2- 172.21.15.82:0/1654830431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d560 0x7fd0000d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fd006f5d700 1 --2- 172.21.15.82:0/1654830431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00015d930 0x7fd0000b1a40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.899+0000 7fd006f5d700 1 -- 172.21.15.82:0/1654830431 >> 172.21.15.82:0/1654830431 conn(0x7fd0000d1180 msgr2=0x7fd000069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.900+0000 7fd006f5d700 1 -- 172.21.15.82:0/1654830431 shutdown_connections 2023-10-06T03:17:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.900+0000 7fd006f5d700 1 -- 172.21.15.82:0/1654830431 wait complete. 2023-10-06T03:17:46.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.901+0000 7fd006f5d700 1 Processor -- start 2023-10-06T03:17:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.901+0000 7fd006f5d700 1 -- start start 2023-10-06T03:17:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.901+0000 7fd006f5d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0001591b0 0x7fd0001698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.901+0000 7fd006f5d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd00015d560 0x7fd0001473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.901+0000 7fd006f5d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d930 0x7fd000157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd006f5d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00015b1d0 con 0x7fd0001591b0 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd006f5d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd000169f60 con 0x7fd00015d560 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd006f5d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00016a240 con 0x7fd00015d930 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0001591b0 0x7fd0001698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0001591b0 0x7fd0001698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40248/0 (socket says 172.21.15.82:40248) 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 -- 172.21.15.82:0/2682249401 learned_addr learned my addr 172.21.15.82:0/2682249401 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd0054fa700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d930 0x7fd000157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fcff7fff700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd00015d560 0x7fd0001473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 -- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d930 msgr2=0x7fd000157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d930 0x7fd000157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 -- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd00015d560 msgr2=0x7fd0001473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd00015d560 0x7fd0001473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 -- 172.21.15.82:0/2682249401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0009420 con 0x7fd0001591b0 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd004cf9700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0001591b0 0x7fd0001698c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00d890 tx=0x7fcffc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fcff4ff9700 1 -- 172.21.15.82:0/2682249401 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00b600 con 0x7fd0001591b0 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fcff4ff9700 1 -- 172.21.15.82:0/2682249401 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc00b760 con 0x7fd0001591b0 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00016a520 con 0x7fd0001591b0 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fcff4ff9700 1 -- 172.21.15.82:0/2682249401 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00bae0 con 0x7fd0001591b0 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.902+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd000154c00 con 0x7fd0001591b0 2023-10-06T03:17:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.903+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd000064050 con 0x7fd0001591b0 2023-10-06T03:17:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.903+0000 7fcff4ff9700 1 -- 172.21.15.82:0/2682249401 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcffc01e460 con 0x7fd0001591b0 2023-10-06T03:17:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.904+0000 7fcff4ff9700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcfec066f30 0x7fcfec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.904+0000 7fcff4ff9700 1 -- 172.21.15.82:0/2682249401 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fcffc084a40 con 0x7fd0001591b0 2023-10-06T03:17:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.904+0000 7fcff7fff700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcfec066f30 0x7fcfec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.904+0000 7fcff7fff700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcfec066f30 0x7fcfec0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcff00091e0 tx=0x7fcff0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:46.908+0000 7fcff4ff9700 1 -- 172.21.15.82:0/2682249401 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcffc086e60 con 0x7fd0001591b0 2023-10-06T03:17:47.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.085+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0000b2510 con 0x7fcfec066f30 2023-10-06T03:17:47.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.089+0000 7fcff4ff9700 1 -- 172.21.15.82:0/2682249401 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73231 (secure 0 0 0) 0x7fd0000b2510 con 0x7fcfec066f30 2023-10-06T03:17:47.091 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:47.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcfec066f30 msgr2=0x7fcfec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcfec066f30 0x7fcfec0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcff00091e0 tx=0x7fcff0017000 comp rx=0 tx=0).stop 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0001591b0 msgr2=0x7fd0001698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0001591b0 0x7fd0001698c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00d890 tx=0x7fcffc008040 comp rx=0 tx=0).stop 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 shutdown_connections 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcfec066f30 0x7fcfec0693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd00015d930 0x7fd000157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0001591b0 0x7fd0001698c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 --2- 172.21.15.82:0/2682249401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd00015d560 0x7fd0001473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 >> 172.21.15.82:0/2682249401 conn(0x7fd0000d1180 msgr2=0x7fd0000b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 shutdown_connections 2023-10-06T03:17:47.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.091+0000 7fd006f5d700 1 -- 172.21.15.82:0/2682249401 wait complete. 2023-10-06T03:17:47.094 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:17:47.104 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-10-06T03:17:45.175231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430520,"kb_used_data":52216,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752544200,"statfs":{"total":773094113280,"available":770605260800,"internally_reserved":0,"allocated":53469184,"data_stored":50103488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23375051,"num_objects":-48,"num_object_clones":0,"num_object_copies":-96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-165,"num_write_kb":-43408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.836298"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.273004+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:17:41.273004+0000","last_peered":"2023-10-06T03:17:41.273004+0000","last_clean":"2023-10-06T03:17:41.273004+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:41.273004+0000","last_undegraded":"2023-10-06T03:17:41.273004+0000","last_fullsized":"2023-10-06T03:17:41.273004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099756+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:17:42.099756+0000","last_peered":"2023-10-06T03:17:42.099756+0000","last_clean":"2023-10-06T03:17:42.099756+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:42.099756+0000","last_undegraded":"2023-10-06T03:17:42.099756+0000","last_fullsized":"2023-10-06T03:17:42.099756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099696+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:17:42.099696+0000","last_peered":"2023-10-06T03:17:42.099696+0000","last_clean":"2023-10-06T03:17:42.099696+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:42.099696+0000","last_undegraded":"2023-10-06T03:17:42.099696+0000","last_fullsized":"2023-10-06T03:17:42.099696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":195,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.420912+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:17:41.420912+0000","last_peered":"2023-10-06T03:17:41.420912+0000","last_clean":"2023-10-06T03:17:41.420912+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:17:41.420912+0000","last_undegraded":"2023-10-06T03:17:41.420912+0000","last_fullsized":"2023-10-06T03:17:41.420912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.421533+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:17:41.421533+0000","last_peered":"2023-10-06T03:17:41.421533+0000","last_clean":"2023-10-06T03:17:41.421533+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:41.421533+0000","last_undegraded":"2023-10-06T03:17:41.421533+0000","last_fullsized":"2023-10-06T03:17:41.421533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.421002+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:17:41.421002+0000","last_peered":"2023-10-06T03:17:41.421002+0000","last_clean":"2023-10-06T03:17:41.421002+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:41.421002+0000","last_undegraded":"2023-10-06T03:17:41.421002+0000","last_fullsized":"2023-10-06T03:17:41.421002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099339+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:17:42.099339+0000","last_peered":"2023-10-06T03:17:42.099339+0000","last_clean":"2023-10-06T03:17:42.099339+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:42.099339+0000","last_undegraded":"2023-10-06T03:17:42.099339+0000","last_fullsized":"2023-10-06T03:17:42.099339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.272991+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:17:41.272991+0000","last_peered":"2023-10-06T03:17:41.272991+0000","last_clean":"2023-10-06T03:17:41.272991+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:41.272991+0000","last_undegraded":"2023-10-06T03:17:41.272991+0000","last_fullsized":"2023-10-06T03:17:41.272991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.272320+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:17:41.272320+0000","last_peered":"2023-10-06T03:17:41.272320+0000","last_clean":"2023-10-06T03:17:41.272320+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:41.272320+0000","last_undegraded":"2023-10-06T03:17:41.272320+0000","last_fullsized":"2023-10-06T03:17:41.272320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306764,"kb_used_data":9476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065076,"statfs":{"total":96636764160,"available":96322637824,"internally_reserved":0,"allocated":9703424,"data_stored":9289973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304132,"kb_used_data":6844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067708,"statfs":{"total":96636764160,"available":96325332992,"internally_reserved":0,"allocated":7008256,"data_stored":6602450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.66900000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.627},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.50800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298896,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072944,"statfs":{"total":96636764160,"available":96330694656,"internally_reserved":0,"allocated":1646592,"data_stored":1202559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.20799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.222},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.23899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.315},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.503}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.442},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":4828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":4943872,"data_stored":4505310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.433},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306204,"kb_used_data":8916,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065636,"statfs":{"total":96636764160,"available":96323211264,"internally_reserved":0,"allocated":9129984,"data_stored":8699610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.308},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.27200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.214},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.253}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":4780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":4894720,"data_stored":4498820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.6960000000000002,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.247}]},{"osd":2,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304148,"kb_used_data":6860,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067692,"statfs":{"total":96636764160,"available":96325316608,"internally_reserved":0,"allocated":7024640,"data_stored":6603808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.53500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306192,"kb_used_data":8904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065648,"statfs":{"total":96636764160,"available":96323223552,"internally_reserved":0,"allocated":9117696,"data_stored":8700958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.433}]},{"osd":1,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:17:47.107 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:17:47.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:17:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.219+0000 7fbc92f3b700 1 Processor -- start 2023-10-06T03:17:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.219+0000 7fbc92f3b700 1 -- start start 2023-10-06T03:17:47.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.220+0000 7fbc92f3b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc8c0aefe0 0x7fbc8c0b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.220+0000 7fbc92f3b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbc8c0cbf20 0x7fbc8c0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.220+0000 7fbc92f3b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c0cb210 con 0x7fbc8c158530 2023-10-06T03:17:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.220+0000 7fbc92f3b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c0b3260 con 0x7fbc8c0aefe0 2023-10-06T03:17:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.220+0000 7fbc92f3b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c0cba90 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.220+0000 7fbc91f39700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc8c0aefe0 0x7fbc8c0b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.220+0000 7fbc91f39700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc8c0aefe0 0x7fbc8c0b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40264/0 (socket says 172.21.15.82:40264) 2023-10-06T03:17:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.220+0000 7fbc91f39700 1 -- 172.21.15.82:0/780084470 learned_addr learned my addr 172.21.15.82:0/780084470 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc9273a700 1 --2- 172.21.15.82:0/780084470 >> v2:172.21.15.134:3300/0 conn(0x7fbc8c0cbf20 0x7fbc8c0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc91f39700 1 -- 172.21.15.82:0/780084470 >> v2:172.21.15.134:3300/0 conn(0x7fbc8c0cbf20 msgr2=0x7fbc8c0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc91f39700 1 --2- 172.21.15.82:0/780084470 >> v2:172.21.15.134:3300/0 conn(0x7fbc8c0cbf20 0x7fbc8c0cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc91f39700 1 -- 172.21.15.82:0/780084470 >> v1:172.21.15.134:6789/0 conn(0x7fbc8c158530 legacy=0x7fbc8c0af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc91f39700 1 -- 172.21.15.82:0/780084470 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c0b0860 con 0x7fbc8c0aefe0 2023-10-06T03:17:47.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc9273a700 1 --2- 172.21.15.82:0/780084470 >> v2:172.21.15.134:3300/0 conn(0x7fbc8c0cbf20 0x7fbc8c0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:47.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc91f39700 1 --2- 172.21.15.82:0/780084470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0aefe0 0x7fbc8c0b2920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0afac0 tx=0x7fbc88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa7a7809f2ee24a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:47.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc90f37700 1 -- 172.21.15.82:0/780084470 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800b860 con 0x7fbc8c0aefe0 2023-10-06T03:17:47.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc90f37700 1 -- 172.21.15.82:0/780084470 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800b9c0 con 0x7fbc8c0aefe0 2023-10-06T03:17:47.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc90f37700 1 -- 172.21.15.82:0/780084470 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800bd60 con 0x7fbc8c0aefe0 2023-10-06T03:17:47.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc92f3b700 1 -- 172.21.15.82:0/780084470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0aefe0 msgr2=0x7fbc8c0b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.221+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/780084470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0aefe0 0x7fbc8c0b2920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0afac0 tx=0x7fbc88009250 comp rx=0 tx=0).stop 2023-10-06T03:17:47.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.222+0000 7fbc92f3b700 1 -- 172.21.15.82:0/780084470 shutdown_connections 2023-10-06T03:17:47.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.222+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/780084470 >> v2:172.21.15.134:3300/0 conn(0x7fbc8c0cbf20 0x7fbc8c0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.222+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/780084470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0aefe0 0x7fbc8c0b2920 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.222+0000 7fbc92f3b700 1 -- 172.21.15.82:0/780084470 >> 172.21.15.82:0/780084470 conn(0x7fbc8c06e600 msgr2=0x7fbc8c06afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:47.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.222+0000 7fbc92f3b700 1 -- 172.21.15.82:0/780084470 shutdown_connections 2023-10-06T03:17:47.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.222+0000 7fbc92f3b700 1 -- 172.21.15.82:0/780084470 wait complete. 2023-10-06T03:17:47.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.223+0000 7fbc92f3b700 1 Processor -- start 2023-10-06T03:17:47.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.223+0000 7fbc92f3b700 1 -- start start 2023-10-06T03:17:47.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.223+0000 7fbc92f3b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc8c0aefe0 0x7fbc8c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.223+0000 7fbc92f3b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0cbf20 0x7fbc8c13f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.223+0000 7fbc92f3b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc8c158530 0x7fbc8c13ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.223+0000 7fbc92f3b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c06a090 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.223+0000 7fbc92f3b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c069480 con 0x7fbc8c158530 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.223+0000 7fbc92f3b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c069760 con 0x7fbc8c0aefe0 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0cbf20 0x7fbc8c13f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0cbf20 0x7fbc8c13f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40280/0 (socket says 172.21.15.82:40280) 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 -- 172.21.15.82:0/3779699642 learned_addr learned my addr 172.21.15.82:0/3779699642 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc9273a700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc8c158530 0x7fbc8c13ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91f39700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc8c0aefe0 0x7fbc8c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 -- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc8c0aefe0 msgr2=0x7fbc8c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc8c0aefe0 0x7fbc8c06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 -- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc8c158530 msgr2=0x7fbc8c13ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc8c158530 0x7fbc8c13ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 -- 172.21.15.82:0/3779699642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc880094f0 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91f39700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc8c0aefe0 0x7fbc8c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc9273a700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc8c158530 0x7fbc8c13ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc91738700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0cbf20 0x7fbc8c13f9d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c4e0 tx=0x7fbc7c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc81ffb700 1 -- 172.21.15.82:0/3779699642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c011590 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc81ffb700 1 -- 172.21.15.82:0/3779699642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c011710 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c069a40 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc81ffb700 1 -- 172.21.15.82:0/3779699642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c011ad0 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.224+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c06aa60 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.225+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c04c3c0 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.225+0000 7fbc81ffb700 1 -- 172.21.15.82:0/3779699642 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc7c01b3b0 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.226+0000 7fbc81ffb700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc70066f30 0x7fbc700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.226+0000 7fbc81ffb700 1 -- 172.21.15.82:0/3779699642 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbc7c083850 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.226+0000 7fbc91f39700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc70066f30 0x7fbc700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.227+0000 7fbc91f39700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc70066f30 0x7fbc700693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0afac0 tx=0x7fbc88017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.230+0000 7fbc81ffb700 1 -- 172.21.15.82:0/3779699642 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc7c050c60 con 0x7fbc8c0cbf20 2023-10-06T03:17:47.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.409+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc8c0cac40 con 0x7fbc70066f30 2023-10-06T03:17:47.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.412+0000 7fbc81ffb700 1 -- 172.21.15.82:0/3779699642 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73231 (secure 0 0 0) 0x7fbc8c0cac40 con 0x7fbc70066f30 2023-10-06T03:17:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:47.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc70066f30 msgr2=0x7fbc700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc70066f30 0x7fbc700693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0afac0 tx=0x7fbc88017000 comp rx=0 tx=0).stop 2023-10-06T03:17:47.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0cbf20 msgr2=0x7fbc8c13f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0cbf20 0x7fbc8c13f9d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c4e0 tx=0x7fbc7c00c8a0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 shutdown_connections 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc8c158530 0x7fbc8c13ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fbc70066f30 0x7fbc700693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc8c0aefe0 0x7fbc8c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 --2- 172.21.15.82:0/3779699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc8c0cbf20 0x7fbc8c13f9d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 >> 172.21.15.82:0/3779699642 conn(0x7fbc8c06e600 msgr2=0x7fbc8c15d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 shutdown_connections 2023-10-06T03:17:47.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.414+0000 7fbc92f3b700 1 -- 172.21.15.82:0/3779699642 wait complete. 2023-10-06T03:17:47.418 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:17:47.428 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-10-06T03:17:47.175659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430520,"kb_used_data":52216,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752544200,"statfs":{"total":773094113280,"available":770605260800,"internally_reserved":0,"allocated":53469184,"data_stored":50103488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23375051,"num_objects":-48,"num_object_clones":0,"num_object_copies":-96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-165,"num_write_kb":-43408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001254"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.273004+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:17:41.273004+0000","last_peered":"2023-10-06T03:17:41.273004+0000","last_clean":"2023-10-06T03:17:41.273004+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:41.273004+0000","last_undegraded":"2023-10-06T03:17:41.273004+0000","last_fullsized":"2023-10-06T03:17:41.273004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099756+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:17:42.099756+0000","last_peered":"2023-10-06T03:17:42.099756+0000","last_clean":"2023-10-06T03:17:42.099756+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:42.099756+0000","last_undegraded":"2023-10-06T03:17:42.099756+0000","last_fullsized":"2023-10-06T03:17:42.099756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099696+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:17:42.099696+0000","last_peered":"2023-10-06T03:17:42.099696+0000","last_clean":"2023-10-06T03:17:42.099696+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:42.099696+0000","last_undegraded":"2023-10-06T03:17:42.099696+0000","last_fullsized":"2023-10-06T03:17:42.099696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":195,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.420912+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:17:41.420912+0000","last_peered":"2023-10-06T03:17:41.420912+0000","last_clean":"2023-10-06T03:17:41.420912+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:17:41.420912+0000","last_undegraded":"2023-10-06T03:17:41.420912+0000","last_fullsized":"2023-10-06T03:17:41.420912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.421533+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:17:41.421533+0000","last_peered":"2023-10-06T03:17:41.421533+0000","last_clean":"2023-10-06T03:17:41.421533+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:41.421533+0000","last_undegraded":"2023-10-06T03:17:41.421533+0000","last_fullsized":"2023-10-06T03:17:41.421533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.421002+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:17:41.421002+0000","last_peered":"2023-10-06T03:17:41.421002+0000","last_clean":"2023-10-06T03:17:41.421002+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:41.421002+0000","last_undegraded":"2023-10-06T03:17:41.421002+0000","last_fullsized":"2023-10-06T03:17:41.421002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:42.099339+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:17:42.099339+0000","last_peered":"2023-10-06T03:17:42.099339+0000","last_clean":"2023-10-06T03:17:42.099339+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:42.099339+0000","last_undegraded":"2023-10-06T03:17:42.099339+0000","last_fullsized":"2023-10-06T03:17:42.099339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.272991+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:17:41.272991+0000","last_peered":"2023-10-06T03:17:41.272991+0000","last_clean":"2023-10-06T03:17:41.272991+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:41.272991+0000","last_undegraded":"2023-10-06T03:17:41.272991+0000","last_fullsized":"2023-10-06T03:17:41.272991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:17:41.272320+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:17:41.272320+0000","last_peered":"2023-10-06T03:17:41.272320+0000","last_clean":"2023-10-06T03:17:41.272320+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:41.272320+0000","last_undegraded":"2023-10-06T03:17:41.272320+0000","last_fullsized":"2023-10-06T03:17:41.272320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306764,"kb_used_data":9476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065076,"statfs":{"total":96636764160,"available":96322637824,"internally_reserved":0,"allocated":9703424,"data_stored":9289973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304132,"kb_used_data":6844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067708,"statfs":{"total":96636764160,"available":96325332992,"internally_reserved":0,"allocated":7008256,"data_stored":6602450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.66900000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.627},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.50800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298896,"kb_used_data":1608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072944,"statfs":{"total":96636764160,"available":96330694656,"internally_reserved":0,"allocated":1646592,"data_stored":1202559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.20799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.222},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.23899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.315},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.503}]},{"osd":6,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.442},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":4828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":4943872,"data_stored":4505310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.433},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306204,"kb_used_data":8916,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065636,"statfs":{"total":96636764160,"available":96323211264,"internally_reserved":0,"allocated":9129984,"data_stored":8699610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.308},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.27200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.214},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.253}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":4780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":4894720,"data_stored":4498820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.6960000000000002,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.247}]},{"osd":2,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304148,"kb_used_data":6860,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94067692,"statfs":{"total":96636764160,"available":96325316608,"internally_reserved":0,"allocated":7024640,"data_stored":6603808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:16:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.53500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306192,"kb_used_data":8904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94065648,"statfs":{"total":96636764160,"available":96323223552,"internally_reserved":0,"allocated":9117696,"data_stored":8700958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.433}]},{"osd":1,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:17:47.430 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:17:47.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.542+0000 7f9eb09dc700 1 Processor -- start 2023-10-06T03:17:47.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.542+0000 7f9eb09dc700 1 -- start start 2023-10-06T03:17:47.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eb09dc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9eac15d850 0x7f9eac0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eb09dc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9eac0b6170 0x7f9eac0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eb09dc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac069f70 con 0x7f9eac15d480 2023-10-06T03:17:47.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eb09dc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0687c0 con 0x7f9eac15d850 2023-10-06T03:17:47.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eb09dc700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac068aa0 con 0x7f9eac0b6170 2023-10-06T03:17:47.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eaaffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9eac15d850 0x7f9eac0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eab7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9eac15d480 0x7f9eac069860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39272/0 (socket says 172.21.15.82:39272) 2023-10-06T03:17:47.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eab7fe700 1 -- 172.21.15.82:0/859857646 learned_addr learned my addr 172.21.15.82:0/859857646 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:47.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eabfff700 1 --2- 172.21.15.82:0/859857646 >> v2:172.21.15.134:3300/0 conn(0x7f9eac0b6170 0x7f9eac0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eaaffd700 1 -- 172.21.15.82:0/859857646 >> v2:172.21.15.134:3300/0 conn(0x7f9eac0b6170 msgr2=0x7f9eac0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eaaffd700 1 --2- 172.21.15.82:0/859857646 >> v2:172.21.15.134:3300/0 conn(0x7f9eac0b6170 0x7f9eac0b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eaaffd700 1 -- 172.21.15.82:0/859857646 >> v1:172.21.15.82:6789/0 conn(0x7f9eac15d480 legacy=0x7f9eac069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eaaffd700 1 -- 172.21.15.82:0/859857646 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac068d80 con 0x7f9eac15d850 2023-10-06T03:17:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eabfff700 1 --2- 172.21.15.82:0/859857646 >> v2:172.21.15.134:3300/0 conn(0x7f9eac0b6170 0x7f9eac0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.543+0000 7f9eaaffd700 1 --2- 172.21.15.82:0/859857646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d850 0x7f9eac0b5c30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0ce010 tx=0x7f9ea00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6119ec71d57e1927 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eaa7fc700 1 -- 172.21.15.82:0/859857646 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000b6b0 con 0x7f9eac15d850 2023-10-06T03:17:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eaa7fc700 1 -- 172.21.15.82:0/859857646 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea000b810 con 0x7f9eac15d850 2023-10-06T03:17:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eaa7fc700 1 -- 172.21.15.82:0/859857646 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000bbb0 con 0x7f9eac15d850 2023-10-06T03:17:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eb09dc700 1 -- 172.21.15.82:0/859857646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d850 msgr2=0x7f9eac0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/859857646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d850 0x7f9eac0b5c30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0ce010 tx=0x7f9ea00091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eb09dc700 1 -- 172.21.15.82:0/859857646 shutdown_connections 2023-10-06T03:17:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/859857646 >> v2:172.21.15.134:3300/0 conn(0x7f9eac0b6170 0x7f9eac0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/859857646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d850 0x7f9eac0b5c30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eb09dc700 1 -- 172.21.15.82:0/859857646 >> 172.21.15.82:0/859857646 conn(0x7f9eac0ccf80 msgr2=0x7f9eac0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eb09dc700 1 -- 172.21.15.82:0/859857646 shutdown_connections 2023-10-06T03:17:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.544+0000 7f9eb09dc700 1 -- 172.21.15.82:0/859857646 wait complete. 2023-10-06T03:17:47.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eb09dc700 1 Processor -- start 2023-10-06T03:17:47.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eb09dc700 1 -- start start 2023-10-06T03:17:47.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eb09dc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9eac0b6170 0x7f9eac13f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eb09dc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d480 0x7f9eac0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eb09dc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9eac15d850 0x7f9eac0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eb09dc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c6aa0 con 0x7f9eac15d480 2023-10-06T03:17:47.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eb09dc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c6d80 con 0x7f9eac0b6170 2023-10-06T03:17:47.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eb09dc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c74e0 con 0x7f9eac15d850 2023-10-06T03:17:47.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eaaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d480 0x7f9eac0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eaaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d480 0x7f9eac0c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44050/0 (socket says 172.21.15.82:44050) 2023-10-06T03:17:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.546+0000 7f9eaaffd700 1 -- 172.21.15.82:0/1849138554 learned_addr learned my addr 172.21.15.82:0/1849138554 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eab7fe700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9eac0b6170 0x7f9eac13f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eabfff700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9eac15d850 0x7f9eac0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eaaffd700 1 -- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9eac15d850 msgr2=0x7f9eac0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eaaffd700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9eac15d850 0x7f9eac0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eaaffd700 1 -- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9eac0b6170 msgr2=0x7f9eac13f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eaaffd700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9eac0b6170 0x7f9eac13f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eaaffd700 1 -- 172.21.15.82:0/1849138554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea0009420 con 0x7f9eac15d480 2023-10-06T03:17:47.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eab7fe700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9eac0b6170 0x7f9eac13f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:47.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eaaffd700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d480 0x7f9eac0c9e00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9eac088ca0 tx=0x7f9ea0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:47.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9e937fe700 1 -- 172.21.15.82:0/1849138554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0011420 con 0x7f9eac15d480 2023-10-06T03:17:47.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9e937fe700 1 -- 172.21.15.82:0/1849138554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0011580 con 0x7f9eac15d480 2023-10-06T03:17:47.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac0c77c0 con 0x7f9eac15d480 2023-10-06T03:17:47.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9e937fe700 1 -- 172.21.15.82:0/1849138554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0011920 con 0x7f9eac15d480 2023-10-06T03:17:47.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.547+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac13fb90 con 0x7f9eac15d480 2023-10-06T03:17:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.548+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac0c7ce0 con 0x7f9eac15d480 2023-10-06T03:17:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.548+0000 7f9e937fe700 1 -- 172.21.15.82:0/1849138554 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ea0011cd0 con 0x7f9eac15d480 2023-10-06T03:17:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.549+0000 7f9e937fe700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9e98066f30 0x7f9e980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.549+0000 7f9e937fe700 1 -- 172.21.15.82:0/1849138554 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9ea0085e20 con 0x7f9eac15d480 2023-10-06T03:17:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.549+0000 7f9eab7fe700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9e98066f30 0x7f9e980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.549+0000 7f9eab7fe700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9e98066f30 0x7f9e980693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c002230 tx=0x7f9e9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:47.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.553+0000 7f9e937fe700 1 -- 172.21.15.82:0/1849138554 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9eac0c7ce0 con 0x7f9eac15d480 2023-10-06T03:17:47.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.736+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9eac0c7ce0 con 0x7f9eac15d480 2023-10-06T03:17:47.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.737+0000 7f9e937fe700 1 -- 172.21.15.82:0/1849138554 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13778 (secure 0 0 0) 0x7f9eac0c7ce0 con 0x7f9eac15d480 2023-10-06T03:17:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:47.738 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":60,"fsid":"968d6894-b90c-4b96-8e67-09d8a805d810","created":"2023-10-06T03:15:33.552734+0000","modified":"2023-10-06T03:17:44.365474+0000","last_up_change":"2023-10-06T03:15:44.311119+0000","last_in_change":"2023-10-06T03:15:35.934727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:15:44.682622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:15:45.177430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b68dff-6549-4b57-b950-31549b337aef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":90632},{"type":"v1","addr":"172.21.15.82:6815","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":90632},{"type":"v1","addr":"172.21.15.82:6819","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":90632},{"type":"v1","addr":"172.21.15.82:6823","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":90632},{"type":"v1","addr":"172.21.15.82:6821","nonce":90632}]},"public_addr":"172.21.15.82:6815/90632","cluster_addr":"172.21.15.82:6819/90632","heartbeat_back_addr":"172.21.15.82:6823/90632","heartbeat_front_addr":"172.21.15.82:6821/90632","state":["exists","up"]},{"osd":1,"uuid":"b2f0ab4a-f3f6-470b-9d76-24d5a3c074ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":90633},{"type":"v1","addr":"172.21.15.82:6809","nonce":90633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":90633},{"type":"v1","addr":"172.21.15.82:6811","nonce":90633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":90633},{"type":"v1","addr":"172.21.15.82:6818","nonce":90633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":90633},{"type":"v1","addr":"172.21.15.82:6814","nonce":90633}]},"public_addr":"172.21.15.82:6809/90633","cluster_addr":"172.21.15.82:6811/90633","heartbeat_back_addr":"172.21.15.82:6818/90633","heartbeat_front_addr":"172.21.15.82:6814/90633","state":["exists","up"]},{"osd":2,"uuid":"86db79f5-08d0-49aa-b034-2af8a0cbff90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":90644},{"type":"v1","addr":"172.21.15.82:6825","nonce":90644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":90644},{"type":"v1","addr":"172.21.15.82:6827","nonce":90644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":90644},{"type":"v1","addr":"172.21.15.82:6831","nonce":90644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":90644},{"type":"v1","addr":"172.21.15.82:6829","nonce":90644}]},"public_addr":"172.21.15.82:6825/90644","cluster_addr":"172.21.15.82:6827/90644","heartbeat_back_addr":"172.21.15.82:6831/90644","heartbeat_front_addr":"172.21.15.82:6829/90644","state":["exists","up"]},{"osd":3,"uuid":"0123a898-574f-45f0-af60-67ef0d7d26b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":90631},{"type":"v1","addr":"172.21.15.82:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":90631},{"type":"v1","addr":"172.21.15.82:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":90631},{"type":"v1","addr":"172.21.15.82:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":90631},{"type":"v1","addr":"172.21.15.82:6805","nonce":90631}]},"public_addr":"172.21.15.82:6801/90631","cluster_addr":"172.21.15.82:6803/90631","heartbeat_back_addr":"172.21.15.82:6807/90631","heartbeat_front_addr":"172.21.15.82:6805/90631","state":["exists","up"]},{"osd":4,"uuid":"ed0146a6-cf93-4abf-a810-072f3b3fae4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":90846},{"type":"v1","addr":"172.21.15.134:6801","nonce":90846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":90846},{"type":"v1","addr":"172.21.15.134:6803","nonce":90846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":90846},{"type":"v1","addr":"172.21.15.134:6807","nonce":90846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":90846},{"type":"v1","addr":"172.21.15.134:6805","nonce":90846}]},"public_addr":"172.21.15.134:6801/90846","cluster_addr":"172.21.15.134:6803/90846","heartbeat_back_addr":"172.21.15.134:6807/90846","heartbeat_front_addr":"172.21.15.134:6805/90846","state":["exists","up"]},{"osd":5,"uuid":"7fe98f77-1037-48ba-88e9-f368d080546d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":90874},{"type":"v1","addr":"172.21.15.134:6817","nonce":90874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":90874},{"type":"v1","addr":"172.21.15.134:6819","nonce":90874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":90874},{"type":"v1","addr":"172.21.15.134:6823","nonce":90874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":90874},{"type":"v1","addr":"172.21.15.134:6821","nonce":90874}]},"public_addr":"172.21.15.134:6817/90874","cluster_addr":"172.21.15.134:6819/90874","heartbeat_back_addr":"172.21.15.134:6823/90874","heartbeat_front_addr":"172.21.15.134:6821/90874","state":["exists","up"]},{"osd":6,"uuid":"78df93db-ca61-4cf1-8f08-d453e7ae9b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":90847},{"type":"v1","addr":"172.21.15.134:6809","nonce":90847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":90847},{"type":"v1","addr":"172.21.15.134:6811","nonce":90847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":90847},{"type":"v1","addr":"172.21.15.134:6815","nonce":90847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":90847},{"type":"v1","addr":"172.21.15.134:6813","nonce":90847}]},"public_addr":"172.21.15.134:6809/90847","cluster_addr":"172.21.15.134:6811/90847","heartbeat_back_addr":"172.21.15.134:6815/90847","heartbeat_front_addr":"172.21.15.134:6813/90847","state":["exists","up"]},{"osd":7,"uuid":"a231fc25-6055-4b4b-945e-c4a0e32de914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":90877},{"type":"v1","addr":"172.21.15.134:6825","nonce":90877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":90877},{"type":"v1","addr":"172.21.15.134:6827","nonce":90877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":90877},{"type":"v1","addr":"172.21.15.134:6831","nonce":90877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":90877},{"type":"v1","addr":"172.21.15.134:6829","nonce":90877}]},"public_addr":"172.21.15.134:6825/90877","cluster_addr":"172.21.15.134:6827/90877","heartbeat_back_addr":"172.21.15.134:6831/90877","heartbeat_front_addr":"172.21.15.134:6829/90877","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.836559+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.081245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.107221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.747156+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.060912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:40.822199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.073898+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:15:41.117260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6835/598797511":"2023-10-07T03:17:41.267435+0000","172.21.15.82:6833/598797511":"2023-10-07T03:17:41.267435+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9e98066f30 msgr2=0x7f9e980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9e98066f30 0x7f9e980693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c002230 tx=0x7f9e9c009040 comp rx=0 tx=0).stop 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d480 msgr2=0x7f9eac0c9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d480 0x7f9eac0c9e00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9eac088ca0 tx=0x7f9ea0017000 comp rx=0 tx=0).stop 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 shutdown_connections 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f9e98066f30 0x7f9e980693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9eac15d850 0x7f9eac0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9eac0b6170 0x7f9eac13f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 --2- 172.21.15.82:0/1849138554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac15d480 0x7f9eac0c9e00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 >> 172.21.15.82:0/1849138554 conn(0x7f9eac0ccf80 msgr2=0x7f9eac141f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:47.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 shutdown_connections 2023-10-06T03:17:47.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:47.739+0000 7f9eb09dc700 1 -- 172.21.15.82:0/1849138554 wait complete. 2023-10-06T03:17:48.753 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T03:17:48.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:17:48.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.882+0000 7f2ef4501700 1 Processor -- start 2023-10-06T03:17:48.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.882+0000 7f2ef4501700 1 -- start start 2023-10-06T03:17:48.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.883+0000 7f2ef4501700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2eec0ccbe0 0x7f2eec0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:48.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.883+0000 7f2ef4501700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 0x7f2eec0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:48.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.883+0000 7f2ef4501700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eec0cbed0 con 0x7f2eec0b55b0 2023-10-06T03:17:48.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.883+0000 7f2ef4501700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec159d40 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.883+0000 7f2ef4501700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0cc750 con 0x7f2eec0d0f00 2023-10-06T03:17:48.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef2a9e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 0x7f2eec0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:48.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef1a9c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2eec0ccbe0 0x7f2eec0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:48.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef229d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2eec0b55b0 0x7f2eec0cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:47740/0 (socket says 172.21.15.82:47740) 2023-10-06T03:17:48.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef229d700 1 -- 172.21.15.82:0/2134095553 learned_addr learned my addr 172.21.15.82:0/2134095553 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:48.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef1a9c700 1 --2- 172.21.15.82:0/2134095553 >> v2:172.21.15.134:3300/0 conn(0x7f2eec0ccbe0 0x7f2eec0b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:40404/0 (socket says 172.21.15.82:40404) 2023-10-06T03:17:48.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef2a9e700 1 -- 172.21.15.82:0/2134095553 >> v2:172.21.15.134:3300/0 conn(0x7f2eec0ccbe0 msgr2=0x7f2eec0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:48.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef2a9e700 1 --2- 172.21.15.82:0/2134095553 >> v2:172.21.15.134:3300/0 conn(0x7f2eec0ccbe0 0x7f2eec0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef2a9e700 1 -- 172.21.15.82:0/2134095553 >> v1:172.21.15.134:6789/0 conn(0x7f2eec0b55b0 legacy=0x7f2eec0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef2a9e700 1 -- 172.21.15.82:0/2134095553 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0cd050 con 0x7f2eec0d0f00 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef1a9c700 1 --2- 172.21.15.82:0/2134095553 >> v2:172.21.15.134:3300/0 conn(0x7f2eec0ccbe0 0x7f2eec0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.884+0000 7f2ef2a9e700 1 --2- 172.21.15.82:0/2134095553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 0x7f2eec0ce270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009e60 tx=0x7f2ee4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdabf326d125149d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef129b700 1 -- 172.21.15.82:0/2134095553 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400e070 con 0x7f2eec0d0f00 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef129b700 1 -- 172.21.15.82:0/2134095553 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400bb60 con 0x7f2eec0d0f00 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef129b700 1 -- 172.21.15.82:0/2134095553 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4012430 con 0x7f2eec0d0f00 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef4501700 1 -- 172.21.15.82:0/2134095553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 msgr2=0x7f2eec0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:48.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef4501700 1 --2- 172.21.15.82:0/2134095553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 0x7f2eec0ce270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009e60 tx=0x7f2ee4009780 comp rx=0 tx=0).stop 2023-10-06T03:17:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef4501700 1 -- 172.21.15.82:0/2134095553 shutdown_connections 2023-10-06T03:17:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef4501700 1 --2- 172.21.15.82:0/2134095553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 0x7f2eec0ce270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef4501700 1 --2- 172.21.15.82:0/2134095553 >> v2:172.21.15.134:3300/0 conn(0x7f2eec0ccbe0 0x7f2eec0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef4501700 1 -- 172.21.15.82:0/2134095553 >> 172.21.15.82:0/2134095553 conn(0x7f2eec08a050 msgr2=0x7f2eec099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef4501700 1 -- 172.21.15.82:0/2134095553 shutdown_connections 2023-10-06T03:17:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.885+0000 7f2ef4501700 1 -- 172.21.15.82:0/2134095553 wait complete. 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.886+0000 7f2ef4501700 1 Processor -- start 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.886+0000 7f2ef4501700 1 -- start start 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef4501700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2eec0b55b0 0x7f2eec157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef4501700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2eec0ccbe0 0x7f2eec15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef4501700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 0x7f2eec15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef4501700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0b0c70 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef4501700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec1580e0 con 0x7f2eec0b55b0 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef4501700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec1585f0 con 0x7f2eec0d0f00 2023-10-06T03:17:48.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef1a9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2eec0ccbe0 0x7f2eec15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef1a9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2eec0ccbe0 0x7f2eec15bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44054/0 (socket says 172.21.15.82:44054) 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.887+0000 7f2ef1a9c700 1 -- 172.21.15.82:0/3549224923 learned_addr learned my addr 172.21.15.82:0/3549224923 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef229d700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2eec0b55b0 0x7f2eec157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef2a9e700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 0x7f2eec15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef1a9c700 1 -- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 msgr2=0x7f2eec15c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef1a9c700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2eec0d0f00 0x7f2eec15c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef1a9c700 1 -- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2eec0b55b0 msgr2=0x7f2eec157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef1a9c700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2eec0b55b0 0x7f2eec157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef1a9c700 1 -- 172.21.15.82:0/3549224923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009420 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef229d700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2eec0b55b0 0x7f2eec157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef1a9c700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2eec0ccbe0 0x7f2eec15bf90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00ece0 tx=0x7f2edc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:48.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00ee90 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc00cbe0 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc013470 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee4009a20 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.888+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eec0c9d10 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.889+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2eec0717c0 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.889+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2edc013820 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ee27fc700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2ed0066f30 0x7f2ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2edc0847a0 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ef229d700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2ed0066f30 0x7f2ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ee27fc700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f2ed006d3a0 0x7f2ed006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 --> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ed006fe80 con 0x7f2ed006d3a0 2023-10-06T03:17:48.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2edc086de0 con 0x7f2eec0ccbe0 2023-10-06T03:17:48.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ef2a9e700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f2ed006d3a0 0x7f2ed006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:48.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ef2a9e700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f2ed006d3a0 0x7f2ed006f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:48.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.890+0000 7f2ef229d700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2ed0066f30 0x7f2ed00693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8007fd0 tx=0x7f2ee8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:48.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.891+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 <== osd.0 v2:172.21.15.82:6813/90632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2ed006fe80 con 0x7f2ed006d3a0 2023-10-06T03:17:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.904+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 --> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2eec0cf5e0 con 0x7f2ed006d3a0 2023-10-06T03:17:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ee27fc700 1 -- 172.21.15.82:0/3549224923 <== osd.0 v2:172.21.15.82:6813/90632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2eec0cf5e0 con 0x7f2ed006d3a0 2023-10-06T03:17:48.907 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:17:48.907 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f2ed006d3a0 msgr2=0x7f2ed006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.82:6813/90632,v1:172.21.15.82:6815/90632] conn(0x7f2ed006d3a0 0x7f2ed006f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2ed0066f30 msgr2=0x7f2ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f2ed0066f30 0x7f2ed00693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8007fd0 tx=0x7f2ee8009040 comp rx=0 tx=0).stop 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2eec0ccbe0 msgr2=0x7f2eec15bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 --2- 172.21.15.82:0/3549224923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2eec0ccbe0 0x7f2eec15bf90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00ece0 tx=0x7f2edc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef2a9e700 1 -- 172.21.15.82:0/3549224923 reap_dead start 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 shutdown_connections 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 >> 172.21.15.82:0/3549224923 conn(0x7f2eec08a050 msgr2=0x7f2eec0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 shutdown_connections 2023-10-06T03:17:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:48.905+0000 7f2ef4501700 1 -- 172.21.15.82:0/3549224923 wait complete. 2023-10-06T03:17:48.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T03:17:49.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.031+0000 7fe565677700 1 Processor -- start 2023-10-06T03:17:49.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.031+0000 7fe565677700 1 -- start start 2023-10-06T03:17:49.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe565677700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560142e90 0x7fe560069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe565677700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe56015d9a0 0x7fe5600b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe565677700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe560069380 con 0x7fe560069d50 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe565677700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe560068770 con 0x7fe56015d9a0 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe565677700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe560068a50 con 0x7fe560142e90 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe564e76700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe56015d9a0 0x7fe5600b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe55f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe560069d50 0x7fe56015d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39284/0 (socket says 172.21.15.82:39284) 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe55f7fe700 1 -- 172.21.15.82:0/3995659975 learned_addr learned my addr 172.21.15.82:0/3995659975 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe55ffff700 1 --2- 172.21.15.82:0/3995659975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560142e90 0x7fe560069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe564e76700 1 -- 172.21.15.82:0/3995659975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560142e90 msgr2=0x7fe560069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe564e76700 1 --2- 172.21.15.82:0/3995659975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560142e90 0x7fe560069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe564e76700 1 -- 172.21.15.82:0/3995659975 >> v1:172.21.15.82:6789/0 conn(0x7fe560069d50 legacy=0x7fe56015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe55effd700 1 -- 172.21.15.82:0/3995659975 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644415619 0 0) 0x7fe560069380 con 0x7fe560069d50 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.032+0000 7fe564e76700 1 -- 172.21.15.82:0/3995659975 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560068d30 con 0x7fe56015d9a0 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe564e76700 1 --2- 172.21.15.82:0/3995659975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe5600b5c90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe558009e60 tx=0x7fe558009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d724f7f41e4cf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe55effd700 1 -- 172.21.15.82:0/3995659975 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800e070 con 0x7fe56015d9a0 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe55effd700 1 -- 172.21.15.82:0/3995659975 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55800bb60 con 0x7fe56015d9a0 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe55effd700 1 -- 172.21.15.82:0/3995659975 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558012430 con 0x7fe56015d9a0 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe565677700 1 -- 172.21.15.82:0/3995659975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 msgr2=0x7fe5600b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe565677700 1 --2- 172.21.15.82:0/3995659975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe5600b5c90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe558009e60 tx=0x7fe558009780 comp rx=0 tx=0).stop 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe565677700 1 -- 172.21.15.82:0/3995659975 shutdown_connections 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe565677700 1 --2- 172.21.15.82:0/3995659975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe5600b5c90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe565677700 1 --2- 172.21.15.82:0/3995659975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560142e90 0x7fe560069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe565677700 1 -- 172.21.15.82:0/3995659975 >> 172.21.15.82:0/3995659975 conn(0x7fe5600ccfe0 msgr2=0x7fe5600cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe565677700 1 -- 172.21.15.82:0/3995659975 shutdown_connections 2023-10-06T03:17:49.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.033+0000 7fe565677700 1 -- 172.21.15.82:0/3995659975 wait complete. 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.034+0000 7fe565677700 1 Processor -- start 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe565677700 1 -- start start 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe565677700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560069d50 0x7fe56016d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe565677700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560142e90 0x7fe5600b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe565677700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe56013f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe565677700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56016df30 con 0x7fe56015d9a0 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe565677700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56016aa00 con 0x7fe560142e90 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe565677700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe560169e80 con 0x7fe560069d50 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe564e76700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe56013f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe564e76700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe56013f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44070/0 (socket says 172.21.15.82:44070) 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.035+0000 7fe564e76700 1 -- 172.21.15.82:0/1030824080 learned_addr learned my addr 172.21.15.82:0/1030824080 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe55f7fe700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560142e90 0x7fe5600b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe55ffff700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560069d50 0x7fe56016d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe564e76700 1 -- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560069d50 msgr2=0x7fe56016d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe564e76700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560069d50 0x7fe56016d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe564e76700 1 -- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560142e90 msgr2=0x7fe5600b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe564e76700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560142e90 0x7fe5600b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe564e76700 1 -- 172.21.15.82:0/1030824080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558009a20 con 0x7fe56015d9a0 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe55ffff700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560069d50 0x7fe56016d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe55f7fe700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560142e90 0x7fe5600b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:49.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe564e76700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe56013f8e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe558013000 tx=0x7fe558019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe547fff700 1 -- 172.21.15.82:0/1030824080 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558027470 con 0x7fe56015d9a0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe547fff700 1 -- 172.21.15.82:0/1030824080 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558027610 con 0x7fe56015d9a0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe547fff700 1 -- 172.21.15.82:0/1030824080 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5580279d0 con 0x7fe56015d9a0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56016a160 con 0x7fe56015d9a0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.036+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56016a720 con 0x7fe56015d9a0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.037+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5600895c0 con 0x7fe56015d9a0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.037+0000 7fe547fff700 1 -- 172.21.15.82:0/1030824080 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe558024070 con 0x7fe56015d9a0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.038+0000 7fe547fff700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.038+0000 7fe547fff700 1 -- 172.21.15.82:0/1030824080 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fe558086ec0 con 0x7fe56015d9a0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.038+0000 7fe55ffff700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.038+0000 7fe55ffff700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe54c066f30 0x7fe54c0693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe550006f00 tx=0x7fe550008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.042+0000 7fe547fff700 1 -- 172.21.15.82:0/1030824080 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe558054230 con 0x7fe56015d9a0 2023-10-06T03:17:49.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.223+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe56004c3c0 con 0x7fe54c066f30 2023-10-06T03:17:49.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.224+0000 7fe547fff700 1 -- 172.21.15.82:0/1030824080 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe56004c3c0 con 0x7fe54c066f30 2023-10-06T03:17:49.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.225+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe54c066f30 msgr2=0x7fe54c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe54c066f30 0x7fe54c0693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe550006f00 tx=0x7fe550008040 comp rx=0 tx=0).stop 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 msgr2=0x7fe56013f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe56013f8e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe558013000 tx=0x7fe558019000 comp rx=0 tx=0).stop 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 shutdown_connections 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe56015d9a0 0x7fe56013f8e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe560069d50 0x7fe56016d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 --2- 172.21.15.82:0/1030824080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560142e90 0x7fe5600b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 >> 172.21.15.82:0/1030824080 conn(0x7fe5600ccfe0 msgr2=0x7fe5600b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 shutdown_connections 2023-10-06T03:17:49.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.226+0000 7fe565677700 1 -- 172.21.15.82:0/1030824080 wait complete. 2023-10-06T03:17:49.229 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T03:17:49.239 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T03:17:49.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:17:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.356+0000 7fb48643b700 1 Processor -- start 2023-10-06T03:17:49.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.356+0000 7fb48643b700 1 -- start start 2023-10-06T03:17:49.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb48643b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4800ccbe0 0x7fb4800b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb48643b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800d0f00 0x7fb4800ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb48643b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800cbed0 con 0x7fb4800b55b0 2023-10-06T03:17:49.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb48643b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb480159d40 con 0x7fb4800ccbe0 2023-10-06T03:17:49.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb48643b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800cc750 con 0x7fb4800d0f00 2023-10-06T03:17:49.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb4800b55b0 0x7fb4800cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39292/0 (socket says 172.21.15.82:39292) 2023-10-06T03:17:49.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47ffff700 1 -- 172.21.15.82:0/3909660959 learned_addr learned my addr 172.21.15.82:0/3909660959 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47f7fe700 1 --2- 172.21.15.82:0/3909660959 >> v2:172.21.15.82:3300/0 conn(0x7fb4800ccbe0 0x7fb4800b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb4849d8700 1 --2- 172.21.15.82:0/3909660959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800d0f00 0x7fb4800ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47effd700 1 -- 172.21.15.82:0/3909660959 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044008919 0 0) 0x7fb4800cbed0 con 0x7fb4800b55b0 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47effd700 1 -- 172.21.15.82:0/3909660959 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb468003570 con 0x7fb4800b55b0 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47f7fe700 1 -- 172.21.15.82:0/3909660959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800d0f00 msgr2=0x7fb4800ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47f7fe700 1 --2- 172.21.15.82:0/3909660959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800d0f00 0x7fb4800ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47f7fe700 1 -- 172.21.15.82:0/3909660959 >> v1:172.21.15.82:6789/0 conn(0x7fb4800b55b0 legacy=0x7fb4800cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47f7fe700 1 -- 172.21.15.82:0/3909660959 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800cd050 con 0x7fb4800ccbe0 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47f7fe700 1 --2- 172.21.15.82:0/3909660959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800ccbe0 0x7fb4800b5980 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb4740098e0 tx=0x7fb4740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c58e6f30fe27027 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47effd700 1 -- 172.21.15.82:0/3909660959 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474011630 con 0x7fb4800ccbe0 2023-10-06T03:17:49.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47effd700 1 -- 172.21.15.82:0/3909660959 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb474011790 con 0x7fb4800ccbe0 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.357+0000 7fb47effd700 1 -- 172.21.15.82:0/3909660959 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474011b30 con 0x7fb4800ccbe0 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.358+0000 7fb48643b700 1 -- 172.21.15.82:0/3909660959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800ccbe0 msgr2=0x7fb4800b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.358+0000 7fb48643b700 1 --2- 172.21.15.82:0/3909660959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800ccbe0 0x7fb4800b5980 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb4740098e0 tx=0x7fb4740091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.358+0000 7fb48643b700 1 -- 172.21.15.82:0/3909660959 shutdown_connections 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.358+0000 7fb48643b700 1 --2- 172.21.15.82:0/3909660959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800d0f00 0x7fb4800ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.358+0000 7fb48643b700 1 --2- 172.21.15.82:0/3909660959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800ccbe0 0x7fb4800b5980 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.358+0000 7fb48643b700 1 -- 172.21.15.82:0/3909660959 >> 172.21.15.82:0/3909660959 conn(0x7fb48008a050 msgr2=0x7fb480099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.358+0000 7fb48643b700 1 -- 172.21.15.82:0/3909660959 shutdown_connections 2023-10-06T03:17:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.358+0000 7fb48643b700 1 -- 172.21.15.82:0/3909660959 wait complete. 2023-10-06T03:17:49.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.359+0000 7fb48643b700 1 Processor -- start 2023-10-06T03:17:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb48643b700 1 -- start start 2023-10-06T03:17:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb48643b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800b55b0 0x7fb48015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb48643b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800ccbe0 0x7fb480157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb48643b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4800d0f00 0x7fb4800c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb48643b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48015e4c0 con 0x7fb4800b55b0 2023-10-06T03:17:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb48643b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48015d8b0 con 0x7fb4800d0f00 2023-10-06T03:17:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb48643b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48015db90 con 0x7fb4800ccbe0 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb47ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800b55b0 0x7fb48015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb47ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800b55b0 0x7fb48015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44078/0 (socket says 172.21.15.82:44078) 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.360+0000 7fb47ffff700 1 -- 172.21.15.82:0/616068078 learned_addr learned my addr 172.21.15.82:0/616068078 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb47ffff700 1 -- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800ccbe0 msgr2=0x7fb480157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb47f7fe700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800ccbe0 0x7fb480157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb4849d8700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4800d0f00 0x7fb4800c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb47ffff700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800ccbe0 0x7fb480157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb47ffff700 1 -- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4800d0f00 msgr2=0x7fb4800c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb47ffff700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4800d0f00 0x7fb4800c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb47ffff700 1 -- 172.21.15.82:0/616068078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474009420 con 0x7fb4800b55b0 2023-10-06T03:17:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb47f7fe700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4800ccbe0 0x7fb480157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb4849d8700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4800d0f00 0x7fb4800c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb47ffff700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800b55b0 0x7fb48015d2b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c790 tx=0x7fb470007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700072e0 con 0x7fb4800b55b0 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470007460 con 0x7fb4800b55b0 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48015de70 con 0x7fb4800b55b0 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700057f0 con 0x7fb4800b55b0 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.361+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4800c9610 con 0x7fb4800b55b0 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.362+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4800717c0 con 0x7fb4800b55b0 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.362+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb470005ba0 con 0x7fb4800b55b0 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb467fff700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb470083940 con 0x7fb4800b55b0 2023-10-06T03:17:49.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb467fff700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7fb46c06d3a0 0x7fb46c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 --> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb46c06fe80 con 0x7fb46c06d3a0 2023-10-06T03:17:49.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb470088240 con 0x7fb4800b55b0 2023-10-06T03:17:49.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb47f7fe700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb4849d8700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7fb46c06d3a0 0x7fb46c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb4849d8700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7fb46c06d3a0 0x7fb46c06f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.363+0000 7fb47f7fe700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb46c066f30 0x7fb46c0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb48016ce20 tx=0x7fb474017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.364+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 <== osd.1 v2:172.21.15.82:6808/90633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb46c06fe80 con 0x7fb46c06d3a0 2023-10-06T03:17:49.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.378+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 --> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb4800b5ec0 con 0x7fb46c06d3a0 2023-10-06T03:17:49.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb467fff700 1 -- 172.21.15.82:0/616068078 <== osd.1 v2:172.21.15.82:6808/90633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb4800b5ec0 con 0x7fb46c06d3a0 2023-10-06T03:17:49.381 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:49.381 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:17:49.381 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7fb46c06d3a0 msgr2=0x7fb46c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.82:6808/90633,v1:172.21.15.82:6809/90633] conn(0x7fb46c06d3a0 0x7fb46c06f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb46c066f30 msgr2=0x7fb46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fb46c066f30 0x7fb46c0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb48016ce20 tx=0x7fb474017000 comp rx=0 tx=0).stop 2023-10-06T03:17:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800b55b0 msgr2=0x7fb48015d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 --2- 172.21.15.82:0/616068078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4800b55b0 0x7fb48015d2b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c790 tx=0x7fb470007c60 comp rx=0 tx=0).stop 2023-10-06T03:17:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb4849d8700 1 -- 172.21.15.82:0/616068078 reap_dead start 2023-10-06T03:17:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 shutdown_connections 2023-10-06T03:17:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 >> 172.21.15.82:0/616068078 conn(0x7fb48008a050 msgr2=0x7fb480159180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 shutdown_connections 2023-10-06T03:17:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.379+0000 7fb48643b700 1 -- 172.21.15.82:0/616068078 wait complete. 2023-10-06T03:17:49.392 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T03:17:49.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.506+0000 7f4c64a5a700 1 Processor -- start 2023-10-06T03:17:49.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.506+0000 7f4c64a5a700 1 -- start start 2023-10-06T03:17:49.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c64a5a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c6015de80 0x7f4c600b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c64a5a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c60069380 con 0x7f4c60142e90 2023-10-06T03:17:49.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c64a5a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c60069f20 con 0x7f4c600b61d0 2023-10-06T03:17:49.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c64a5a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c60068770 con 0x7f4c6015de80 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c5effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c6015de80 0x7f4c600b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c5f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4c60142e90 0x7f4c60069810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39298/0 (socket says 172.21.15.82:39298) 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c5f7fe700 1 -- 172.21.15.82:0/4175606246 learned_addr learned my addr 172.21.15.82:0/4175606246 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c5effd700 1 -- 172.21.15.82:0/4175606246 >> v1:172.21.15.134:6789/0 conn(0x7f4c600b61d0 legacy=0x7f4c6015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c5effd700 1 -- 172.21.15.82:0/4175606246 >> v1:172.21.15.82:6789/0 conn(0x7f4c60142e90 legacy=0x7f4c60069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c5effd700 1 -- 172.21.15.82:0/4175606246 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60068a50 con 0x7f4c6015de80 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.507+0000 7f4c5e7fc700 1 -- 172.21.15.82:0/4175606246 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265518001 0 0) 0x7f4c60069380 con 0x7f4c60142e90 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c5effd700 1 --2- 172.21.15.82:0/4175606246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6015de80 0x7f4c600b5c90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4c540098e0 tx=0x7f4c540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bffcf1b5f05dcb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c5e7fc700 1 -- 172.21.15.82:0/4175606246 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54009e80 con 0x7f4c6015de80 2023-10-06T03:17:49.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c5e7fc700 1 -- 172.21.15.82:0/4175606246 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5400b860 con 0x7f4c6015de80 2023-10-06T03:17:49.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c5e7fc700 1 -- 172.21.15.82:0/4175606246 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5400bbe0 con 0x7f4c6015de80 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c64a5a700 1 -- 172.21.15.82:0/4175606246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6015de80 msgr2=0x7f4c600b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c64a5a700 1 --2- 172.21.15.82:0/4175606246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6015de80 0x7f4c600b5c90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4c540098e0 tx=0x7f4c540091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c64a5a700 1 -- 172.21.15.82:0/4175606246 shutdown_connections 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c64a5a700 1 --2- 172.21.15.82:0/4175606246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6015de80 0x7f4c600b5c90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c64a5a700 1 -- 172.21.15.82:0/4175606246 >> 172.21.15.82:0/4175606246 conn(0x7f4c600ccfe0 msgr2=0x7f4c600cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c64a5a700 1 -- 172.21.15.82:0/4175606246 shutdown_connections 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.508+0000 7f4c64a5a700 1 -- 172.21.15.82:0/4175606246 wait complete. 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.509+0000 7f4c64a5a700 1 Processor -- start 2023-10-06T03:17:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c64a5a700 1 -- start start 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c64a5a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c600b61d0 0x7f4c6015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c64a5a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c60142e90 0x7f4c600b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c64a5a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c6015de80 0x7f4c600b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c64a5a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6015b230 con 0x7f4c60142e90 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c64a5a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6015b510 con 0x7f4c600b61d0 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c64a5a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6015b7f0 con 0x7f4c6015de80 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c5effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c60142e90 0x7f4c600b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c5effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c60142e90 0x7f4c600b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44104/0 (socket says 172.21.15.82:44104) 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.510+0000 7f4c5effd700 1 -- 172.21.15.82:0/1816775223 learned_addr learned my addr 172.21.15.82:0/1816775223 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c5effd700 1 -- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c6015de80 msgr2=0x7f4c600b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c5effd700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c6015de80 0x7f4c600b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c5effd700 1 -- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c600b61d0 msgr2=0x7f4c6015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c5effd700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c600b61d0 0x7f4c6015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c5effd700 1 -- 172.21.15.82:0/1816775223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54009420 con 0x7f4c60142e90 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c5effd700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c60142e90 0x7f4c600b0fc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4c54013000 tx=0x7f4c54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c477fe700 1 -- 172.21.15.82:0/1816775223 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54011420 con 0x7f4c60142e90 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c477fe700 1 -- 172.21.15.82:0/1816775223 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54011580 con 0x7f4c60142e90 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6015bad0 con 0x7f4c60142e90 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c477fe700 1 -- 172.21.15.82:0/1816775223 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54011920 con 0x7f4c60142e90 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.511+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6015ad50 con 0x7f4c60142e90 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.512+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6015afa0 con 0x7f4c60142e90 2023-10-06T03:17:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.512+0000 7f4c477fe700 1 -- 172.21.15.82:0/1816775223 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c54011c90 con 0x7f4c60142e90 2023-10-06T03:17:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.513+0000 7f4c477fe700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c4c066f30 0x7f4c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.513+0000 7f4c477fe700 1 -- 172.21.15.82:0/1816775223 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4c54085d90 con 0x7f4c60142e90 2023-10-06T03:17:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.513+0000 7f4c5f7fe700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c4c066f30 0x7f4c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.513+0000 7f4c5f7fe700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c4c066f30 0x7f4c4c0693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c500011e0 tx=0x7f4c500079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.517+0000 7f4c477fe700 1 -- 172.21.15.82:0/1816775223 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c54053220 con 0x7f4c60142e90 2023-10-06T03:17:49.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.700+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c6015b680 con 0x7f4c4c066f30 2023-10-06T03:17:49.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.702+0000 7f4c477fe700 1 -- 172.21.15.82:0/1816775223 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4c6015b680 con 0x7f4c4c066f30 2023-10-06T03:17:49.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c4c066f30 msgr2=0x7f4c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c4c066f30 0x7f4c4c0693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c500011e0 tx=0x7f4c500079d0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c60142e90 msgr2=0x7f4c600b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c60142e90 0x7f4c600b0fc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4c54013000 tx=0x7f4c54017000 comp rx=0 tx=0).stop 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 shutdown_connections 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4c4c066f30 0x7f4c4c0693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c6015de80 0x7f4c600b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c600b61d0 0x7f4c6015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 --2- 172.21.15.82:0/1816775223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c60142e90 0x7f4c600b0fc0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 >> 172.21.15.82:0/1816775223 conn(0x7f4c600ccfe0 msgr2=0x7f4c60159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 shutdown_connections 2023-10-06T03:17:49.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.703+0000 7f4c64a5a700 1 -- 172.21.15.82:0/1816775223 wait complete. 2023-10-06T03:17:49.707 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T03:17:49.717 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T03:17:49.717 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:17:49.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.833+0000 7f23dcfdd700 1 Processor -- start 2023-10-06T03:17:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.833+0000 7f23dcfdd700 1 -- start start 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23dcfdd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23d80ccbe0 0x7f23d80b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23dcfdd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f23d80d0f00 0x7f23d80ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23dcfdd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d80cbed0 con 0x7f23d80b55b0 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23dcfdd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d8159d40 con 0x7f23d80ccbe0 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23dcfdd700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d80cc750 con 0x7f23d80d0f00 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d5d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23d80ccbe0 0x7f23d80b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d5d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23d80ccbe0 0x7f23d80b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44114/0 (socket says 172.21.15.82:44114) 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d5d9b700 1 -- 172.21.15.82:0/341281694 learned_addr learned my addr 172.21.15.82:0/341281694 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d6d9d700 1 --2- 172.21.15.82:0/341281694 >> v2:172.21.15.134:3300/0 conn(0x7f23d80d0f00 0x7f23d80ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d5d9b700 1 -- 172.21.15.82:0/341281694 >> v2:172.21.15.134:3300/0 conn(0x7f23d80d0f00 msgr2=0x7f23d80ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d5d9b700 1 --2- 172.21.15.82:0/341281694 >> v2:172.21.15.134:3300/0 conn(0x7f23d80d0f00 0x7f23d80ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d5d9b700 1 -- 172.21.15.82:0/341281694 >> v1:172.21.15.134:6789/0 conn(0x7f23d80b55b0 legacy=0x7f23d80cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d5d9b700 1 -- 172.21.15.82:0/341281694 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80cd050 con 0x7f23d80ccbe0 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d5d9b700 1 --2- 172.21.15.82:0/341281694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 0x7f23d80b5980 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f23d8089aa0 tx=0x7f23cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ed1eeecf5f9327 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d559a700 1 -- 172.21.15.82:0/341281694 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00b820 con 0x7f23d80ccbe0 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d559a700 1 -- 172.21.15.82:0/341281694 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00b980 con 0x7f23d80ccbe0 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.834+0000 7f23d559a700 1 -- 172.21.15.82:0/341281694 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00bd40 con 0x7f23d80ccbe0 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.835+0000 7f23dcfdd700 1 -- 172.21.15.82:0/341281694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 msgr2=0x7f23d80b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.835+0000 7f23dcfdd700 1 --2- 172.21.15.82:0/341281694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 0x7f23d80b5980 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f23d8089aa0 tx=0x7f23cc009250 comp rx=0 tx=0).stop 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.835+0000 7f23dcfdd700 1 -- 172.21.15.82:0/341281694 shutdown_connections 2023-10-06T03:17:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.835+0000 7f23dcfdd700 1 --2- 172.21.15.82:0/341281694 >> v2:172.21.15.134:3300/0 conn(0x7f23d80d0f00 0x7f23d80ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.835+0000 7f23dcfdd700 1 --2- 172.21.15.82:0/341281694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 0x7f23d80b5980 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.835+0000 7f23dcfdd700 1 -- 172.21.15.82:0/341281694 >> 172.21.15.82:0/341281694 conn(0x7f23d808a050 msgr2=0x7f23d8099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.835+0000 7f23dcfdd700 1 -- 172.21.15.82:0/341281694 shutdown_connections 2023-10-06T03:17:49.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.835+0000 7f23dcfdd700 1 -- 172.21.15.82:0/341281694 wait complete. 2023-10-06T03:17:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.836+0000 7f23dcfdd700 1 Processor -- start 2023-10-06T03:17:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.836+0000 7f23dcfdd700 1 -- start start 2023-10-06T03:17:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23dcfdd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23d80b55b0 0x7f23d80b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23dcfdd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 0x7f23d815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23dcfdd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23d80d0f00 0x7f23d80b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23dcfdd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80b25a0 con 0x7f23d80ccbe0 2023-10-06T03:17:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23dcfdd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d815b7e0 con 0x7f23d80d0f00 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23dcfdd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80b1990 con 0x7f23d80b55b0 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 0x7f23d815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 0x7f23d815b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44130/0 (socket says 172.21.15.82:44130) 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 -- 172.21.15.82:0/2633224729 learned_addr learned my addr 172.21.15.82:0/2633224729 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d6d9d700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23d80d0f00 0x7f23d80b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d659c700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23d80b55b0 0x7f23d80b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 -- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23d80b55b0 msgr2=0x7f23d80b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23d80b55b0 0x7f23d80b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 -- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23d80d0f00 msgr2=0x7f23d80b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23d80d0f00 0x7f23d80b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 -- 172.21.15.82:0/2633224729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0094f0 con 0x7f23d80ccbe0 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d659c700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23d80b55b0 0x7f23d80b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23d5d9b700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 0x7f23d815b2a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c010 tx=0x7f23cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc011c60 con 0x7f23d80ccbe0 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc020070 con 0x7f23d80ccbe0 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d80b1c70 con 0x7f23d80ccbe0 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc01c450 con 0x7f23d80ccbe0 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.837+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d80b2230 con 0x7f23d80ccbe0 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.838+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23d80717c0 con 0x7f23d80ccbe0 2023-10-06T03:17:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.839+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23cc022030 con 0x7f23d80ccbe0 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.839+0000 7f23c67fc700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f23b8066f30 0x7f23b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.839+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f23cc0868c0 con 0x7f23d80ccbe0 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.839+0000 7f23c67fc700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f23b806d3a0 0x7f23b806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.839+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 --> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23b806fe80 con 0x7f23b806d3a0 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.839+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23cc086c90 con 0x7f23d80ccbe0 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.839+0000 7f23d659c700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f23b8066f30 0x7f23b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.839+0000 7f23d6d9d700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f23b806d3a0 0x7f23b806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.840+0000 7f23d6d9d700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f23b806d3a0 0x7f23b806f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.840+0000 7f23d659c700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f23b8066f30 0x7f23b80693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f23c80099f0 tx=0x7f23c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.840+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 <== osd.2 v2:172.21.15.82:6824/90644 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f23b806fe80 con 0x7f23b806d3a0 2023-10-06T03:17:49.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 --> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f23d80ad2f0 con 0x7f23b806d3a0 2023-10-06T03:17:49.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23c67fc700 1 -- 172.21.15.82:0/2633224729 <== osd.2 v2:172.21.15.82:6824/90644 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f23d80ad2f0 con 0x7f23b806d3a0 2023-10-06T03:17:49.856 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:49.856 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:17:49.856 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f23b806d3a0 msgr2=0x7f23b806f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.82:6824/90644,v1:172.21.15.82:6825/90644] conn(0x7f23b806d3a0 0x7f23b806f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f23b8066f30 msgr2=0x7f23b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f23b8066f30 0x7f23b80693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f23c80099f0 tx=0x7f23c8008040 comp rx=0 tx=0).stop 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 msgr2=0x7f23d815b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 --2- 172.21.15.82:0/2633224729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d80ccbe0 0x7f23d815b2a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c010 tx=0x7f23cc016000 comp rx=0 tx=0).stop 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23d6d9d700 1 -- 172.21.15.82:0/2633224729 reap_dead start 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 shutdown_connections 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 >> 172.21.15.82:0/2633224729 conn(0x7f23d808a050 msgr2=0x7f23d8158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 shutdown_connections 2023-10-06T03:17:49.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.854+0000 7f23dcfdd700 1 -- 172.21.15.82:0/2633224729 wait complete. 2023-10-06T03:17:49.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T03:17:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.980+0000 7fc917f57700 1 Processor -- start 2023-10-06T03:17:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.980+0000 7fc917f57700 1 -- start start 2023-10-06T03:17:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.981+0000 7fc917f57700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc910159500 0x7fc9101598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.981+0000 7fc917f57700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc91015dab0 0x7fc9100cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.981+0000 7fc917f57700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9100b1110 con 0x7fc9100b3fd0 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.981+0000 7fc917f57700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100b13b0 con 0x7fc910159500 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.981+0000 7fc917f57700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100b1690 con 0x7fc91015dab0 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.981+0000 7fc915cf3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc910159500 0x7fc9101598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.981+0000 7fc9154f2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc9100b3fd0 0x7fc91015d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39304/0 (socket says 172.21.15.82:39304) 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.981+0000 7fc9154f2700 1 -- 172.21.15.82:0/1606028148 learned_addr learned my addr 172.21.15.82:0/1606028148 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc9164f4700 1 --2- 172.21.15.82:0/1606028148 >> v2:172.21.15.134:3300/0 conn(0x7fc91015dab0 0x7fc9100cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc915cf3700 1 -- 172.21.15.82:0/1606028148 >> v2:172.21.15.134:3300/0 conn(0x7fc91015dab0 msgr2=0x7fc9100cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc915cf3700 1 --2- 172.21.15.82:0/1606028148 >> v2:172.21.15.134:3300/0 conn(0x7fc91015dab0 0x7fc9100cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc915cf3700 1 -- 172.21.15.82:0/1606028148 >> v1:172.21.15.82:6789/0 conn(0x7fc9100b3fd0 legacy=0x7fc91015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc915cf3700 1 -- 172.21.15.82:0/1606028148 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100b1970 con 0x7fc910159500 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc914cf1700 1 -- 172.21.15.82:0/1606028148 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756881366 0 0) 0x7fc9100b1110 con 0x7fc9100b3fd0 2023-10-06T03:17:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc915cf3700 1 --2- 172.21.15.82:0/1606028148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc910159500 0x7fc9101598d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc91006a270 tx=0x7fc90c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237a17fb3b91073e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc914cf1700 1 -- 172.21.15.82:0/1606028148 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00e070 con 0x7fc910159500 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc914cf1700 1 -- 172.21.15.82:0/1606028148 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c00bc30 con 0x7fc910159500 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc914cf1700 1 -- 172.21.15.82:0/1606028148 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c012430 con 0x7fc910159500 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc917f57700 1 -- 172.21.15.82:0/1606028148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc910159500 msgr2=0x7fc9101598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc917f57700 1 --2- 172.21.15.82:0/1606028148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc910159500 0x7fc9101598d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc91006a270 tx=0x7fc90c009780 comp rx=0 tx=0).stop 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc917f57700 1 -- 172.21.15.82:0/1606028148 shutdown_connections 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc917f57700 1 --2- 172.21.15.82:0/1606028148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc910159500 0x7fc9101598d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc917f57700 1 --2- 172.21.15.82:0/1606028148 >> v2:172.21.15.134:3300/0 conn(0x7fc91015dab0 0x7fc9100cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.982+0000 7fc917f57700 1 -- 172.21.15.82:0/1606028148 >> 172.21.15.82:0/1606028148 conn(0x7fc910067630 msgr2=0x7fc910069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.983+0000 7fc917f57700 1 -- 172.21.15.82:0/1606028148 shutdown_connections 2023-10-06T03:17:49.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.983+0000 7fc917f57700 1 -- 172.21.15.82:0/1606028148 wait complete. 2023-10-06T03:17:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc917f57700 1 Processor -- start 2023-10-06T03:17:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc917f57700 1 -- start start 2023-10-06T03:17:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc917f57700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9100b3fd0 0x7fc91014c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc917f57700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc910159500 0x7fc91015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc917f57700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc91015dab0 0x7fc91015cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc917f57700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91015be80 con 0x7fc91015dab0 2023-10-06T03:17:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc917f57700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91015a050 con 0x7fc9100b3fd0 2023-10-06T03:17:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc917f57700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91015bba0 con 0x7fc910159500 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc9164f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc91015dab0 0x7fc91015cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc9164f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc91015dab0 0x7fc91015cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44150/0 (socket says 172.21.15.82:44150) 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.984+0000 7fc9164f4700 1 -- 172.21.15.82:0/2563445427 learned_addr learned my addr 172.21.15.82:0/2563445427 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc9154f2700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc910159500 0x7fc91015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc9164f4700 1 -- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc910159500 msgr2=0x7fc91015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc915cf3700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9100b3fd0 0x7fc91014c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc9164f4700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc910159500 0x7fc91015a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc9164f4700 1 -- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9100b3fd0 msgr2=0x7fc91014c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc9164f4700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9100b3fd0 0x7fc91014c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc9164f4700 1 -- 172.21.15.82:0/2563445427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c009a20 con 0x7fc91015dab0 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc9164f4700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc91015dab0 0x7fc91015cc40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc90800d890 tx=0x7fc908008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc905ffb700 1 -- 172.21.15.82:0/2563445427 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9080125f0 con 0x7fc91015dab0 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc905ffb700 1 -- 172.21.15.82:0/2563445427 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908012750 con 0x7fc91015dab0 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc910159a00 con 0x7fc91015dab0 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc905ffb700 1 -- 172.21.15.82:0/2563445427 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908012af0 con 0x7fc91015dab0 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.985+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91015aa20 con 0x7fc91015dab0 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.986+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc910064050 con 0x7fc91015dab0 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.987+0000 7fc905ffb700 1 -- 172.21.15.82:0/2563445427 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc90801e460 con 0x7fc91015dab0 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.987+0000 7fc905ffb700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8f4066f30 0x7fc8f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.987+0000 7fc905ffb700 1 -- 172.21.15.82:0/2563445427 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc908084970 con 0x7fc91015dab0 2023-10-06T03:17:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.987+0000 7fc915cf3700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8f4066f30 0x7fc8f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.988+0000 7fc915cf3700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8f4066f30 0x7fc8f40693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc91006a270 tx=0x7fc90c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:49.991+0000 7fc905ffb700 1 -- 172.21.15.82:0/2563445427 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc908051d80 con 0x7fc91015dab0 2023-10-06T03:17:50.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.174+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc91015a190 con 0x7fc8f4066f30 2023-10-06T03:17:50.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.175+0000 7fc905ffb700 1 -- 172.21.15.82:0/2563445427 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc91015a190 con 0x7fc8f4066f30 2023-10-06T03:17:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8f4066f30 msgr2=0x7fc8f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8f4066f30 0x7fc8f40693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc91006a270 tx=0x7fc90c019000 comp rx=0 tx=0).stop 2023-10-06T03:17:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc91015dab0 msgr2=0x7fc91015cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc91015dab0 0x7fc91015cc40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc90800d890 tx=0x7fc908008040 comp rx=0 tx=0).stop 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 shutdown_connections 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc91015dab0 0x7fc91015cc40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9100b3fd0 0x7fc91014c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fc8f4066f30 0x7fc8f40693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 --2- 172.21.15.82:0/2563445427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc910159500 0x7fc91015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 >> 172.21.15.82:0/2563445427 conn(0x7fc910067630 msgr2=0x7fc91014d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 shutdown_connections 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.177+0000 7fc917f57700 1 -- 172.21.15.82:0/2563445427 wait complete. 2023-10-06T03:17:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T03:17:50.191 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T03:17:50.191 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:17:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.307+0000 7f603dd24700 1 Processor -- start 2023-10-06T03:17:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.307+0000 7f603dd24700 1 -- start start 2023-10-06T03:17:50.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f603dd24700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60380b55b0 0x7f60380ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f603dd24700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60380cf800 0x7f60380b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f603dd24700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380cbed0 con 0x7f60380d0f00 2023-10-06T03:17:50.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f603dd24700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6038159d40 con 0x7f60380b55b0 2023-10-06T03:17:50.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f603dd24700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60380cc750 con 0x7f60380cf800 2023-10-06T03:17:50.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f6037fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f60380d0f00 0x7f60380ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39320/0 (socket says 172.21.15.82:39320) 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60377fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f60380b55b0 0x7f60380ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f6037fff700 1 -- 172.21.15.82:0/100184262 learned_addr learned my addr 172.21.15.82:0/100184262 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f6036ffd700 1 --2- 172.21.15.82:0/100184262 >> v2:172.21.15.134:3300/0 conn(0x7f60380cf800 0x7f60380b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60377fe700 1 -- 172.21.15.82:0/100184262 >> v2:172.21.15.134:3300/0 conn(0x7f60380cf800 msgr2=0x7f60380b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60377fe700 1 --2- 172.21.15.82:0/100184262 >> v2:172.21.15.134:3300/0 conn(0x7f60380cf800 0x7f60380b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60377fe700 1 -- 172.21.15.82:0/100184262 >> v1:172.21.15.82:6789/0 conn(0x7f60380d0f00 legacy=0x7f60380ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60367fc700 1 -- 172.21.15.82:0/100184262 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783678527 0 0) 0x7f60380cbed0 con 0x7f60380d0f00 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60377fe700 1 -- 172.21.15.82:0/100184262 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60380b5ec0 con 0x7f60380b55b0 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f6036ffd700 1 --2- 172.21.15.82:0/100184262 >> v2:172.21.15.134:3300/0 conn(0x7f60380cf800 0x7f60380b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60377fe700 1 --2- 172.21.15.82:0/100184262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380b55b0 0x7f60380ccbe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f60380b66a0 tx=0x7f6028009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec065b777ad0dfc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60367fc700 1 -- 172.21.15.82:0/100184262 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028005c10 con 0x7f60380b55b0 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60367fc700 1 -- 172.21.15.82:0/100184262 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6028005d70 con 0x7f60380b55b0 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.308+0000 7f60367fc700 1 -- 172.21.15.82:0/100184262 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028006280 con 0x7f60380b55b0 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.309+0000 7f603dd24700 1 -- 172.21.15.82:0/100184262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380b55b0 msgr2=0x7f60380ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.309+0000 7f603dd24700 1 --2- 172.21.15.82:0/100184262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380b55b0 0x7f60380ccbe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f60380b66a0 tx=0x7f6028009120 comp rx=0 tx=0).stop 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.309+0000 7f603dd24700 1 -- 172.21.15.82:0/100184262 shutdown_connections 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.309+0000 7f603dd24700 1 --2- 172.21.15.82:0/100184262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380b55b0 0x7f60380ccbe0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.309+0000 7f603dd24700 1 --2- 172.21.15.82:0/100184262 >> v2:172.21.15.134:3300/0 conn(0x7f60380cf800 0x7f60380b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.309+0000 7f603dd24700 1 -- 172.21.15.82:0/100184262 >> 172.21.15.82:0/100184262 conn(0x7f603808a050 msgr2=0x7f6038099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.309+0000 7f603dd24700 1 -- 172.21.15.82:0/100184262 shutdown_connections 2023-10-06T03:17:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.309+0000 7f603dd24700 1 -- 172.21.15.82:0/100184262 wait complete. 2023-10-06T03:17:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.310+0000 7f603dd24700 1 Processor -- start 2023-10-06T03:17:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.310+0000 7f603dd24700 1 -- start start 2023-10-06T03:17:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f603dd24700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60380b55b0 0x7f60380b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f603dd24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380cf800 0x7f60380c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f603dd24700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60380d0f00 0x7f60380c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f603dd24700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603815cf30 con 0x7f60380cf800 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f603dd24700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380b2340 con 0x7f60380b55b0 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f603dd24700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60380b25e0 con 0x7f60380d0f00 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380cf800 0x7f60380c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380cf800 0x7f60380c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44156/0 (socket says 172.21.15.82:44156) 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 -- 172.21.15.82:0/2171811219 learned_addr learned my addr 172.21.15.82:0/2171811219 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 -- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60380d0f00 msgr2=0x7f60380c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60380d0f00 0x7f60380c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 -- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60380b55b0 msgr2=0x7f60380b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60380b55b0 0x7f60380b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 -- 172.21.15.82:0/2171811219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280093c0 con 0x7f60380cf800 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.311+0000 7f6036ffd700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380cf800 0x7f60380c8720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f602c00e8d0 tx=0x7f602c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.312+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00ee70 con 0x7f60380cf800 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.312+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00c5e0 con 0x7f60380cf800 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.312+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00c980 con 0x7f60380cf800 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.312+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60380b28c0 con 0x7f60380cf800 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.312+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603815cbc0 con 0x7f60380cf800 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.312+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60380717c0 con 0x7f60380cf800 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.313+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f602c025480 con 0x7f60380cf800 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.313+0000 7f601f7fe700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6024066f30 0x7f60240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.313+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f602c0845a0 con 0x7f60380cf800 2023-10-06T03:17:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.314+0000 7f601f7fe700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7f602406d3a0 0x7f602406f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.314+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 --> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f602406fe80 con 0x7f602406d3a0 2023-10-06T03:17:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.314+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f602c084970 con 0x7f60380cf800 2023-10-06T03:17:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.314+0000 7f6037fff700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7f602406d3a0 0x7f602406f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.314+0000 7f60377fe700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6024066f30 0x7f60240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.314+0000 7f6037fff700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7f602406d3a0 0x7f602406f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.314+0000 7f60377fe700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6024066f30 0x7f60240693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f60380ca2e0 tx=0x7f6028016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.315+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 <== osd.3 v2:172.21.15.82:6800/90631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f602406fe80 con 0x7f602406d3a0 2023-10-06T03:17:50.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.328+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 --> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60380cffe0 con 0x7f602406d3a0 2023-10-06T03:17:50.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.328+0000 7f601f7fe700 1 -- 172.21.15.82:0/2171811219 <== osd.3 v2:172.21.15.82:6800/90631 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f60380cffe0 con 0x7f602406d3a0 2023-10-06T03:17:50.330 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:50.330 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:17:50.331 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:50.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.328+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7f602406d3a0 msgr2=0x7f602406f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.328+0000 7f603dd24700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.82:6800/90631,v1:172.21.15.82:6801/90631] conn(0x7f602406d3a0 0x7f602406f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6024066f30 msgr2=0x7f60240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f603dd24700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f6024066f30 0x7f60240693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f60380ca2e0 tx=0x7f6028016000 comp rx=0 tx=0).stop 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380cf800 msgr2=0x7f60380c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f603dd24700 1 --2- 172.21.15.82:0/2171811219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60380cf800 0x7f60380c8720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f602c00e8d0 tx=0x7f602c008040 comp rx=0 tx=0).stop 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f6037fff700 1 -- 172.21.15.82:0/2171811219 reap_dead start 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 shutdown_connections 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 >> 172.21.15.82:0/2171811219 conn(0x7f603808a050 msgr2=0x7f6038158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 shutdown_connections 2023-10-06T03:17:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.329+0000 7f603dd24700 1 -- 172.21.15.82:0/2171811219 wait complete. 2023-10-06T03:17:50.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T03:17:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.455+0000 7f84365fc700 1 Processor -- start 2023-10-06T03:17:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.455+0000 7f84365fc700 1 -- start start 2023-10-06T03:17:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.456+0000 7f84365fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8430159500 0x7f84301598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.456+0000 7f84365fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f84300b3fd0 0x7f843015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.456+0000 7f84365fc700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843015dd20 con 0x7f843015d8e0 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.456+0000 7f84365fc700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84300b1110 con 0x7f8430159500 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.456+0000 7f84365fc700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84300b13b0 con 0x7f84300b3fd0 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.456+0000 7f842ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8430159500 0x7f84301598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.456+0000 7f842ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8430159500 0x7f84301598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44166/0 (socket says 172.21.15.82:44166) 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.456+0000 7f842ffff700 1 -- 172.21.15.82:0/485471515 learned_addr learned my addr 172.21.15.82:0/485471515 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842f7fe700 1 --2- 172.21.15.82:0/485471515 >> v2:172.21.15.134:3300/0 conn(0x7f84300b3fd0 0x7f843015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842ffff700 1 -- 172.21.15.82:0/485471515 >> v2:172.21.15.134:3300/0 conn(0x7f84300b3fd0 msgr2=0x7f843015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842ffff700 1 --2- 172.21.15.82:0/485471515 >> v2:172.21.15.134:3300/0 conn(0x7f84300b3fd0 0x7f843015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842ffff700 1 -- 172.21.15.82:0/485471515 >> v1:172.21.15.134:6789/0 conn(0x7f843015d8e0 legacy=0x7f84300cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842ffff700 1 -- 172.21.15.82:0/485471515 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84300b1690 con 0x7f8430159500 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842ffff700 1 --2- 172.21.15.82:0/485471515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8430159500 0x7f84301598d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8430063430 tx=0x7f8420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f196ce9f8157228d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842effd700 1 -- 172.21.15.82:0/485471515 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842000b860 con 0x7f8430159500 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842effd700 1 -- 172.21.15.82:0/485471515 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842000b9c0 con 0x7f8430159500 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f842effd700 1 -- 172.21.15.82:0/485471515 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842000bd60 con 0x7f8430159500 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f84365fc700 1 -- 172.21.15.82:0/485471515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8430159500 msgr2=0x7f84301598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f84365fc700 1 --2- 172.21.15.82:0/485471515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8430159500 0x7f84301598d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8430063430 tx=0x7f8420009250 comp rx=0 tx=0).stop 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f84365fc700 1 -- 172.21.15.82:0/485471515 shutdown_connections 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f84365fc700 1 --2- 172.21.15.82:0/485471515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8430159500 0x7f84301598d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.457+0000 7f84365fc700 1 --2- 172.21.15.82:0/485471515 >> v2:172.21.15.134:3300/0 conn(0x7f84300b3fd0 0x7f843015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.458+0000 7f84365fc700 1 -- 172.21.15.82:0/485471515 >> 172.21.15.82:0/485471515 conn(0x7f8430067630 msgr2=0x7f8430069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:50.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.458+0000 7f84365fc700 1 -- 172.21.15.82:0/485471515 shutdown_connections 2023-10-06T03:17:50.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.458+0000 7f84365fc700 1 -- 172.21.15.82:0/485471515 wait complete. 2023-10-06T03:17:50.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.459+0000 7f84365fc700 1 Processor -- start 2023-10-06T03:17:50.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.459+0000 7f84365fc700 1 -- start start 2023-10-06T03:17:50.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f84365fc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84300b3fd0 0x7f8430068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f84365fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8430159500 0x7f843015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f84365fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f843015d8e0 0x7f8430169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f84365fc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430068b40 con 0x7f843015d8e0 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f84365fc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430067f30 con 0x7f8430159500 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f84365fc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8430068210 con 0x7f84300b3fd0 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f843015d8e0 0x7f8430169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f843015d8e0 0x7f8430169d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44178/0 (socket says 172.21.15.82:44178) 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 -- 172.21.15.82:0/373675211 learned_addr learned my addr 172.21.15.82:0/373675211 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f842ffff700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84300b3fd0 0x7f8430068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f842f7fe700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8430159500 0x7f843015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 -- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84300b3fd0 msgr2=0x7f8430068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84300b3fd0 0x7f8430068fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 -- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8430159500 msgr2=0x7f843015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8430159500 0x7f843015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 -- 172.21.15.82:0/373675211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200094f0 con 0x7f843015d8e0 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8434b99700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f843015d8e0 0x7f8430169d00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f842800c840 tx=0x7f8428001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8417fff700 1 -- 172.21.15.82:0/373675211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428012630 con 0x7f843015d8e0 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8417fff700 1 -- 172.21.15.82:0/373675211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84280127b0 con 0x7f843015d8e0 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84300684f0 con 0x7f843015d8e0 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f8417fff700 1 -- 172.21.15.82:0/373675211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428012b70 con 0x7f843015d8e0 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.460+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843015b890 con 0x7f843015d8e0 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.461+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8430064050 con 0x7f843015d8e0 2023-10-06T03:17:50.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.462+0000 7f8417fff700 1 -- 172.21.15.82:0/373675211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f842801a3a0 con 0x7f843015d8e0 2023-10-06T03:17:50.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.462+0000 7f8417fff700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f841c066f30 0x7f841c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.462+0000 7f8417fff700 1 -- 172.21.15.82:0/373675211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f84280844f0 con 0x7f843015d8e0 2023-10-06T03:17:50.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.462+0000 7f842ffff700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f841c066f30 0x7f841c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.463+0000 7f842ffff700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f841c066f30 0x7f841c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8430063430 tx=0x7f8420017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.466+0000 7f8417fff700 1 -- 172.21.15.82:0/373675211 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8428051900 con 0x7f843015d8e0 2023-10-06T03:17:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.648+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f84300b1970 con 0x7f841c066f30 2023-10-06T03:17:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.649+0000 7f8417fff700 1 -- 172.21.15.82:0/373675211 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f84300b1970 con 0x7f841c066f30 2023-10-06T03:17:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f841c066f30 msgr2=0x7f841c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f841c066f30 0x7f841c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8430063430 tx=0x7f8420017000 comp rx=0 tx=0).stop 2023-10-06T03:17:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f843015d8e0 msgr2=0x7f8430169d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f843015d8e0 0x7f8430169d00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f842800c840 tx=0x7f8428001670 comp rx=0 tx=0).stop 2023-10-06T03:17:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 shutdown_connections 2023-10-06T03:17:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f843015d8e0 0x7f8430169d00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f841c066f30 0x7f841c0693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84300b3fd0 0x7f8430068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 --2- 172.21.15.82:0/373675211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8430159500 0x7f843015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 >> 172.21.15.82:0/373675211 conn(0x7f8430067630 msgr2=0x7f843014e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 shutdown_connections 2023-10-06T03:17:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.651+0000 7f84365fc700 1 -- 172.21.15.82:0/373675211 wait complete. 2023-10-06T03:17:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T03:17:50.664 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T03:17:50.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:17:50.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.781+0000 7f029d2a9700 1 Processor -- start 2023-10-06T03:17:50.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.781+0000 7f029d2a9700 1 -- start start 2023-10-06T03:17:50.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f029d2a9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf810 0x7f02980cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f029d2a9700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02980cb670 con 0x7f02980cbb00 2023-10-06T03:17:50.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f029d2a9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02980cce90 con 0x7f02980cf440 2023-10-06T03:17:50.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f029d2a9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02980cbf60 con 0x7f02980cf810 2023-10-06T03:17:50.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f029caa8700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f02980cbb00 0x7f0298158e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39324/0 (socket says 172.21.15.82:39324) 2023-10-06T03:17:50.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f029caa8700 1 -- 172.21.15.82:0/3204372109 learned_addr learned my addr 172.21.15.82:0/3204372109 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f02977fe700 1 --2- 172.21.15.82:0/3204372109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf810 0x7f02980cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f0296ffd700 1 -- 172.21.15.82:0/3204372109 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725424576 0 0) 0x7f02980cb670 con 0x7f02980cbb00 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f0296ffd700 1 -- 172.21.15.82:0/3204372109 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0280003570 con 0x7f02980cbb00 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f0296ffd700 1 -- 172.21.15.82:0/3204372109 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831048832 0 0) 0x7f02980cce90 con 0x7f02980cf440 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f0296ffd700 1 -- 172.21.15.82:0/3204372109 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02980cb670 con 0x7f02980cf440 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f02977fe700 1 -- 172.21.15.82:0/3204372109 >> v1:172.21.15.134:6789/0 conn(0x7f02980cf440 legacy=0x7f02980cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f02977fe700 1 -- 172.21.15.82:0/3204372109 >> v1:172.21.15.82:6789/0 conn(0x7f02980cbb00 legacy=0x7f0298158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.782+0000 7f02977fe700 1 -- 172.21.15.82:0/3204372109 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02980cad80 con 0x7f02980cf810 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f02977fe700 1 --2- 172.21.15.82:0/3204372109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf810 0x7f02980cc850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f028c009910 tx=0x7f028c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc7b7fb9ae12eef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f0296ffd700 1 -- 172.21.15.82:0/3204372109 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c011630 con 0x7f02980cf810 2023-10-06T03:17:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f0296ffd700 1 -- 172.21.15.82:0/3204372109 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c011790 con 0x7f02980cf810 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f0296ffd700 1 -- 172.21.15.82:0/3204372109 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c011b30 con 0x7f02980cf810 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f029d2a9700 1 -- 172.21.15.82:0/3204372109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf810 msgr2=0x7f02980cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f029d2a9700 1 --2- 172.21.15.82:0/3204372109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf810 0x7f02980cc850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f028c009910 tx=0x7f028c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f029d2a9700 1 -- 172.21.15.82:0/3204372109 shutdown_connections 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f029d2a9700 1 --2- 172.21.15.82:0/3204372109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf810 0x7f02980cc850 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f029d2a9700 1 -- 172.21.15.82:0/3204372109 >> 172.21.15.82:0/3204372109 conn(0x7f02980cd080 msgr2=0x7f02980cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f029d2a9700 1 -- 172.21.15.82:0/3204372109 shutdown_connections 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.783+0000 7f029d2a9700 1 -- 172.21.15.82:0/3204372109 wait complete. 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.784+0000 7f029d2a9700 1 Processor -- start 2023-10-06T03:17:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.785+0000 7f029d2a9700 1 -- start start 2023-10-06T03:17:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.785+0000 7f029d2a9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980cbb00 0x7f029814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.785+0000 7f029d2a9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf440 0x7f029815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.785+0000 7f029d2a9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02980cf810 0x7f029815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.785+0000 7f029d2a9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029815a290 con 0x7f02980cf810 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.785+0000 7f029d2a9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02980c9eb0 con 0x7f02980cbb00 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.785+0000 7f029d2a9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029814d760 con 0x7f02980cf440 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.785+0000 7f029caa8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02980cf810 0x7f029815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029caa8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02980cf810 0x7f029815aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44184/0 (socket says 172.21.15.82:44184) 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029caa8700 1 -- 172.21.15.82:0/3788242718 learned_addr learned my addr 172.21.15.82:0/3788242718 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f02977fe700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf440 0x7f029815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f0297fff700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980cbb00 0x7f029814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029caa8700 1 -- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf440 msgr2=0x7f029815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029caa8700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf440 0x7f029815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029caa8700 1 -- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980cbb00 msgr2=0x7f029814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029caa8700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980cbb00 0x7f029814d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029caa8700 1 -- 172.21.15.82:0/3788242718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c009420 con 0x7f02980cf810 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f0297fff700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02980cbb00 0x7f029814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f02977fe700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02980cf440 0x7f029815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029caa8700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02980cf810 0x7f029815aa40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f029000cc90 tx=0x7f0290001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029000cea0 con 0x7f02980cf810 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029000ab30 con 0x7f02980cf810 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02980c9580 con 0x7f02980cf810 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900070f0 con 0x7f02980cf810 2023-10-06T03:17:50.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.786+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02980c9b40 con 0x7f02980cf810 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.787+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0298064050 con 0x7f02980cf810 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.787+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0290007520 con 0x7f02980cf810 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.788+0000 7f027ffff700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0284066f30 0x7f02840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.788+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f02900847a0 con 0x7f02980cf810 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.788+0000 7f027ffff700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f028406d3a0 0x7f028406f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.788+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 --> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f028406fe80 con 0x7f028406d3a0 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.788+0000 7f0297fff700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0284066f30 0x7f02840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.788+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0290086de0 con 0x7f02980cf810 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.788+0000 7f02977fe700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f028406d3a0 0x7f028406f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.788+0000 7f0297fff700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0284066f30 0x7f02840693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0288003990 tx=0x7f0288009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.789+0000 7f02977fe700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f028406d3a0 0x7f028406f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.789+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 <== osd.4 v2:172.21.15.134:6800/90846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f028406fe80 con 0x7f028406d3a0 2023-10-06T03:17:50.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.803+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 --> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02980cb020 con 0x7f028406d3a0 2023-10-06T03:17:50.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.803+0000 7f027ffff700 1 -- 172.21.15.82:0/3788242718 <== osd.4 v2:172.21.15.134:6800/90846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f02980cb020 con 0x7f028406d3a0 2023-10-06T03:17:50.805 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:50.805 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:17:50.805 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:50.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.803+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f028406d3a0 msgr2=0x7f028406f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.803+0000 7f029d2a9700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6800/90846,v1:172.21.15.134:6801/90846] conn(0x7f028406d3a0 0x7f028406f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.803+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0284066f30 msgr2=0x7f02840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.803+0000 7f029d2a9700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f0284066f30 0x7f02840693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0288003990 tx=0x7f0288009040 comp rx=0 tx=0).stop 2023-10-06T03:17:50.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.804+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02980cf810 msgr2=0x7f029815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.804+0000 7f029d2a9700 1 --2- 172.21.15.82:0/3788242718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02980cf810 0x7f029815aa40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f029000cc90 tx=0x7f0290001ae0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.804+0000 7f029caa8700 1 -- 172.21.15.82:0/3788242718 reap_dead start 2023-10-06T03:17:50.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.804+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 shutdown_connections 2023-10-06T03:17:50.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.804+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 >> 172.21.15.82:0/3788242718 conn(0x7f02980cd080 msgr2=0x7f02980683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:50.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.804+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 shutdown_connections 2023-10-06T03:17:50.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.804+0000 7f029d2a9700 1 -- 172.21.15.82:0/3788242718 wait complete. 2023-10-06T03:17:50.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T03:17:50.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.929+0000 7fdc8c149700 1 Processor -- start 2023-10-06T03:17:50.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.929+0000 7fdc8c149700 1 -- start start 2023-10-06T03:17:50.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.930+0000 7fdc8c149700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdc8415cb10 0x7fdc840af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.930+0000 7fdc8c149700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdc840b4000 0x7fdc84159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.930+0000 7fdc8c149700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840698e0 con 0x7fdc840b1690 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.930+0000 7fdc8c149700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc84068fd0 con 0x7fdc840b4000 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.930+0000 7fdc8c149700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc840b0020 con 0x7fdc8415cb10 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.930+0000 7fdc896e4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdc840b4000 0x7fdc84159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.930+0000 7fdc8a6e6700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdc840b1690 0x7fdc84069d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39326/0 (socket says 172.21.15.82:39326) 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.930+0000 7fdc8a6e6700 1 -- 172.21.15.82:0/3832017427 learned_addr learned my addr 172.21.15.82:0/3832017427 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc89ee5700 1 --2- 172.21.15.82:0/3832017427 >> v2:172.21.15.134:3300/0 conn(0x7fdc8415cb10 0x7fdc840af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc896e4700 1 -- 172.21.15.82:0/3832017427 >> v2:172.21.15.134:3300/0 conn(0x7fdc8415cb10 msgr2=0x7fdc840af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:50.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc896e4700 1 --2- 172.21.15.82:0/3832017427 >> v2:172.21.15.134:3300/0 conn(0x7fdc8415cb10 0x7fdc840af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc896e4700 1 -- 172.21.15.82:0/3832017427 >> v1:172.21.15.82:6789/0 conn(0x7fdc840b1690 legacy=0x7fdc84069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc896e4700 1 -- 172.21.15.82:0/3832017427 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84069290 con 0x7fdc840b4000 2023-10-06T03:17:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc88ee3700 1 -- 172.21.15.82:0/3832017427 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781643916 0 0) 0x7fdc840698e0 con 0x7fdc840b1690 2023-10-06T03:17:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc89ee5700 1 --2- 172.21.15.82:0/3832017427 >> v2:172.21.15.134:3300/0 conn(0x7fdc8415cb10 0x7fdc840af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc896e4700 1 --2- 172.21.15.82:0/3832017427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc840b4000 0x7fdc84159b50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdc8406ac80 tx=0x7fdc740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4872f8bfc6bbc8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc88ee3700 1 -- 172.21.15.82:0/3832017427 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400b6b0 con 0x7fdc840b4000 2023-10-06T03:17:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc88ee3700 1 -- 172.21.15.82:0/3832017427 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7400b810 con 0x7fdc840b4000 2023-10-06T03:17:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.931+0000 7fdc88ee3700 1 -- 172.21.15.82:0/3832017427 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400bbb0 con 0x7fdc840b4000 2023-10-06T03:17:50.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.932+0000 7fdc8c149700 1 -- 172.21.15.82:0/3832017427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc840b4000 msgr2=0x7fdc84159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.932+0000 7fdc8c149700 1 --2- 172.21.15.82:0/3832017427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc840b4000 0x7fdc84159b50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdc8406ac80 tx=0x7fdc740091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.932+0000 7fdc8c149700 1 -- 172.21.15.82:0/3832017427 shutdown_connections 2023-10-06T03:17:50.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.932+0000 7fdc8c149700 1 --2- 172.21.15.82:0/3832017427 >> v2:172.21.15.134:3300/0 conn(0x7fdc8415cb10 0x7fdc840af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.932+0000 7fdc8c149700 1 --2- 172.21.15.82:0/3832017427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc840b4000 0x7fdc84159b50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.932+0000 7fdc8c149700 1 -- 172.21.15.82:0/3832017427 >> 172.21.15.82:0/3832017427 conn(0x7fdc8406d890 msgr2=0x7fdc8406dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:50.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.932+0000 7fdc8c149700 1 -- 172.21.15.82:0/3832017427 shutdown_connections 2023-10-06T03:17:50.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.932+0000 7fdc8c149700 1 -- 172.21.15.82:0/3832017427 wait complete. 2023-10-06T03:17:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.933+0000 7fdc8c149700 1 Processor -- start 2023-10-06T03:17:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.933+0000 7fdc8c149700 1 -- start start 2023-10-06T03:17:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.933+0000 7fdc8c149700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc840b1690 0x7fdc840ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.933+0000 7fdc8c149700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc840b4000 0x7fdc84157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8c149700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8415cb10 0x7fdc8416a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8c149700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841577a0 con 0x7fdc8415cb10 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8c149700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840cacb0 con 0x7fdc840b1690 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8c149700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840caf90 con 0x7fdc840b4000 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8415cb10 0x7fdc8416a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8415cb10 0x7fdc8416a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44200/0 (socket says 172.21.15.82:44200) 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 -- 172.21.15.82:0/2224666233 learned_addr learned my addr 172.21.15.82:0/2224666233 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc89ee5700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc840b1690 0x7fdc840ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc896e4700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc840b4000 0x7fdc84157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 -- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc840b4000 msgr2=0x7fdc84157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc840b4000 0x7fdc84157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 -- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc840b1690 msgr2=0x7fdc840ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc840b1690 0x7fdc840ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 -- 172.21.15.82:0/2224666233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74009420 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8a6e6700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8415cb10 0x7fdc8416a9c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00c7e0 tx=0x7fdc7c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc79ffb700 1 -- 172.21.15.82:0/2224666233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c005c00 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc79ffb700 1 -- 172.21.15.82:0/2224666233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c005d60 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840cb270 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc79ffb700 1 -- 172.21.15.82:0/2224666233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c004a80 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.934+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840cb830 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.935+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc840cba50 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.936+0000 7fdc79ffb700 1 -- 172.21.15.82:0/2224666233 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc7c005030 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.936+0000 7fdc79ffb700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc68066f30 0x7fdc680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.936+0000 7fdc79ffb700 1 -- 172.21.15.82:0/2224666233 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fdc7c083800 con 0x7fdc8415cb10 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.937+0000 7fdc89ee5700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc68066f30 0x7fdc680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.937+0000 7fdc89ee5700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc68066f30 0x7fdc680693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000e4b0 tx=0x7fdc80007670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:50.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:50.941+0000 7fdc79ffb700 1 -- 172.21.15.82:0/2224666233 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc7c04b5a0 con 0x7fdc8415cb10 2023-10-06T03:17:51.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.123+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc84064050 con 0x7fdc68066f30 2023-10-06T03:17:51.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.124+0000 7fdc79ffb700 1 -- 172.21.15.82:0/2224666233 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdc84064050 con 0x7fdc68066f30 2023-10-06T03:17:51.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc68066f30 msgr2=0x7fdc680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc68066f30 0x7fdc680693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000e4b0 tx=0x7fdc80007670 comp rx=0 tx=0).stop 2023-10-06T03:17:51.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8415cb10 msgr2=0x7fdc8416a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8415cb10 0x7fdc8416a9c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00c7e0 tx=0x7fdc7c007d90 comp rx=0 tx=0).stop 2023-10-06T03:17:51.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 shutdown_connections 2023-10-06T03:17:51.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8415cb10 0x7fdc8416a9c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc840b1690 0x7fdc840ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fdc68066f30 0x7fdc680693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 --2- 172.21.15.82:0/2224666233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc840b4000 0x7fdc84157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 >> 172.21.15.82:0/2224666233 conn(0x7fdc8406d890 msgr2=0x7fdc8415af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:51.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 shutdown_connections 2023-10-06T03:17:51.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.126+0000 7fdc8c149700 1 -- 172.21.15.82:0/2224666233 wait complete. 2023-10-06T03:17:51.129 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T03:17:51.139 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T03:17:51.139 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:17:51.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.257+0000 7f45c359e700 1 Processor -- start 2023-10-06T03:17:51.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.257+0000 7f45c359e700 1 -- start start 2023-10-06T03:17:51.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f45c40cf440 0x7f45c40cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c359e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f45c40cf810 0x7f45c40cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c359e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 0x7f45c415d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c40cb670 con 0x7f45c40cf440 2023-10-06T03:17:51.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c359e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c40cce90 con 0x7f45c40cf810 2023-10-06T03:17:51.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c359e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40cad80 con 0x7f45c40cc680 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f45c40cf440 0x7f45c40cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f45c40cf440 0x7f45c40cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44202/0 (socket says 172.21.15.82:44202) 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 -- 172.21.15.82:0/1154775414 learned_addr learned my addr 172.21.15.82:0/1154775414 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c2d9d700 1 --2- 172.21.15.82:0/1154775414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 0x7f45c415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c1d9b700 1 --2- 172.21.15.82:0/1154775414 >> v2:172.21.15.134:3300/0 conn(0x7f45c40cf810 0x7f45c40cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 -- 172.21.15.82:0/1154775414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 msgr2=0x7f45c415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 --2- 172.21.15.82:0/1154775414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 0x7f45c415d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 -- 172.21.15.82:0/1154775414 >> v2:172.21.15.134:3300/0 conn(0x7f45c40cf810 msgr2=0x7f45c40cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 --2- 172.21.15.82:0/1154775414 >> v2:172.21.15.134:3300/0 conn(0x7f45c40cf810 0x7f45c40cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 -- 172.21.15.82:0/1154775414 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40cb020 con 0x7f45c40cf440 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.258+0000 7f45c259c700 1 --2- 172.21.15.82:0/1154775414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf440 0x7f45c40cbb00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f45c4159ed0 tx=0x7f45b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873b7d0f88336b3d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c159a700 1 -- 172.21.15.82:0/1154775414 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400b860 con 0x7f45c40cf440 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c159a700 1 -- 172.21.15.82:0/1154775414 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400b9c0 con 0x7f45c40cf440 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c159a700 1 -- 172.21.15.82:0/1154775414 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400bd60 con 0x7f45c40cf440 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 -- 172.21.15.82:0/1154775414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf440 msgr2=0x7f45c40cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 --2- 172.21.15.82:0/1154775414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf440 0x7f45c40cbb00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f45c4159ed0 tx=0x7f45b4009250 comp rx=0 tx=0).stop 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 -- 172.21.15.82:0/1154775414 shutdown_connections 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 --2- 172.21.15.82:0/1154775414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf440 0x7f45c40cbb00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 --2- 172.21.15.82:0/1154775414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 0x7f45c415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 --2- 172.21.15.82:0/1154775414 >> v2:172.21.15.134:3300/0 conn(0x7f45c40cf810 0x7f45c40cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 -- 172.21.15.82:0/1154775414 >> 172.21.15.82:0/1154775414 conn(0x7f45c40cd080 msgr2=0x7f45c40cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 -- 172.21.15.82:0/1154775414 shutdown_connections 2023-10-06T03:17:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.259+0000 7f45c359e700 1 -- 172.21.15.82:0/1154775414 wait complete. 2023-10-06T03:17:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.260+0000 7f45c359e700 1 Processor -- start 2023-10-06T03:17:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.260+0000 7f45c359e700 1 -- start start 2023-10-06T03:17:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c359e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 0x7f45c415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c359e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c40cf440 0x7f45c415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf810 0x7f45c414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4151540 con 0x7f45c40cf810 2023-10-06T03:17:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c359e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40b4ad0 con 0x7f45c40cf440 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c359e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40b4db0 con 0x7f45c40cc680 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf810 0x7f45c414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf810 0x7f45c414fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44206/0 (socket says 172.21.15.82:44206) 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c2d9d700 1 -- 172.21.15.82:0/4252761248 learned_addr learned my addr 172.21.15.82:0/4252761248 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c259c700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 0x7f45c415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c1d9b700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c40cf440 0x7f45c415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c2d9d700 1 -- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 msgr2=0x7f45c415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.261+0000 7f45c2d9d700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c40cc680 0x7f45c415c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45c2d9d700 1 -- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c40cf440 msgr2=0x7f45c415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45c2d9d700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c40cf440 0x7f45c415ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45c2d9d700 1 -- 172.21.15.82:0/4252761248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40094f0 con 0x7f45c40cf810 2023-10-06T03:17:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45c1d9b700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c40cf440 0x7f45c415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45c2d9d700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf810 0x7f45c414fe30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00cdb0 tx=0x7f45bc0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00aa80 con 0x7f45c40cf810 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00abe0 con 0x7f45c40cf810 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c40b5090 con 0x7f45c40cf810 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc017430 con 0x7f45c40cf810 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c415a2a0 con 0x7f45c40cf810 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.262+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45c4069a20 con 0x7f45c40cf810 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.263+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45bc003020 con 0x7f45c40cf810 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.263+0000 7f45b27fc700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45a4066f30 0x7f45a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.264+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f45bc013070 con 0x7f45c40cf810 2023-10-06T03:17:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.264+0000 7f45b27fc700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f45a406d3a0 0x7f45a406f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.264+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 --> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45a406fe80 con 0x7f45a406d3a0 2023-10-06T03:17:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.264+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45bc086b80 con 0x7f45c40cf810 2023-10-06T03:17:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.264+0000 7f45c259c700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45a4066f30 0x7f45a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.264+0000 7f45c1d9b700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f45a406d3a0 0x7f45a406f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.264+0000 7f45c259c700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45a4066f30 0x7f45a40693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f45c4159ed0 tx=0x7f45b4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.264+0000 7f45c1d9b700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f45a406d3a0 0x7f45a406f7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.265+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 <== osd.5 v2:172.21.15.134:6816/90874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f45a406fe80 con 0x7f45a406d3a0 2023-10-06T03:17:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.278+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 --> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f45c4064050 con 0x7f45a406d3a0 2023-10-06T03:17:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.279+0000 7f45b27fc700 1 -- 172.21.15.82:0/4252761248 <== osd.5 v2:172.21.15.134:6816/90874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f45c4064050 con 0x7f45a406d3a0 2023-10-06T03:17:51.281 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:51.281 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:17:51.281 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.279+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f45a406d3a0 msgr2=0x7f45a406f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.279+0000 7f45c359e700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6816/90874,v1:172.21.15.134:6817/90874] conn(0x7f45a406d3a0 0x7f45a406f7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.279+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45a4066f30 msgr2=0x7f45a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.280+0000 7f45c359e700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f45a4066f30 0x7f45a40693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f45c4159ed0 tx=0x7f45b4017000 comp rx=0 tx=0).stop 2023-10-06T03:17:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.280+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf810 msgr2=0x7f45c414fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.280+0000 7f45c359e700 1 --2- 172.21.15.82:0/4252761248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40cf810 0x7f45c414fe30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00cdb0 tx=0x7f45bc0077d0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.280+0000 7f45c2d9d700 1 -- 172.21.15.82:0/4252761248 reap_dead start 2023-10-06T03:17:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.280+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 shutdown_connections 2023-10-06T03:17:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.280+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 >> 172.21.15.82:0/4252761248 conn(0x7f45c40cd080 msgr2=0x7f45c4157ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.280+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 shutdown_connections 2023-10-06T03:17:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.280+0000 7f45c359e700 1 -- 172.21.15.82:0/4252761248 wait complete. 2023-10-06T03:17:51.293 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T03:17:51.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.408+0000 7f4792dd2700 1 Processor -- start 2023-10-06T03:17:51.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.408+0000 7f4792dd2700 1 -- start start 2023-10-06T03:17:51.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.409+0000 7f4792dd2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c1598d0 0x7f478c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.409+0000 7f4792dd2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c15d8e0 0x7f478c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.409+0000 7f4792dd2700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478c15dd20 con 0x7f478c159500 2023-10-06T03:17:51.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.409+0000 7f4792dd2700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c0b1110 con 0x7f478c1598d0 2023-10-06T03:17:51.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.409+0000 7f4792dd2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0b13b0 con 0x7f478c15d8e0 2023-10-06T03:17:51.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4783fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c1598d0 0x7f478c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f479136f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c15d8e0 0x7f478c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4783fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c1598d0 0x7f478c15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:40552/0 (socket says 172.21.15.82:40552) 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f479136f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c15d8e0 0x7f478c0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.82:53574/0 (socket says 172.21.15.82:53574) 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4783fff700 1 -- 172.21.15.82:0/4068799475 learned_addr learned my addr 172.21.15.82:0/4068799475 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4790b6e700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f478c159500 0x7f478c0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.82:47784/0 (socket says 172.21.15.82:47784) 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4783fff700 1 -- 172.21.15.82:0/4068799475 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c15d8e0 msgr2=0x7f478c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4783fff700 1 --2- 172.21.15.82:0/4068799475 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c15d8e0 0x7f478c0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4783fff700 1 -- 172.21.15.82:0/4068799475 >> v1:172.21.15.134:6789/0 conn(0x7f478c159500 legacy=0x7f478c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4783fff700 1 -- 172.21.15.82:0/4068799475 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c0b1690 con 0x7f478c1598d0 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f479136f700 1 --2- 172.21.15.82:0/4068799475 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c15d8e0 0x7f478c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f4783fff700 1 --2- 172.21.15.82:0/4068799475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 0x7f478c15d3a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f477c0099b0 tx=0x7f477c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32d875e376e635b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f47837fe700 1 -- 172.21.15.82:0/4068799475 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c009ea0 con 0x7f478c1598d0 2023-10-06T03:17:51.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f47837fe700 1 -- 172.21.15.82:0/4068799475 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c00b860 con 0x7f478c1598d0 2023-10-06T03:17:51.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.410+0000 7f47837fe700 1 -- 172.21.15.82:0/4068799475 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00bc00 con 0x7f478c1598d0 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.411+0000 7f4792dd2700 1 -- 172.21.15.82:0/4068799475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 msgr2=0x7f478c15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.411+0000 7f4792dd2700 1 --2- 172.21.15.82:0/4068799475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 0x7f478c15d3a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f477c0099b0 tx=0x7f477c009250 comp rx=0 tx=0).stop 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.411+0000 7f4792dd2700 1 -- 172.21.15.82:0/4068799475 shutdown_connections 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.411+0000 7f4792dd2700 1 --2- 172.21.15.82:0/4068799475 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c15d8e0 0x7f478c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.411+0000 7f4792dd2700 1 --2- 172.21.15.82:0/4068799475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 0x7f478c15d3a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.411+0000 7f4792dd2700 1 -- 172.21.15.82:0/4068799475 >> 172.21.15.82:0/4068799475 conn(0x7f478c067630 msgr2=0x7f478c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.411+0000 7f4792dd2700 1 -- 172.21.15.82:0/4068799475 shutdown_connections 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.411+0000 7f4792dd2700 1 -- 172.21.15.82:0/4068799475 wait complete. 2023-10-06T03:17:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.412+0000 7f4792dd2700 1 Processor -- start 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.412+0000 7f4792dd2700 1 -- start start 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f4792dd2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c159500 0x7f478c148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f4792dd2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 0x7f478c169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f4792dd2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f478c15d8e0 0x7f478c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f4792dd2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c15afa0 con 0x7f478c15d8e0 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f4792dd2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c14e640 con 0x7f478c1598d0 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f4792dd2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c15acc0 con 0x7f478c159500 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f479136f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f478c15d8e0 0x7f478c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f479136f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f478c15d8e0 0x7f478c14ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44218/0 (socket says 172.21.15.82:44218) 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f479136f700 1 -- 172.21.15.82:0/1976280268 learned_addr learned my addr 172.21.15.82:0/1976280268 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f4790b6e700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c159500 0x7f478c148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f4783fff700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 0x7f478c169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f479136f700 1 -- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c159500 msgr2=0x7f478c148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f479136f700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c159500 0x7f478c148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f479136f700 1 -- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 msgr2=0x7f478c169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f479136f700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 0x7f478c169d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.413+0000 7f479136f700 1 -- 172.21.15.82:0/1976280268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009a20 con 0x7f478c15d8e0 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.414+0000 7f479136f700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f478c15d8e0 0x7f478c14ead0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4784009f20 tx=0x7f478400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.414+0000 7f4780ff9700 1 -- 172.21.15.82:0/1976280268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784009c80 con 0x7f478c15d8e0 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.414+0000 7f4780ff9700 1 -- 172.21.15.82:0/1976280268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400f040 con 0x7f478c15d8e0 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.414+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c0094f0 con 0x7f478c15d8e0 2023-10-06T03:17:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.414+0000 7f4780ff9700 1 -- 172.21.15.82:0/1976280268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400cdc0 con 0x7f478c15d8e0 2023-10-06T03:17:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.414+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c14e2d0 con 0x7f478c15d8e0 2023-10-06T03:17:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.415+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c14e7b0 con 0x7f478c15d8e0 2023-10-06T03:17:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.415+0000 7f4780ff9700 1 -- 172.21.15.82:0/1976280268 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4784003020 con 0x7f478c15d8e0 2023-10-06T03:17:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.415+0000 7f4780ff9700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4778066f30 0x7f47780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.415+0000 7f4780ff9700 1 -- 172.21.15.82:0/1976280268 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4784084ba0 con 0x7f478c15d8e0 2023-10-06T03:17:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.416+0000 7f4790b6e700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4778066f30 0x7f47780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.416+0000 7f4790b6e700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4778066f30 0x7f47780693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4788004f40 tx=0x7f4788007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.420+0000 7f4780ff9700 1 -- 172.21.15.82:0/1976280268 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4784051fb0 con 0x7f478c15d8e0 2023-10-06T03:17:51.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.602+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f478c064050 con 0x7f4778066f30 2023-10-06T03:17:51.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.603+0000 7f4780ff9700 1 -- 172.21.15.82:0/1976280268 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f478c064050 con 0x7f4778066f30 2023-10-06T03:17:51.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4778066f30 msgr2=0x7f47780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4778066f30 0x7f47780693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4788004f40 tx=0x7f4788007eb0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f478c15d8e0 msgr2=0x7f478c14ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f478c15d8e0 0x7f478c14ead0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4784009f20 tx=0x7f478400b040 comp rx=0 tx=0).stop 2023-10-06T03:17:51.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 shutdown_connections 2023-10-06T03:17:51.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f478c15d8e0 0x7f478c14ead0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f4778066f30 0x7f47780693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f478c159500 0x7f478c148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 --2- 172.21.15.82:0/1976280268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c1598d0 0x7f478c169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 >> 172.21.15.82:0/1976280268 conn(0x7f478c067630 msgr2=0x7f478c14b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 shutdown_connections 2023-10-06T03:17:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.605+0000 7f4792dd2700 1 -- 172.21.15.82:0/1976280268 wait complete. 2023-10-06T03:17:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T03:17:51.618 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T03:17:51.619 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:17:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.736+0000 7fa310a3d700 1 Processor -- start 2023-10-06T03:17:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.736+0000 7fa310a3d700 1 -- start start 2023-10-06T03:17:51.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa310a3d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cf440 0x7fa30c0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa310a3d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa30c0cf810 0x7fa30c0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa310a3d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c0cb670 con 0x7fa30c0cc680 2023-10-06T03:17:51.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa310a3d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c0cce90 con 0x7fa30c0cf810 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa310a3d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0cad80 con 0x7fa30c0cf440 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30b59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa30c0cc680 0x7fa30c15d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39330/0 (socket says 172.21.15.82:39330) 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30b59e700 1 -- 172.21.15.82:0/3402197745 learned_addr learned my addr 172.21.15.82:0/3402197745 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30a59c700 1 --2- 172.21.15.82:0/3402197745 >> v2:172.21.15.134:3300/0 conn(0x7fa30c0cf810 0x7fa30c0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30ad9d700 1 --2- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cf440 0x7fa30c0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa309d9b700 1 -- 172.21.15.82:0/3402197745 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013220488 0 0) 0x7fa30c0cb670 con 0x7fa30c0cc680 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa309d9b700 1 -- 172.21.15.82:0/3402197745 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f8003570 con 0x7fa30c0cc680 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30a59c700 1 -- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cf440 msgr2=0x7fa30c0cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30a59c700 1 --2- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cf440 0x7fa30c0cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30a59c700 1 -- 172.21.15.82:0/3402197745 >> v1:172.21.15.82:6789/0 conn(0x7fa30c0cc680 legacy=0x7fa30c15d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30a59c700 1 -- 172.21.15.82:0/3402197745 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0cb020 con 0x7fa30c0cf810 2023-10-06T03:17:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30ad9d700 1 --2- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cf440 0x7fa30c0cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.737+0000 7fa30a59c700 1 --2- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf810 0x7fa30c0cc140 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40098e0 tx=0x7fa2f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aac36cad5d1cef01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa309d9b700 1 -- 172.21.15.82:0/3402197745 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4011630 con 0x7fa30c0cf810 2023-10-06T03:17:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa309d9b700 1 -- 172.21.15.82:0/3402197745 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4011790 con 0x7fa30c0cf810 2023-10-06T03:17:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa309d9b700 1 -- 172.21.15.82:0/3402197745 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4011b30 con 0x7fa30c0cf810 2023-10-06T03:17:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa310a3d700 1 -- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf810 msgr2=0x7fa30c0cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa310a3d700 1 --2- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf810 0x7fa30c0cc140 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40098e0 tx=0x7fa2f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa310a3d700 1 -- 172.21.15.82:0/3402197745 shutdown_connections 2023-10-06T03:17:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa310a3d700 1 --2- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cf440 0x7fa30c0cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa310a3d700 1 --2- 172.21.15.82:0/3402197745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf810 0x7fa30c0cc140 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa310a3d700 1 -- 172.21.15.82:0/3402197745 >> 172.21.15.82:0/3402197745 conn(0x7fa30c0cd080 msgr2=0x7fa30c0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa310a3d700 1 -- 172.21.15.82:0/3402197745 shutdown_connections 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.738+0000 7fa310a3d700 1 -- 172.21.15.82:0/3402197745 wait complete. 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.739+0000 7fa310a3d700 1 Processor -- start 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.739+0000 7fa310a3d700 1 -- start start 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa310a3d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cc680 0x7fa30c1512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa310a3d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf440 0x7fa30c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa310a3d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30c0cf810 0x7fa30c14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa310a3d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0c8b00 con 0x7fa30c0cf810 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa310a3d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c169ad0 con 0x7fa30c0cf440 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa310a3d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c169db0 con 0x7fa30c0cc680 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa30b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30c0cf810 0x7fa30c14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa30b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30c0cf810 0x7fa30c14dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44228/0 (socket says 172.21.15.82:44228) 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa30b59e700 1 -- 172.21.15.82:0/2083664635 learned_addr learned my addr 172.21.15.82:0/2083664635 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa30ad9d700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cc680 0x7fa30c1512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.740+0000 7fa30a59c700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf440 0x7fa30c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa30b59e700 1 -- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cc680 msgr2=0x7fa30c1512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa30b59e700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cc680 0x7fa30c1512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa30b59e700 1 -- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf440 msgr2=0x7fa30c14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa30b59e700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf440 0x7fa30c14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa30b59e700 1 -- 172.21.15.82:0/2083664635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009a20 con 0x7fa30c0cf810 2023-10-06T03:17:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa30ad9d700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30c0cc680 0x7fa30c1512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa30a59c700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30c0cf440 0x7fa30c14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa30b59e700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30c0cf810 0x7fa30c14dd70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0010e0 tx=0x7fa2fc007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc005c00 con 0x7fa30c0cf810 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc005d60 con 0x7fa30c0cf810 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f4009420 con 0x7fa30c0cf810 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0072e0 con 0x7fa30c0cf810 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.741+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c16a370 con 0x7fa30c0cf810 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.742+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa30c15e940 con 0x7fa30c0cf810 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.742+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2fc007690 con 0x7fa30c0cf810 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.742+0000 7fa302ffd700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2ec066f30 0x7fa2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.743+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa2fc0838e0 con 0x7fa30c0cf810 2023-10-06T03:17:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.743+0000 7fa302ffd700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fa2ec06d3a0 0x7fa2ec06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.743+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 --> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2ec06fe80 con 0x7fa2ec06d3a0 2023-10-06T03:17:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.743+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2fc088240 con 0x7fa30c0cf810 2023-10-06T03:17:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.743+0000 7fa30ad9d700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2ec066f30 0x7fa2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.743+0000 7fa30a59c700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fa2ec06d3a0 0x7fa2ec06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.743+0000 7fa30ad9d700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2ec066f30 0x7fa2ec0693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa3040099f0 tx=0x7fa30400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.743+0000 7fa30a59c700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fa2ec06d3a0 0x7fa2ec06f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.744+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 <== osd.6 v2:172.21.15.134:6808/90847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa2ec06fe80 con 0x7fa2ec06d3a0 2023-10-06T03:17:51.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.757+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 --> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa30c064050 con 0x7fa2ec06d3a0 2023-10-06T03:17:51.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.758+0000 7fa302ffd700 1 -- 172.21.15.82:0/2083664635 <== osd.6 v2:172.21.15.134:6808/90847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa30c064050 con 0x7fa2ec06d3a0 2023-10-06T03:17:51.760 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:51.760 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:17:51.760 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:51.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.758+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fa2ec06d3a0 msgr2=0x7fa2ec06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.758+0000 7fa310a3d700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6808/90847,v1:172.21.15.134:6809/90847] conn(0x7fa2ec06d3a0 0x7fa2ec06f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.758+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2ec066f30 msgr2=0x7fa2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.758+0000 7fa310a3d700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa2ec066f30 0x7fa2ec0693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa3040099f0 tx=0x7fa30400b040 comp rx=0 tx=0).stop 2023-10-06T03:17:51.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.758+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30c0cf810 msgr2=0x7fa30c14dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.758+0000 7fa310a3d700 1 --2- 172.21.15.82:0/2083664635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30c0cf810 0x7fa30c14dd70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0010e0 tx=0x7fa2fc007dd0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.758+0000 7fa30b59e700 1 -- 172.21.15.82:0/2083664635 reap_dead start 2023-10-06T03:17:51.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.759+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 shutdown_connections 2023-10-06T03:17:51.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.759+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 >> 172.21.15.82:0/2083664635 conn(0x7fa30c0cd080 msgr2=0x7fa30c0b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:51.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.759+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 shutdown_connections 2023-10-06T03:17:51.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.759+0000 7fa310a3d700 1 -- 172.21.15.82:0/2083664635 wait complete. 2023-10-06T03:17:51.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T03:17:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.885+0000 7f77a0858700 1 Processor -- start 2023-10-06T03:17:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.885+0000 7f77a0858700 1 -- start start 2023-10-06T03:17:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f77a0858700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f779c15de80 0x7f779c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f77a0858700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 0x7f779c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f77a0858700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c069380 con 0x7f779c142e90 2023-10-06T03:17:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f77a0858700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c069f20 con 0x7f779c15de80 2023-10-06T03:17:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f77a0858700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c068770 con 0x7f779c0b61d0 2023-10-06T03:17:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f779c15de80 0x7f779c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779ad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f779c142e90 0x7f779c069810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39346/0 (socket says 172.21.15.82:39346) 2023-10-06T03:17:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779ad9d700 1 -- 172.21.15.82:0/2178373454 learned_addr learned my addr 172.21.15.82:0/2178373454 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779259c700 1 -- 172.21.15.82:0/2178373454 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 msgr2=0x7f779c15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779259c700 1 --2- 172.21.15.82:0/2178373454 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 0x7f779c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779259c700 1 -- 172.21.15.82:0/2178373454 >> v1:172.21.15.82:6789/0 conn(0x7f779c142e90 legacy=0x7f779c069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779259c700 1 -- 172.21.15.82:0/2178373454 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c068a50 con 0x7f779c15de80 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779a59c700 1 -- 172.21.15.82:0/2178373454 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562679723 0 0) 0x7f779c069380 con 0x7f779c142e90 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779259c700 1 --2- 172.21.15.82:0/2178373454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c15de80 0x7f779c0b5c90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f77840098e0 tx=0x7f77840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e867a3c03a60cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.886+0000 7f779a59c700 1 -- 172.21.15.82:0/2178373454 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784009e80 con 0x7f779c15de80 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f779a59c700 1 -- 172.21.15.82:0/2178373454 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778400b860 con 0x7f779c15de80 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f779a59c700 1 -- 172.21.15.82:0/2178373454 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400bbe0 con 0x7f779c15de80 2023-10-06T03:17:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f77a0858700 1 -- 172.21.15.82:0/2178373454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c15de80 msgr2=0x7f779c0b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f77a0858700 1 --2- 172.21.15.82:0/2178373454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c15de80 0x7f779c0b5c90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f77840098e0 tx=0x7f77840091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f77a0858700 1 -- 172.21.15.82:0/2178373454 shutdown_connections 2023-10-06T03:17:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f77a0858700 1 --2- 172.21.15.82:0/2178373454 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 0x7f779c15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f77a0858700 1 --2- 172.21.15.82:0/2178373454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c15de80 0x7f779c0b5c90 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f77a0858700 1 -- 172.21.15.82:0/2178373454 >> 172.21.15.82:0/2178373454 conn(0x7f779c0ccfe0 msgr2=0x7f779c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f77a0858700 1 -- 172.21.15.82:0/2178373454 shutdown_connections 2023-10-06T03:17:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.887+0000 7f77a0858700 1 -- 172.21.15.82:0/2178373454 wait complete. 2023-10-06T03:17:51.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.888+0000 7f77a0858700 1 Processor -- start 2023-10-06T03:17:51.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.888+0000 7f77a0858700 1 -- start start 2023-10-06T03:17:51.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f77a0858700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 0x7f779c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f77a0858700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c142e90 0x7f779c0cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f77a0858700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c15de80 0x7f779c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f77a0858700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0c93d0 con 0x7f779c142e90 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f77a0858700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0c8aa0 con 0x7f779c15de80 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f77a0858700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0c8d80 con 0x7f779c0b61d0 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c142e90 0x7f779c0cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c142e90 0x7f779c0cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44246/0 (socket says 172.21.15.82:44246) 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779259c700 1 -- 172.21.15.82:0/4172521349 learned_addr learned my addr 172.21.15.82:0/4172521349 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779ad9d700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 0x7f779c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779b59e700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c15de80 0x7f779c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779259c700 1 -- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 msgr2=0x7f779c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779259c700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 0x7f779c0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779259c700 1 -- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c15de80 msgr2=0x7f779c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779259c700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c15de80 0x7f779c0cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.889+0000 7f779259c700 1 -- 172.21.15.82:0/4172521349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784009420 con 0x7f779c142e90 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.890+0000 7f779259c700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c142e90 0x7f779c0cf0f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7784013000 tx=0x7f7784017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.890+0000 7f77937fe700 1 -- 172.21.15.82:0/4172521349 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400bbe0 con 0x7f779c142e90 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.890+0000 7f77937fe700 1 -- 172.21.15.82:0/4172521349 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784011420 con 0x7f779c142e90 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.890+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c0c9060 con 0x7f779c142e90 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.890+0000 7f77937fe700 1 -- 172.21.15.82:0/4172521349 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784011820 con 0x7f779c142e90 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.890+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c0c7630 con 0x7f779c142e90 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.891+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c0c9580 con 0x7f779c142e90 2023-10-06T03:17:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.891+0000 7f77937fe700 1 -- 172.21.15.82:0/4172521349 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7784011c50 con 0x7f779c142e90 2023-10-06T03:17:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.891+0000 7f77937fe700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f777c066f30 0x7f777c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.891+0000 7f77937fe700 1 -- 172.21.15.82:0/4172521349 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7784085c00 con 0x7f779c142e90 2023-10-06T03:17:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.892+0000 7f779ad9d700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f777c066f30 0x7f777c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.892+0000 7f779ad9d700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f777c066f30 0x7f777c0693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f778c007fd0 tx=0x7f778c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:51.896+0000 7f77937fe700 1 -- 172.21.15.82:0/4172521349 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f779c0c9580 con 0x7f779c142e90 2023-10-06T03:17:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.077+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f779c0c9580 con 0x7f777c066f30 2023-10-06T03:17:52.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.077+0000 7f77937fe700 1 -- 172.21.15.82:0/4172521349 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f779c0c9580 con 0x7f777c066f30 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f777c066f30 msgr2=0x7f777c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f777c066f30 0x7f777c0693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f778c007fd0 tx=0x7f778c007d30 comp rx=0 tx=0).stop 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c142e90 msgr2=0x7f779c0cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c142e90 0x7f779c0cf0f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7784013000 tx=0x7f7784017000 comp rx=0 tx=0).stop 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 shutdown_connections 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c15de80 0x7f779c0cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f777c066f30 0x7f777c0693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f779c0b61d0 0x7f779c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 --2- 172.21.15.82:0/4172521349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f779c142e90 0x7f779c0cf0f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 >> 172.21.15.82:0/4172521349 conn(0x7f779c0ccfe0 msgr2=0x7f779c0b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 shutdown_connections 2023-10-06T03:17:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.079+0000 7f77a0858700 1 -- 172.21.15.82:0/4172521349 wait complete. 2023-10-06T03:17:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T03:17:52.092 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T03:17:52.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:17:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.210+0000 7fcc35436700 1 Processor -- start 2023-10-06T03:17:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.210+0000 7fcc35436700 1 -- start start 2023-10-06T03:17:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc35436700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcc300b4f00 0x7fcc30164670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc35436700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3015e0f0 con 0x7fcc3015cb40 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc35436700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc300b1b20 con 0x7fcc300b6260 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc35436700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc300ce220 con 0x7fcc300b4f00 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc2effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcc3015cb40 0x7fcc3015d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39362/0 (socket says 172.21.15.82:39362) 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc2effd700 1 -- 172.21.15.82:0/446263031 learned_addr learned my addr 172.21.15.82:0/446263031 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc2f7fe700 1 --2- 172.21.15.82:0/446263031 >> v2:172.21.15.134:3300/0 conn(0x7fcc300b4f00 0x7fcc30164670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566297023 0 0) 0x7fcc3015e0f0 con 0x7fcc3015cb40 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.211+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc18003570 con 0x7fcc3015cb40 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038737556 0 0) 0x7fcc18003570 con 0x7fcc3015cb40 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 >> v2:172.21.15.134:3300/0 conn(0x7fcc300b4f00 msgr2=0x7fcc30164670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 --2- 172.21.15.82:0/446263031 >> v2:172.21.15.134:3300/0 conn(0x7fcc300b4f00 0x7fcc30164670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 >> v1:172.21.15.134:6789/0 conn(0x7fcc300b6260 legacy=0x7fcc3015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300b1e00 con 0x7fcc3015cb40 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7fcc280017f0 con 0x7fcc3015cb40 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 >> v1:172.21.15.82:6789/0 conn(0x7fcc3015cb40 legacy=0x7fcc3015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc18004810 0x7fcc18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc180051c0 0x7fcc1800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300ce220 con 0x7fcc18003a60 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1800c160 con 0x7fcc18004810 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1800c320 con 0x7fcc180051c0 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2f7fe700 1 --2- 172.21.15.82:0/446263031 >> v2:172.21.15.134:3300/0 conn(0x7fcc300b4f00 0x7fcc30164670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:17:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2effd700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2e7fc700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc18004810 0x7fcc18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2f7fe700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc180051c0 0x7fcc1800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2effd700 1 -- 172.21.15.82:0/446263031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc180051c0 msgr2=0x7fcc1800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2effd700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc180051c0 0x7fcc1800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2effd700 1 -- 172.21.15.82:0/446263031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc18004810 msgr2=0x7fcc18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2effd700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc18004810 0x7fcc18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2effd700 1 -- 172.21.15.82:0/446263031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18003570 con 0x7fcc18003a60 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2f7fe700 1 -- 172.21.15.82:0/446263031 reap_dead start 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2effd700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc18003e70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a930 tx=0x7fcc280021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152c0ab8a837da33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280070d0 con 0x7fcc18003a60 2023-10-06T03:17:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28007230 con 0x7fcc18003a60 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.212+0000 7fcc2dffb700 1 -- 172.21.15.82:0/446263031 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280075d0 con 0x7fcc18003a60 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.213+0000 7fcc35436700 1 -- 172.21.15.82:0/446263031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 msgr2=0x7fcc18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.213+0000 7fcc35436700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc18003e70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a930 tx=0x7fcc280021d0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.213+0000 7fcc35436700 1 -- 172.21.15.82:0/446263031 shutdown_connections 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.213+0000 7fcc35436700 1 --2- 172.21.15.82:0/446263031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc18003e70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.213+0000 7fcc35436700 1 -- 172.21.15.82:0/446263031 >> 172.21.15.82:0/446263031 conn(0x7fcc30067630 msgr2=0x7fcc30069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.213+0000 7fcc35436700 1 -- 172.21.15.82:0/446263031 shutdown_connections 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.213+0000 7fcc35436700 1 -- 172.21.15.82:0/446263031 wait complete. 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.214+0000 7fcc35436700 1 Processor -- start 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.214+0000 7fcc35436700 1 -- start start 2023-10-06T03:17:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc35436700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc3013f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc35436700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc30150070 0x7fcc3016dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc35436700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc3013cfa0 0x7fcc3014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc35436700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3013ef20 con 0x7fcc18003a60 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc35436700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3016e290 con 0x7fcc30150070 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc35436700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3013e310 con 0x7fcc3013cfa0 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc3013f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc3013f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44264/0 (socket says 172.21.15.82:44264) 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 -- 172.21.15.82:0/3745238521 learned_addr learned my addr 172.21.15.82:0/3745238521 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2f7fe700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc3013cfa0 0x7fcc3014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2e7fc700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc30150070 0x7fcc3016dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 -- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc3013cfa0 msgr2=0x7fcc3014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc3013cfa0 0x7fcc3014ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 -- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc30150070 msgr2=0x7fcc3016dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc30150070 0x7fcc3016dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 -- 172.21.15.82:0/3745238521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3013e5f0 con 0x7fcc18003a60 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc2effd700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc3013f3b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcc28012000 tx=0x7fcc28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28001a90 con 0x7fcc18003a60 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28027470 con 0x7fcc18003a60 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.215+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3013e8d0 con 0x7fcc18003a60 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.216+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28027830 con 0x7fcc18003a60 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.216+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3013d3f0 con 0x7fcc18003a60 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.216+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc30064050 con 0x7fcc18003a60 2023-10-06T03:17:52.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.217+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc28024070 con 0x7fcc18003a60 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.217+0000 7fcc16ffd700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcc1c066f30 0x7fcc1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.217+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fcc28086ba0 con 0x7fcc18003a60 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.217+0000 7fcc16ffd700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7fcc1c06d3a0 0x7fcc1c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.217+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 --> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc1c06fe80 con 0x7fcc1c06d3a0 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.217+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc2808b240 con 0x7fcc18003a60 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.217+0000 7fcc2e7fc700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcc1c066f30 0x7fcc1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.218+0000 7fcc2f7fe700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7fcc1c06d3a0 0x7fcc1c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.218+0000 7fcc2e7fc700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcc1c066f30 0x7fcc1c0693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc3013ff70 tx=0x7fcc24007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.218+0000 7fcc2f7fe700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7fcc1c06d3a0 0x7fcc1c06f7b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.219+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 <== osd.7 v2:172.21.15.134:6824/90877 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcc1c06fe80 con 0x7fcc1c06d3a0 2023-10-06T03:17:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.233+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 --> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcc300b20e0 con 0x7fcc1c06d3a0 2023-10-06T03:17:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc16ffd700 1 -- 172.21.15.82:0/3745238521 <== osd.7 v2:172.21.15.134:6824/90877 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcc300b20e0 con 0x7fcc1c06d3a0 2023-10-06T03:17:52.235 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-10-06T03:17:52.235 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:17:52.235 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-10-06T03:17:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7fcc1c06d3a0 msgr2=0x7fcc1c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6824/90877,v1:172.21.15.134:6825/90877] conn(0x7fcc1c06d3a0 0x7fcc1c06f7b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcc1c066f30 msgr2=0x7fcc1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fcc1c066f30 0x7fcc1c0693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc3013ff70 tx=0x7fcc24007d30 comp rx=0 tx=0).stop 2023-10-06T03:17:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 msgr2=0x7fcc3013f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 --2- 172.21.15.82:0/3745238521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc18003a60 0x7fcc3013f3b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcc28012000 tx=0x7fcc28016000 comp rx=0 tx=0).stop 2023-10-06T03:17:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc2f7fe700 1 -- 172.21.15.82:0/3745238521 reap_dead start 2023-10-06T03:17:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 shutdown_connections 2023-10-06T03:17:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 >> 172.21.15.82:0/3745238521 conn(0x7fcc30067630 msgr2=0x7fcc30156a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 shutdown_connections 2023-10-06T03:17:52.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.234+0000 7fcc35436700 1 -- 172.21.15.82:0/3745238521 wait complete. 2023-10-06T03:17:52.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T03:17:52.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.360+0000 7f49de14c700 1 Processor -- start 2023-10-06T03:17:52.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.360+0000 7f49de14c700 1 -- start start 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.361+0000 7f49de14c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49d8155a40 0x7f49d80ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.361+0000 7f49de14c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49d8155e10 0x7f49d80ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.361+0000 7f49de14c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d80cba50 con 0x7f49d80ae400 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.361+0000 7f49de14c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d80c8280 con 0x7f49d8155a40 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.361+0000 7f49de14c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d80cab70 con 0x7f49d8155e10 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.361+0000 7f49d77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49d8155a40 0x7f49d80ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.361+0000 7f49d7fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f49d80ae400 0x7f49d81597a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39368/0 (socket says 172.21.15.82:39368) 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.361+0000 7f49d7fff700 1 -- 172.21.15.82:0/1640927742 learned_addr learned my addr 172.21.15.82:0/1640927742 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d77fe700 1 -- 172.21.15.82:0/1640927742 >> v2:172.21.15.134:3300/0 conn(0x7f49d8155e10 msgr2=0x7f49d80ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d6ffd700 1 --2- 172.21.15.82:0/1640927742 >> v2:172.21.15.134:3300/0 conn(0x7f49d8155e10 0x7f49d80ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d77fe700 1 --2- 172.21.15.82:0/1640927742 >> v2:172.21.15.134:3300/0 conn(0x7f49d8155e10 0x7f49d80ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d77fe700 1 -- 172.21.15.82:0/1640927742 >> v1:172.21.15.82:6789/0 conn(0x7f49d80ae400 legacy=0x7f49d81597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d67fc700 1 -- 172.21.15.82:0/1640927742 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198722004 0 0) 0x7f49d80cba50 con 0x7f49d80ae400 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d77fe700 1 -- 172.21.15.82:0/1640927742 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80cae40 con 0x7f49d8155a40 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d77fe700 1 --2- 172.21.15.82:0/1640927742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d8155a40 0x7f49d80ca630 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f49d806da60 tx=0x7f49c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142acdd8bbb5e211 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d67fc700 1 -- 172.21.15.82:0/1640927742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c800e070 con 0x7f49d8155a40 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d67fc700 1 -- 172.21.15.82:0/1640927742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c800bc30 con 0x7f49d8155a40 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49d67fc700 1 -- 172.21.15.82:0/1640927742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8012430 con 0x7f49d8155a40 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49de14c700 1 -- 172.21.15.82:0/1640927742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d8155a40 msgr2=0x7f49d80ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.362+0000 7f49de14c700 1 --2- 172.21.15.82:0/1640927742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d8155a40 0x7f49d80ca630 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f49d806da60 tx=0x7f49c8009780 comp rx=0 tx=0).stop 2023-10-06T03:17:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.363+0000 7f49de14c700 1 -- 172.21.15.82:0/1640927742 shutdown_connections 2023-10-06T03:17:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.363+0000 7f49de14c700 1 --2- 172.21.15.82:0/1640927742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d8155a40 0x7f49d80ca630 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.363+0000 7f49de14c700 1 --2- 172.21.15.82:0/1640927742 >> v2:172.21.15.134:3300/0 conn(0x7f49d8155e10 0x7f49d80ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.363+0000 7f49de14c700 1 -- 172.21.15.82:0/1640927742 >> 172.21.15.82:0/1640927742 conn(0x7f49d80c94d0 msgr2=0x7f49d80c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.363+0000 7f49de14c700 1 -- 172.21.15.82:0/1640927742 shutdown_connections 2023-10-06T03:17:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.363+0000 7f49de14c700 1 -- 172.21.15.82:0/1640927742 wait complete. 2023-10-06T03:17:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.364+0000 7f49de14c700 1 Processor -- start 2023-10-06T03:17:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.364+0000 7f49de14c700 1 -- start start 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.364+0000 7f49de14c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d80ae400 0x7f49d816a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.364+0000 7f49de14c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d8155a40 0x7f49d8156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49de14c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49d8155e10 0x7f49d81574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49de14c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80c4a70 con 0x7f49d80ae400 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49de14c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80c3cb0 con 0x7f49d8155a40 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49de14c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80c3f90 con 0x7f49d8155e10 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d80ae400 0x7f49d816a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d80ae400 0x7f49d816a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44288/0 (socket says 172.21.15.82:44288) 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 -- 172.21.15.82:0/3037941503 learned_addr learned my addr 172.21.15.82:0/3037941503 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d6ffd700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d8155a40 0x7f49d8156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d7fff700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49d8155e10 0x7f49d81574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 -- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49d8155e10 msgr2=0x7f49d81574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49d8155e10 0x7f49d81574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 -- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d8155a40 msgr2=0x7f49d8156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d8155a40 0x7f49d8156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 -- 172.21.15.82:0/3037941503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c8009a20 con 0x7f49d80ae400 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49d77fe700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d80ae400 0x7f49d816a070 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f49c80097c0 tx=0x7f49c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49bf7fe700 1 -- 172.21.15.82:0/3037941503 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8012e20 con 0x7f49d80ae400 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49bf7fe700 1 -- 172.21.15.82:0/3037941503 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c801d630 con 0x7f49d80ae400 2023-10-06T03:17:52.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d80c4270 con 0x7f49d80ae400 2023-10-06T03:17:52.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49bf7fe700 1 -- 172.21.15.82:0/3037941503 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c801d9f0 con 0x7f49d80ae400 2023-10-06T03:17:52.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.365+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d816a5b0 con 0x7f49d80ae400 2023-10-06T03:17:52.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.366+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d8064050 con 0x7f49d80ae400 2023-10-06T03:17:52.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.367+0000 7f49bf7fe700 1 -- 172.21.15.82:0/3037941503 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49c8024070 con 0x7f49d80ae400 2023-10-06T03:17:52.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.367+0000 7f49bf7fe700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f49c4066f30 0x7f49c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.367+0000 7f49bf7fe700 1 -- 172.21.15.82:0/3037941503 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f49c8086ad0 con 0x7f49d80ae400 2023-10-06T03:17:52.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.367+0000 7f49d6ffd700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f49c4066f30 0x7f49c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.368+0000 7f49d6ffd700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f49c4066f30 0x7f49c40693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f49d80c2e00 tx=0x7f49cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.371+0000 7f49bf7fe700 1 -- 172.21.15.82:0/3037941503 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49c8053ee0 con 0x7f49d80ae400 2023-10-06T03:17:52.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.554+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f49d80cc490 con 0x7f49c4066f30 2023-10-06T03:17:52.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.556+0000 7f49bf7fe700 1 -- 172.21.15.82:0/3037941503 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f49d80cc490 con 0x7f49c4066f30 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.556+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f49c4066f30 msgr2=0x7f49c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.556+0000 7f49de14c700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f49c4066f30 0x7f49c40693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f49d80c2e00 tx=0x7f49cc008040 comp rx=0 tx=0).stop 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d80ae400 msgr2=0x7f49d816a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d80ae400 0x7f49d816a070 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f49c80097c0 tx=0x7f49c8019000 comp rx=0 tx=0).stop 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 shutdown_connections 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f49c4066f30 0x7f49c40693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49d8155e10 0x7f49d81574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d80ae400 0x7f49d816a070 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 --2- 172.21.15.82:0/3037941503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d8155a40 0x7f49d8156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 >> 172.21.15.82:0/3037941503 conn(0x7f49d80c94d0 msgr2=0x7f49d814a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:52.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 shutdown_connections 2023-10-06T03:17:52.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.557+0000 7f49de14c700 1 -- 172.21.15.82:0/3037941503 wait complete. 2023-10-06T03:17:52.560 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T03:17:52.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:17:52.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.682+0000 7f00dcc4f700 1 Processor -- start 2023-10-06T03:17:52.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.682+0000 7f00dcc4f700 1 -- start start 2023-10-06T03:17:52.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.683+0000 7f00dcc4f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00d815d560 0x7f00d80d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.683+0000 7f00dcc4f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00d815d930 0x7f00d80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.683+0000 7f00dcc4f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d80b2ad0 con 0x7f00d81591b0 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.683+0000 7f00dcc4f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d80b4160 con 0x7f00d815d560 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.683+0000 7f00dcc4f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d80b1f80 con 0x7f00d815d930 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.683+0000 7f00d659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00d815d560 0x7f00d80d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.683+0000 7f00d6d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f00d81591b0 0x7f00d8159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39370/0 (socket says 172.21.15.82:39370) 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.683+0000 7f00d6d9d700 1 -- 172.21.15.82:0/3521012215 learned_addr learned my addr 172.21.15.82:0/3521012215 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00cdd9b700 1 --2- 172.21.15.82:0/3521012215 >> v2:172.21.15.134:3300/0 conn(0x7f00d815d930 0x7f00d80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d659c700 1 -- 172.21.15.82:0/3521012215 >> v2:172.21.15.134:3300/0 conn(0x7f00d815d930 msgr2=0x7f00d80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:17:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d659c700 1 --2- 172.21.15.82:0/3521012215 >> v2:172.21.15.134:3300/0 conn(0x7f00d815d930 0x7f00d80b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d659c700 1 -- 172.21.15.82:0/3521012215 >> v1:172.21.15.82:6789/0 conn(0x7f00d81591b0 legacy=0x7f00d8159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d659c700 1 -- 172.21.15.82:0/3521012215 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d80b2230 con 0x7f00d815d560 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d5d9b700 1 -- 172.21.15.82:0/3521012215 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116417638 0 0) 0x7f00d80b2ad0 con 0x7f00d81591b0 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d659c700 1 --2- 172.21.15.82:0/3521012215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d815d560 0x7f00d80d0030 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f00d815e440 tx=0x7f00c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b98110eeab151f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d5d9b700 1 -- 172.21.15.82:0/3521012215 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c800b6b0 con 0x7f00d815d560 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d5d9b700 1 -- 172.21.15.82:0/3521012215 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c800b810 con 0x7f00d815d560 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00d5d9b700 1 -- 172.21.15.82:0/3521012215 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c800bbb0 con 0x7f00d815d560 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3521012215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d815d560 msgr2=0x7f00d80d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3521012215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d815d560 0x7f00d80d0030 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f00d815e440 tx=0x7f00c80091a0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3521012215 shutdown_connections 2023-10-06T03:17:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3521012215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d815d560 0x7f00d80d0030 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3521012215 >> v2:172.21.15.134:3300/0 conn(0x7f00d815d930 0x7f00d80b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.684+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3521012215 >> 172.21.15.82:0/3521012215 conn(0x7f00d80d1180 msgr2=0x7f00d8069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.685+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3521012215 shutdown_connections 2023-10-06T03:17:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.685+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3521012215 wait complete. 2023-10-06T03:17:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.686+0000 7f00dcc4f700 1 Processor -- start 2023-10-06T03:17:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.686+0000 7f00dcc4f700 1 -- start start 2023-10-06T03:17:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00dcc4f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d81591b0 0x7f00d8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00dcc4f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00d815d560 0x7f00d814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00dcc4f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d815d930 0x7f00d814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00dcc4f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8155310 con 0x7f00d81591b0 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00dcc4f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8156560 con 0x7f00d815d930 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00dcc4f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8154700 con 0x7f00d815d560 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d81591b0 0x7f00d8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d81591b0 0x7f00d8156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44302/0 (socket says 172.21.15.82:44302) 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 -- 172.21.15.82:0/3937717875 learned_addr learned my addr 172.21.15.82:0/3937717875 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d6d9d700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d815d930 0x7f00d814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00cdd9b700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00d815d560 0x7f00d814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 -- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00d815d560 msgr2=0x7f00d814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00d815d560 0x7f00d814e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 -- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d815d930 msgr2=0x7f00d814f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d815d930 0x7f00d814f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 -- 172.21.15.82:0/3937717875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8009420 con 0x7f00d81591b0 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00cdd9b700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00d815d560 0x7f00d814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00d659c700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d81591b0 0x7f00d8156020 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f00c800b0e0 tx=0x7f00c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00ceffd700 1 -- 172.21.15.82:0/3937717875 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8011420 con 0x7f00d81591b0 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00ceffd700 1 -- 172.21.15.82:0/3937717875 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8011580 con 0x7f00d81591b0 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d81549e0 con 0x7f00d81591b0 2023-10-06T03:17:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00ceffd700 1 -- 172.21.15.82:0/3937717875 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8011940 con 0x7f00d81591b0 2023-10-06T03:17:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.687+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d8154fa0 con 0x7f00d81591b0 2023-10-06T03:17:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.688+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d8064050 con 0x7f00d81591b0 2023-10-06T03:17:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.689+0000 7f00ceffd700 1 -- 172.21.15.82:0/3937717875 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00c8011d30 con 0x7f00d81591b0 2023-10-06T03:17:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.689+0000 7f00ceffd700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f00b8066f30 0x7f00b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:17:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.689+0000 7f00ceffd700 1 -- 172.21.15.82:0/3937717875 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f00c8085cf0 con 0x7f00d81591b0 2023-10-06T03:17:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.689+0000 7f00cdd9b700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f00b8066f30 0x7f00b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:17:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.690+0000 7f00cdd9b700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f00b8066f30 0x7f00b80693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f00d815a780 tx=0x7f00c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:17:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.694+0000 7f00ceffd700 1 -- 172.21.15.82:0/3937717875 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00c808a070 con 0x7f00d81591b0 2023-10-06T03:17:52.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.870+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00d80b2510 con 0x7f00b8066f30 2023-10-06T03:17:52.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.875+0000 7f00ceffd700 1 -- 172.21.15.82:0/3937717875 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73346 (secure 0 0 0) 0x7f00d80b2510 con 0x7f00b8066f30 2023-10-06T03:17:52.876 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:17:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f00b8066f30 msgr2=0x7f00b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f00b8066f30 0x7f00b80693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f00d815a780 tx=0x7f00c0008040 comp rx=0 tx=0).stop 2023-10-06T03:17:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d81591b0 msgr2=0x7f00d8156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:17:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d81591b0 0x7f00d8156020 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f00c800b0e0 tx=0x7f00c8017000 comp rx=0 tx=0).stop 2023-10-06T03:17:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 shutdown_connections 2023-10-06T03:17:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d815d930 0x7f00d814f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d81591b0 0x7f00d8156020 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f00b8066f30 0x7f00b80693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 --2- 172.21.15.82:0/3937717875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00d815d560 0x7f00d814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:17:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 >> 172.21.15.82:0/3937717875 conn(0x7f00d80d1180 msgr2=0x7f00d8157910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:17:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 shutdown_connections 2023-10-06T03:17:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:17:52.876+0000 7f00dcc4f700 1 -- 172.21.15.82:0/3937717875 wait complete. 2023-10-06T03:17:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:17:52.889 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-10-06T03:17:51.176420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385140,"kb_used_data":6836,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589580,"statfs":{"total":773094113280,"available":770651729920,"internally_reserved":0,"allocated":7000064,"data_stored":3720515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23375051,"num_objects":-48,"num_object_clones":0,"num_object_copies":-96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-165,"num_write_kb":-43408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001649"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.369098+0000","last_change":"2023-10-06T03:15:46.452021+0000","last_active":"2023-10-06T03:17:43.369098+0000","last_peered":"2023-10-06T03:17:43.369098+0000","last_clean":"2023-10-06T03:17:43.369098+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:43.369098+0000","last_undegraded":"2023-10-06T03:17:43.369098+0000","last_fullsized":"2023-10-06T03:17:43.369098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.855081+0000","last_change":"2023-10-06T03:15:46.353153+0000","last_active":"2023-10-06T03:17:43.855081+0000","last_peered":"2023-10-06T03:17:43.855081+0000","last_clean":"2023-10-06T03:17:43.855081+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:43.855081+0000","last_undegraded":"2023-10-06T03:17:43.855081+0000","last_fullsized":"2023-10-06T03:17:43.855081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.855042+0000","last_change":"2023-10-06T03:15:46.357741+0000","last_active":"2023-10-06T03:17:43.855042+0000","last_peered":"2023-10-06T03:17:43.855042+0000","last_clean":"2023-10-06T03:17:43.855042+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:43.855042+0000","last_undegraded":"2023-10-06T03:17:43.855042+0000","last_fullsized":"2023-10-06T03:17:43.855042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.854996+0000","last_change":"2023-10-06T03:15:46.358346+0000","last_active":"2023-10-06T03:17:43.854996+0000","last_peered":"2023-10-06T03:17:43.854996+0000","last_clean":"2023-10-06T03:17:43.854996+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:17:43.854996+0000","last_undegraded":"2023-10-06T03:17:43.854996+0000","last_fullsized":"2023-10-06T03:17:43.854996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:00:11.108904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":46,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.855464+0000","last_change":"2023-10-06T03:15:46.449349+0000","last_active":"2023-10-06T03:17:43.855464+0000","last_peered":"2023-10-06T03:17:43.855464+0000","last_clean":"2023-10-06T03:17:43.855464+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:43.855464+0000","last_undegraded":"2023-10-06T03:17:43.855464+0000","last_fullsized":"2023-10-06T03:17:43.855464+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.855061+0000","last_change":"2023-10-06T03:15:46.452118+0000","last_active":"2023-10-06T03:17:43.855061+0000","last_peered":"2023-10-06T03:17:43.855061+0000","last_clean":"2023-10-06T03:17:43.855061+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:43.855061+0000","last_undegraded":"2023-10-06T03:17:43.855061+0000","last_fullsized":"2023-10-06T03:17:43.855061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:20.275866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":50,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.368691+0000","last_change":"2023-10-06T03:15:46.449724+0000","last_active":"2023-10-06T03:17:43.368691+0000","last_peered":"2023-10-06T03:17:43.368691+0000","last_clean":"2023-10-06T03:17:43.368691+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:43.368691+0000","last_undegraded":"2023-10-06T03:17:43.368691+0000","last_fullsized":"2023-10-06T03:17:43.368691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.765506+0000","last_change":"2023-10-06T03:15:46.449451+0000","last_active":"2023-10-06T03:17:43.765506+0000","last_peered":"2023-10-06T03:17:43.765506+0000","last_clean":"2023-10-06T03:17:43.765506+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:43.765506+0000","last_undegraded":"2023-10-06T03:17:43.765506+0000","last_fullsized":"2023-10-06T03:17:43.765506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:09.141896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:17:43.765459+0000","last_change":"2023-10-06T03:15:46.358203+0000","last_active":"2023-10-06T03:17:43.765459+0000","last_peered":"2023-10-06T03:17:43.765459+0000","last_clean":"2023-10-06T03:17:43.765459+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:43.765459+0000","last_undegraded":"2023-10-06T03:17:43.765459+0000","last_fullsized":"2023-10-06T03:17:43.765459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:15:45.336183+0000","last_clean_scrub_stamp":"2023-10-06T03:15:45.336183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:18.944605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":907333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51700000000000002,"15min":0.52500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":0.53000000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.38,"5min":0.315,"15min":0.315},"max":{"1min":0.64000000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.495},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.2010000000000001,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.433}]},{"osd":6,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":316965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.49199999999999999},"min":{"1min":0.42799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.40999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.48499999999999999},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.42699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.502,"15min":0.499},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":908686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.316,"15min":0.314},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35199999999999998,"15min":0.34899999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.316,"15min":0.31},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36799999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.39000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78700000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":316965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.308,"15min":0.308},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.499,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.308},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.311,"15min":0.311},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.48599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.34999999999999998,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.215,"15min":0.215},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.36199999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36899999999999999,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73699999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.495},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":316965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.214,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46000000000000002,"5min":1.585,"15min":1.585},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.374,"15min":0.378},"min":{"1min":0.27200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47399999999999998,"5min":1.331,"15min":1.331},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41599999999999998,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.34399999999999997,"15min":0.34999999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.52100000000000002,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.49299999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71499999999999997,"5min":1.613,"15min":1.613},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72299999999999998,"5min":1.411,"15min":1.411},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71699999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.629,"15min":0.64400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":1.635,"15min":1.635},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74299999999999999,"5min":1.355,"15min":1.355},"last":0.624},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72999999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60899999999999999,"15min":0.621},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.70099999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72299999999999998,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":316965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.35299999999999998,"15min":0.36099999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.35699999999999998,"15min":0.36499999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.41999999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.313}]},{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.34200000000000003,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40500000000000003,"5min":1.204,"15min":1.204},"last":0.251},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.51600000000000001,"15min":0.54200000000000004},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.38}]},{"osd":2,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46600000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56399999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":1.153,"15min":1.153},"last":0.436}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79300000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.39800000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78700000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68999999999999995,"5min":1.177,"15min":1.177},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83699999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.70399999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77400000000000002,"5min":1.127,"15min":1.127},"last":0.45600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":318318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":1.03,"15min":1.03},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70599999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.379}]},{"osd":2,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78700000000000003,"5min":1.048,"15min":1.048},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.752,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71199999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77800000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":318318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.505},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.437}]},{"osd":7,"last update":"Fri Oct 6 03:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.379},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:17:52.894 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.894 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.894 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.894 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.894 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.894 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.894 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.895 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.895 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T03:15:45.336183+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=15, tm_sec=45, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=17, tm_sec=47, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:17:52.895 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:17:57.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:17:57.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:18:12.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:18:13.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.021+0000 7fa05cdc7700 1 Processor -- start 2023-10-06T03:18:13.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.021+0000 7fa05cdc7700 1 -- start start 2023-10-06T03:18:13.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.022+0000 7fa05cdc7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa05815d930 0x7fa0580d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.022+0000 7fa05cdc7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580b2ad0 con 0x7fa0581591b0 2023-10-06T03:18:13.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.022+0000 7fa05cdc7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580b4160 con 0x7fa05815d560 2023-10-06T03:18:13.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.022+0000 7fa05cdc7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0580b2230 con 0x7fa05815d930 2023-10-06T03:18:13.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.022+0000 7fa04dd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa05815d930 0x7fa0580d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.022+0000 7fa056d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa0581591b0 0x7fa058159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42650/0 (socket says 172.21.15.82:42650) 2023-10-06T03:18:13.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.022+0000 7fa056d9d700 1 -- 172.21.15.82:0/2193454625 learned_addr learned my addr 172.21.15.82:0/2193454625 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:18:13.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.022+0000 7fa04dd9b700 1 -- 172.21.15.82:0/2193454625 >> v1:172.21.15.134:6789/0 conn(0x7fa05815d560 legacy=0x7fa0580b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa04dd9b700 1 -- 172.21.15.82:0/2193454625 >> v1:172.21.15.82:6789/0 conn(0x7fa0581591b0 legacy=0x7fa058159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa055d9b700 1 -- 172.21.15.82:0/2193454625 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836374915 0 0) 0x7fa0580b2ad0 con 0x7fa0581591b0 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa04dd9b700 1 -- 172.21.15.82:0/2193454625 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0580b2510 con 0x7fa05815d930 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa04dd9b700 1 --2- 172.21.15.82:0/2193454625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05815d930 0x7fa0580d0030 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa0400098e0 tx=0x7fa0400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b957223329be92e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa055d9b700 1 -- 172.21.15.82:0/2193454625 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040009e80 con 0x7fa05815d930 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa055d9b700 1 -- 172.21.15.82:0/2193454625 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000b860 con 0x7fa05815d930 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa055d9b700 1 -- 172.21.15.82:0/2193454625 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000bbe0 con 0x7fa05815d930 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa05cdc7700 1 -- 172.21.15.82:0/2193454625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05815d930 msgr2=0x7fa0580d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa05cdc7700 1 --2- 172.21.15.82:0/2193454625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05815d930 0x7fa0580d0030 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa0400098e0 tx=0x7fa0400091a0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa05cdc7700 1 -- 172.21.15.82:0/2193454625 shutdown_connections 2023-10-06T03:18:13.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa05cdc7700 1 --2- 172.21.15.82:0/2193454625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05815d930 0x7fa0580d0030 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa05cdc7700 1 -- 172.21.15.82:0/2193454625 >> 172.21.15.82:0/2193454625 conn(0x7fa0580d1180 msgr2=0x7fa058069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:18:13.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa05cdc7700 1 -- 172.21.15.82:0/2193454625 shutdown_connections 2023-10-06T03:18:13.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.023+0000 7fa05cdc7700 1 -- 172.21.15.82:0/2193454625 wait complete. 2023-10-06T03:18:13.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.025+0000 7fa05cdc7700 1 Processor -- start 2023-10-06T03:18:13.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.025+0000 7fa05cdc7700 1 -- start start 2023-10-06T03:18:13.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.025+0000 7fa05cdc7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0581591b0 0x7fa058156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.025+0000 7fa05cdc7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa05815d560 0x7fa05815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.025+0000 7fa05cdc7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa05815d930 0x7fa05815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.025+0000 7fa05cdc7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058156660 con 0x7fa0581591b0 2023-10-06T03:18:13.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.025+0000 7fa05cdc7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580a9840 con 0x7fa05815d930 2023-10-06T03:18:13.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.025+0000 7fa05cdc7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580a9b20 con 0x7fa05815d560 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0581591b0 0x7fa058156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0581591b0 0x7fa058156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57402/0 (socket says 172.21.15.82:57402) 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 -- 172.21.15.82:0/1173746756 learned_addr learned my addr 172.21.15.82:0/1173746756 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa056d9d700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa05815d930 0x7fa05815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa04dd9b700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa05815d560 0x7fa05815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 -- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa05815d560 msgr2=0x7fa05815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa05815d560 0x7fa05815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 -- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa05815d930 msgr2=0x7fa05815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa05815d930 0x7fa05815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 -- 172.21.15.82:0/1173746756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040009420 con 0x7fa0581591b0 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05659c700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0581591b0 0x7fa058156120 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c590 tx=0x7fa04800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa04effd700 1 -- 172.21.15.82:0/1173746756 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048011590 con 0x7fa0581591b0 2023-10-06T03:18:13.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa04effd700 1 -- 172.21.15.82:0/1173746756 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048011710 con 0x7fa0581591b0 2023-10-06T03:18:13.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa04effd700 1 -- 172.21.15.82:0/1173746756 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048011ad0 con 0x7fa0581591b0 2023-10-06T03:18:13.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0580a9e00 con 0x7fa0581591b0 2023-10-06T03:18:13.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.026+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0580ad080 con 0x7fa0581591b0 2023-10-06T03:18:13.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.027+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0580ad2a0 con 0x7fa0581591b0 2023-10-06T03:18:13.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.028+0000 7fa04effd700 1 -- 172.21.15.82:0/1173746756 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa04801b3b0 con 0x7fa0581591b0 2023-10-06T03:18:13.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.028+0000 7fa04effd700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa038066f30 0x7fa0380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.028+0000 7fa04effd700 1 -- 172.21.15.82:0/1173746756 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa048083880 con 0x7fa0581591b0 2023-10-06T03:18:13.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.028+0000 7fa04dd9b700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa038066f30 0x7fa0380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.029+0000 7fa04dd9b700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa038066f30 0x7fa0380693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa0400091e0 tx=0x7fa040017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.032+0000 7fa04effd700 1 -- 172.21.15.82:0/1173746756 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa048050c90 con 0x7fa0581591b0 2023-10-06T03:18:13.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.211+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 --> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa058064050 con 0x7fa038066f30 2023-10-06T03:18:13.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.215+0000 7fa04effd700 1 -- 172.21.15.82:0/1173746756 <== mgr.4105 v2:172.21.15.134:6832/90261 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73373 (secure 0 0 0) 0x7fa058064050 con 0x7fa038066f30 2023-10-06T03:18:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:18:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa038066f30 msgr2=0x7fa0380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa038066f30 0x7fa0380693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa0400091e0 tx=0x7fa040017000 comp rx=0 tx=0).stop 2023-10-06T03:18:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0581591b0 msgr2=0x7fa058156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0581591b0 0x7fa058156120 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c590 tx=0x7fa04800c8a0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 shutdown_connections 2023-10-06T03:18:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa05815d930 0x7fa05815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0581591b0 0x7fa058156120 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7fa038066f30 0x7fa0380693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 --2- 172.21.15.82:0/1173746756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa05815d560 0x7fa05815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 >> 172.21.15.82:0/1173746756 conn(0x7fa0580d1180 msgr2=0x7fa0580682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:18:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 shutdown_connections 2023-10-06T03:18:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.217+0000 7fa05cdc7700 1 -- 172.21.15.82:0/1173746756 wait complete. 2023-10-06T03:18:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-10-06T03:18:13.229 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-06T03:18:13.181010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385140,"kb_used_data":6836,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589580,"statfs":{"total":773094113280,"available":770651729920,"internally_reserved":0,"allocated":7000064,"data_stored":3720515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002591"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":64,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:17:56.970934+0000","last_change":"2023-10-06T03:17:56.970901+0000","last_active":"2023-10-06T03:17:56.970934+0000","last_peered":"2023-10-06T03:17:56.970934+0000","last_clean":"2023-10-06T03:17:56.970934+0000","last_became_active":"2023-10-06T03:15:46.451701+0000","last_became_peered":"2023-10-06T03:15:46.451701+0000","last_unstale":"2023-10-06T03:17:56.970934+0000","last_undegraded":"2023-10-06T03:17:56.970934+0000","last_fullsized":"2023-10-06T03:17:56.970934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:56.970796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:56.970796+0000","last_clean_scrub_stamp":"2023-10-06T03:17:56.970796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:05.731277+0000","scrub_duration":0.0020716269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":58,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:17:58.735343+0000","last_change":"2023-10-06T03:17:58.735314+0000","last_active":"2023-10-06T03:17:58.735343+0000","last_peered":"2023-10-06T03:17:58.735343+0000","last_clean":"2023-10-06T03:17:58.735343+0000","last_became_active":"2023-10-06T03:15:46.352858+0000","last_became_peered":"2023-10-06T03:15:46.352858+0000","last_unstale":"2023-10-06T03:17:58.735343+0000","last_undegraded":"2023-10-06T03:17:58.735343+0000","last_fullsized":"2023-10-06T03:17:58.735343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:58.735201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:58.735201+0000","last_clean_scrub_stamp":"2023-10-06T03:17:58.735201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:13.048163+0000","scrub_duration":0.0021186579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":58,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:17:51.382334+0000","last_change":"2023-10-06T03:17:51.382304+0000","last_active":"2023-10-06T03:17:51.382334+0000","last_peered":"2023-10-06T03:17:51.382334+0000","last_clean":"2023-10-06T03:17:51.382334+0000","last_became_active":"2023-10-06T03:15:46.357406+0000","last_became_peered":"2023-10-06T03:15:46.357406+0000","last_unstale":"2023-10-06T03:17:51.382334+0000","last_undegraded":"2023-10-06T03:17:51.382334+0000","last_fullsized":"2023-10-06T03:17:51.382334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:51.382188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:51.382188+0000","last_clean_scrub_stamp":"2023-10-06T03:17:51.382188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:47.102532+0000","scrub_duration":0.0014331109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"60'119","reported_seq":209,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:18:01.688473+0000","last_change":"2023-10-06T03:18:01.688437+0000","last_active":"2023-10-06T03:18:01.688473+0000","last_peered":"2023-10-06T03:18:01.688473+0000","last_clean":"2023-10-06T03:18:01.688473+0000","last_became_active":"2023-10-06T03:15:46.358010+0000","last_became_peered":"2023-10-06T03:15:46.358010+0000","last_unstale":"2023-10-06T03:18:01.688473+0000","last_undegraded":"2023-10-06T03:18:01.688473+0000","last_fullsized":"2023-10-06T03:18:01.688473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'119","last_scrub_stamp":"2023-10-06T03:18:01.688329+0000","last_deep_scrub":"60'119","last_deep_scrub_stamp":"2023-10-06T03:18:01.688329+0000","last_clean_scrub_stamp":"2023-10-06T03:18:01.688329+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:45.298549+0000","scrub_duration":0.005460388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":57,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:17:56.764324+0000","last_change":"2023-10-06T03:17:56.764284+0000","last_active":"2023-10-06T03:17:56.764324+0000","last_peered":"2023-10-06T03:17:56.764324+0000","last_clean":"2023-10-06T03:17:56.764324+0000","last_became_active":"2023-10-06T03:15:46.449064+0000","last_became_peered":"2023-10-06T03:15:46.449064+0000","last_unstale":"2023-10-06T03:17:56.764324+0000","last_undegraded":"2023-10-06T03:17:56.764324+0000","last_fullsized":"2023-10-06T03:17:56.764324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:56.764165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:56.764165+0000","last_clean_scrub_stamp":"2023-10-06T03:17:56.764165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:54.041890+0000","scrub_duration":0.0021958199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:17:54.821685+0000","last_change":"2023-10-06T03:17:54.821655+0000","last_active":"2023-10-06T03:17:54.821685+0000","last_peered":"2023-10-06T03:17:54.821685+0000","last_clean":"2023-10-06T03:17:54.821685+0000","last_became_active":"2023-10-06T03:15:46.451868+0000","last_became_peered":"2023-10-06T03:15:46.451868+0000","last_unstale":"2023-10-06T03:17:54.821685+0000","last_undegraded":"2023-10-06T03:17:54.821685+0000","last_fullsized":"2023-10-06T03:17:54.821685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:54.821531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:54.821531+0000","last_clean_scrub_stamp":"2023-10-06T03:17:54.821531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:48.442218+0000","scrub_duration":0.0020815730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:17:53.845072+0000","last_change":"2023-10-06T03:17:53.845038+0000","last_active":"2023-10-06T03:17:53.845072+0000","last_peered":"2023-10-06T03:17:53.845072+0000","last_clean":"2023-10-06T03:17:53.845072+0000","last_became_active":"2023-10-06T03:15:46.449206+0000","last_became_peered":"2023-10-06T03:15:46.449206+0000","last_unstale":"2023-10-06T03:17:53.845072+0000","last_undegraded":"2023-10-06T03:17:53.845072+0000","last_fullsized":"2023-10-06T03:17:53.845072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:53.844914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:53.844914+0000","last_clean_scrub_stamp":"2023-10-06T03:17:53.844914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:02.605395+0000","scrub_duration":0.0020046719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":56,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:17:52.330578+0000","last_change":"2023-10-06T03:17:52.330544+0000","last_active":"2023-10-06T03:17:52.330578+0000","last_peered":"2023-10-06T03:17:52.330578+0000","last_clean":"2023-10-06T03:17:52.330578+0000","last_became_active":"2023-10-06T03:15:46.449107+0000","last_became_peered":"2023-10-06T03:15:46.449107+0000","last_unstale":"2023-10-06T03:17:52.330578+0000","last_undegraded":"2023-10-06T03:17:52.330578+0000","last_fullsized":"2023-10-06T03:17:52.330578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:52.330438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:52.330438+0000","last_clean_scrub_stamp":"2023-10-06T03:17:52.330438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:41.403669+0000","scrub_duration":0.0017135360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":56,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:17:53.295440+0000","last_change":"2023-10-06T03:17:53.295393+0000","last_active":"2023-10-06T03:17:53.295440+0000","last_peered":"2023-10-06T03:17:53.295440+0000","last_clean":"2023-10-06T03:17:53.295440+0000","last_became_active":"2023-10-06T03:15:46.357867+0000","last_became_peered":"2023-10-06T03:15:46.357867+0000","last_unstale":"2023-10-06T03:17:53.295440+0000","last_undegraded":"2023-10-06T03:17:53.295440+0000","last_fullsized":"2023-10-06T03:17:53.295440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:17:53.295270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:17:53.295270+0000","last_clean_scrub_stamp":"2023-10-06T03:17:53.295270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:49.015614+0000","scrub_duration":0.0019677900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":907333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51700000000000002,"15min":0.52500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65400000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.38,"5min":0.315,"15min":0.315},"max":{"1min":0.64000000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.2010000000000001,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.503}]},{"osd":6,"last update":"Fri Oct 6 03:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.443},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":316965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.49199999999999999},"min":{"1min":0.42799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.40999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.48499999999999999},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.503},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.42699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.502,"15min":0.499},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.372},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.624},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.44400000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":908686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.316,"15min":0.314},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.35199999999999998,"15min":0.34899999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.316,"15min":0.31},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.376,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.39000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.879},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.96499999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78700000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.79100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":316965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.308,"15min":0.308},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.499,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.308},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.311,"15min":0.311},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.48599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.34999999999999998,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.215,"15min":0.215},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.36199999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36899999999999999,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73699999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.40999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.5}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.45700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":316965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.214,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46000000000000002,"5min":1.585,"15min":1.585},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.374,"15min":0.378},"min":{"1min":0.27200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47399999999999998,"5min":1.331,"15min":1.331},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41599999999999998,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.374}]},{"osd":3,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.34399999999999997,"15min":0.34999999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.52100000000000002,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.49299999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71499999999999997,"5min":1.613,"15min":1.613},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72299999999999998,"5min":1.411,"15min":1.411},"last":0.57499999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71699999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.629,"15min":0.64400000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":1.635,"15min":1.635},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74299999999999999,"5min":1.355,"15min":1.355},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72999999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60899999999999999,"15min":0.621},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.70099999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72299999999999998,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":316965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.35299999999999998,"15min":0.36099999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.35699999999999998,"15min":0.36499999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.41999999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.34200000000000003,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40500000000000003,"5min":1.204,"15min":1.204},"last":0.311},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.51600000000000001,"15min":0.54200000000000004},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.379}]},{"osd":2,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46600000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.37},{"interface":"front","average":{"1min":0.37,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56399999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":1.153,"15min":1.153},"last":0.57499999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79300000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.747},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.39800000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78700000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68999999999999995,"5min":1.177,"15min":1.177},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83699999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.70399999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77400000000000002,"5min":1.127,"15min":1.127},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":318318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":1.03,"15min":1.03},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70599999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.498},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78700000000000003,"5min":1.048,"15min":1.048},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.752,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71199999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40000000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.372},{"interface":"front","average":{"1min":0.5,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77800000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":318318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72999999999999998,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66500000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":1.825,"15min":1.825},"last":0.621}]},{"osd":3,"last update":"Fri Oct 6 03:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75900000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.747,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82899999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64100000000000001,"15min":0.65000000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77700000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.39300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:18:13.232 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T03:18:13.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.344+0000 7ff54e39f700 1 Processor -- start 2023-10-06T03:18:13.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.344+0000 7ff54e39f700 1 -- start start 2023-10-06T03:18:13.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.345+0000 7ff54e39f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 0x7ff54815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.345+0000 7ff54e39f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54815dd20 con 0x7ff54815d8e0 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.345+0000 7ff54e39f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480b1110 con 0x7ff548159500 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.345+0000 7ff54e39f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480b13b0 con 0x7ff5481598d0 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.345+0000 7ff54c93c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff54815d8e0 0x7ff5480cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42652/0 (socket says 172.21.15.82:42652) 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.345+0000 7ff54c93c700 1 -- 172.21.15.82:0/3945127887 learned_addr learned my addr 172.21.15.82:0/3945127887 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.345+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656224272 0 0) 0x7ff54815dd20 con 0x7ff54815d8e0 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff530003570 con 0x7ff54815d8e0 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff5477fe700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 0x7ff54815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970064879 0 0) 0x7ff530003570 con 0x7ff54815d8e0 2023-10-06T03:18:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 msgr2=0x7ff54815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 0x7ff54815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 >> v1:172.21.15.134:6789/0 conn(0x7ff548159500 legacy=0x7ff5480b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480b1690 con 0x7ff54815d8e0 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7ff5400017f0 con 0x7ff54815d8e0 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 >> v1:172.21.15.82:6789/0 conn(0x7ff54815d8e0 legacy=0x7ff5480cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530003a90 0x7ff530003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff530004810 0x7ff530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 0x7ff5300051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480b13b0 con 0x7ff530004810 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53000bb60 con 0x7ff530003a90 2023-10-06T03:18:13.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53000bd20 con 0x7ff5481598d0 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff5477fe700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff530004810 0x7ff530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff547fff700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530003a90 0x7ff530003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff54c93c700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 0x7ff5300051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff5477fe700 1 -- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 msgr2=0x7ff5300051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff5477fe700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 0x7ff5300051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff5477fe700 1 -- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530003a90 msgr2=0x7ff530003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff5477fe700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530003a90 0x7ff530003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff5477fe700 1 -- 172.21.15.82:0/3945127887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530003570 con 0x7ff530004810 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff54c93c700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5481598d0 0x7ff5300051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff5477fe700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff530004810 0x7ff530004c80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009c00 tx=0x7ff53c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32e9f6f2713aeaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00e710 con 0x7ff530004810 2023-10-06T03:18:13.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c00e870 con 0x7ff530004810 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.346+0000 7ff546ffd700 1 -- 172.21.15.82:0/3945127887 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00ec30 con 0x7ff530004810 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.347+0000 7ff54e39f700 1 -- 172.21.15.82:0/3945127887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff530004810 msgr2=0x7ff530004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.347+0000 7ff54e39f700 1 --2- 172.21.15.82:0/3945127887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff530004810 0x7ff530004c80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009c00 tx=0x7ff53c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.347+0000 7ff54c93c700 1 -- 172.21.15.82:0/3945127887 reap_dead start 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.347+0000 7ff54e39f700 1 -- 172.21.15.82:0/3945127887 shutdown_connections 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.347+0000 7ff54e39f700 1 -- 172.21.15.82:0/3945127887 >> 172.21.15.82:0/3945127887 conn(0x7ff548067630 msgr2=0x7ff548069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.347+0000 7ff54e39f700 1 -- 172.21.15.82:0/3945127887 shutdown_connections 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.347+0000 7ff54e39f700 1 -- 172.21.15.82:0/3945127887 wait complete. 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.348+0000 7ff54e39f700 1 Processor -- start 2023-10-06T03:18:13.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.348+0000 7ff54e39f700 1 -- start start 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff54e39f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530004810 0x7ff548153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff54e39f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54814d080 0x7ff54815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff54e39f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff54814d4f0 0x7ff5480cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff54e39f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54816cfd0 con 0x7ff54814d080 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff54e39f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54816d2b0 con 0x7ff530004810 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff54e39f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54816d590 con 0x7ff54814d4f0 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54814d080 0x7ff54815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54814d080 0x7ff54815cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57434/0 (socket says 172.21.15.82:57434) 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 -- 172.21.15.82:0/1864033813 learned_addr learned my addr 172.21.15.82:0/1864033813 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff54c93c700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff54814d4f0 0x7ff5480cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff547fff700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530004810 0x7ff548153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 -- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff54814d4f0 msgr2=0x7ff5480cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff54814d4f0 0x7ff5480cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 -- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530004810 msgr2=0x7ff548153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530004810 0x7ff548153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 -- 172.21.15.82:0/1864033813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54816d870 con 0x7ff54814d080 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.349+0000 7ff5477fe700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54814d080 0x7ff54815cb10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff53000bb30 tx=0x7ff53c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.350+0000 7ff52ffff700 1 -- 172.21.15.82:0/1864033813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c022070 con 0x7ff54814d080 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.350+0000 7ff52ffff700 1 -- 172.21.15.82:0/1864033813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c00ebf0 con 0x7ff54814d080 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.350+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54816cca0 con 0x7ff54814d080 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.350+0000 7ff52ffff700 1 -- 172.21.15.82:0/1864033813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c01c6a0 con 0x7ff54814d080 2023-10-06T03:18:13.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.350+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54815d050 con 0x7ff54814d080 2023-10-06T03:18:13.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.351+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff548064050 con 0x7ff54814d080 2023-10-06T03:18:13.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.351+0000 7ff52ffff700 1 -- 172.21.15.82:0/1864033813 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff53c01ca90 con 0x7ff54814d080 2023-10-06T03:18:13.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.351+0000 7ff52ffff700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff534066f30 0x7ff5340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.352+0000 7ff52ffff700 1 -- 172.21.15.82:0/1864033813 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff53c085bf0 con 0x7ff54814d080 2023-10-06T03:18:13.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.352+0000 7ff547fff700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff534066f30 0x7ff5340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.352+0000 7ff547fff700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff534066f30 0x7ff5340693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff538003960 tx=0x7ff538009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.356+0000 7ff52ffff700 1 -- 172.21.15.82:0/1864033813 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff53c053000 con 0x7ff54814d080 2023-10-06T03:18:13.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.538+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff5480b1970 con 0x7ff54814d080 2023-10-06T03:18:13.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.545+0000 7ff52ffff700 1 -- 172.21.15.82:0/1864033813 <== mon.0 v2:172.21.15.82:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff53c053000 con 0x7ff54814d080 2023-10-06T03:18:13.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.545+0000 7ff52ffff700 1 -- 172.21.15.82:0/1864033813 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff53c02b0c0 con 0x7ff54814d080 2023-10-06T03:18:13.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff534066f30 msgr2=0x7ff5340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff534066f30 0x7ff5340693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff538003960 tx=0x7ff538009040 comp rx=0 tx=0).stop 2023-10-06T03:18:13.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54814d080 msgr2=0x7ff54815cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54814d080 0x7ff54815cb10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff53000bb30 tx=0x7ff53c01a000 comp rx=0 tx=0).stop 2023-10-06T03:18:13.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 shutdown_connections 2023-10-06T03:18:13.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7ff534066f30 0x7ff5340693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff54814d4f0 0x7ff5480cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff530004810 0x7ff548153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 --2- 172.21.15.82:0/1864033813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54814d080 0x7ff54815cb10 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 >> 172.21.15.82:0/1864033813 conn(0x7ff548067630 msgr2=0x7ff5480b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:18:13.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 shutdown_connections 2023-10-06T03:18:13.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.547+0000 7ff54e39f700 1 -- 172.21.15.82:0/1864033813 wait complete. 2023-10-06T03:18:13.560 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:18:13.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:18:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.674+0000 7f78a8fdf700 1 Processor -- start 2023-10-06T03:18:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.674+0000 7f78a8fdf700 1 -- start start 2023-10-06T03:18:13.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a8fdf700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f78a415d850 0x7f78a40b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a8fdf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a40b6170 0x7f78a40b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a8fdf700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a4069f70 con 0x7f78a415d480 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a8fdf700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40687c0 con 0x7f78a415d850 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a8fdf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4068aa0 con 0x7f78a40b6170 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a37fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f78a415d480 0x7f78a4069860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42666/0 (socket says 172.21.15.82:42666) 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a37fe700 1 -- 172.21.15.82:0/3405516015 learned_addr learned my addr 172.21.15.82:0/3405516015 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167082354 0 0) 0x7f78a4069f70 con 0x7f78a415d480 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a2ffd700 1 --2- 172.21.15.82:0/3405516015 >> v2:172.21.15.134:3300/0 conn(0x7f78a415d850 0x7f78a40b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a3fff700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a40b6170 0x7f78a40b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f788c003570 con 0x7f78a415d480 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3137000092 0 0) 0x7f788c003570 con 0x7f78a415d480 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a40b6170 msgr2=0x7f78a40b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a27fc700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a40b6170 0x7f78a40b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 >> v2:172.21.15.134:3300/0 conn(0x7f78a415d850 msgr2=0x7f78a40b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a27fc700 1 --2- 172.21.15.82:0/3405516015 >> v2:172.21.15.134:3300/0 conn(0x7f78a415d850 0x7f78a40b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.675+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4068d80 con 0x7f78a415d480 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2484263102 0 0) 0x7f7894001470 con 0x7f78a415d480 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 >> v1:172.21.15.82:6789/0 conn(0x7f78a415d480 legacy=0x7f78a4069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c003ae0 0x7f788c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f788c004810 0x7f788c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a40b6170 0x7f788c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40687c0 con 0x7f788c004810 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4068aa0 con 0x7f788c003ae0 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c014350 con 0x7f78a40b6170 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a2ffd700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f788c004810 0x7f788c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a37fe700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c003ae0 0x7f788c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a3fff700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a40b6170 0x7f788c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a2ffd700 1 -- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a40b6170 msgr2=0x7f788c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a2ffd700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a40b6170 0x7f788c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a2ffd700 1 -- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c003ae0 msgr2=0x7f788c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a2ffd700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c003ae0 0x7f788c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a2ffd700 1 -- 172.21.15.82:0/3405516015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c003570 con 0x7f788c004810 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a2ffd700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f788c004810 0x7f788c004c80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7898009c00 tx=0x7f78980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b614d6dacbfaf444 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789800e710 con 0x7f788c004810 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f789800e870 con 0x7f788c004810 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.676+0000 7f78a27fc700 1 -- 172.21.15.82:0/3405516015 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789800ec50 con 0x7f788c004810 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.677+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3405516015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f788c004810 msgr2=0x7f788c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.677+0000 7f78a8fdf700 1 --2- 172.21.15.82:0/3405516015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f788c004810 0x7f788c004c80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7898009c00 tx=0x7f78980091a0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.677+0000 7f78a3fff700 1 -- 172.21.15.82:0/3405516015 reap_dead start 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.677+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3405516015 shutdown_connections 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.677+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3405516015 >> 172.21.15.82:0/3405516015 conn(0x7f78a40ccf80 msgr2=0x7f78a40cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.677+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3405516015 shutdown_connections 2023-10-06T03:18:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.677+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3405516015 wait complete. 2023-10-06T03:18:13.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.678+0000 7f78a8fdf700 1 Processor -- start 2023-10-06T03:18:13.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.678+0000 7f78a8fdf700 1 -- start start 2023-10-06T03:18:13.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a8fdf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c004810 0x7f78a40b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a8fdf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a41654c0 0x7f78a4165930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a8fdf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a41571d0 0x7f78a4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a8fdf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4157bb0 con 0x7f78a41654c0 2023-10-06T03:18:13.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a8fdf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4169080 con 0x7f788c004810 2023-10-06T03:18:13.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a8fdf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4168a50 con 0x7f78a41571d0 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a41654c0 0x7f78a4165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a41654c0 0x7f78a4165930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57444/0 (socket says 172.21.15.82:57444) 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 -- 172.21.15.82:0/3574992170 learned_addr learned my addr 172.21.15.82:0/3574992170 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a37fe700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c004810 0x7f78a40b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a3fff700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a41571d0 0x7f78a4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 -- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a41571d0 msgr2=0x7f78a4157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a41571d0 0x7f78a4157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 -- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c004810 msgr2=0x7f78a40b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c004810 0x7f78a40b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 -- 172.21.15.82:0/3574992170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4165f80 con 0x7f78a41654c0 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.679+0000 7f78a2ffd700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a41654c0 0x7f78a4165930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f78980137a0 tx=0x7f78980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.680+0000 7f788b7fe700 1 -- 172.21.15.82:0/3574992170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898022070 con 0x7f78a41654c0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.680+0000 7f788b7fe700 1 -- 172.21.15.82:0/3574992170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7898013b10 con 0x7f78a41654c0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.680+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a4166260 con 0x7f78a41654c0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.680+0000 7f788b7fe700 1 -- 172.21.15.82:0/3574992170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789801c450 con 0x7f78a41654c0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.680+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a40b15b0 con 0x7f78a41654c0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.681+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a4088410 con 0x7f78a41654c0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.681+0000 7f788b7fe700 1 -- 172.21.15.82:0/3574992170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f789801c880 con 0x7f78a41654c0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.681+0000 7f788b7fe700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7890066f30 0x7f78900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.681+0000 7f788b7fe700 1 -- 172.21.15.82:0/3574992170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7898085a60 con 0x7f78a41654c0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.682+0000 7f78a37fe700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7890066f30 0x7f78900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:18:13.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.682+0000 7f78a37fe700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7890066f30 0x7f78900693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78a40b5fa0 tx=0x7f7894001dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:18:13.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.686+0000 7f788b7fe700 1 -- 172.21.15.82:0/3574992170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7898052ef0 con 0x7f78a41654c0 2023-10-06T03:18:13.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.913+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78a404c3c0 con 0x7f78a41654c0 2023-10-06T03:18:13.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.913+0000 7f788b7fe700 1 -- 172.21.15.82:0/3574992170 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f7898017de0 con 0x7f78a41654c0 2023-10-06T03:18:13.914 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-10-06T03:18:13.914 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/763820094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":763820094},{"type":"v1","addr":"172.21.15.134:6837","nonce":763820094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/1309129480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1309129480},{"type":"v1","addr":"172.21.15.134:6836","nonce":1309129480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/21148295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":21148295},{"type":"v1","addr":"172.21.15.82:6834","nonce":21148295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3144608812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6833","nonce":3144608812},{"type":"v1","addr":"172.21.15.82:6835","nonce":3144608812}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2023-10-06T03:18:13.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7890066f30 msgr2=0x7f78900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7890066f30 0x7f78900693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78a40b5fa0 tx=0x7f7894001dc0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a41654c0 msgr2=0x7f78a4165930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:18:13.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a41654c0 0x7f78a4165930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f78980137a0 tx=0x7f78980091a0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 shutdown_connections 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:6832/90261,v1:172.21.15.134:6833/90261] conn(0x7f7890066f30 0x7f78900693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a41571d0 0x7f78a4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f788c004810 0x7f78a40b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 --2- 172.21.15.82:0/3574992170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a41654c0 0x7f78a4165930 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 >> 172.21.15.82:0/3574992170 conn(0x7f78a40ccf80 msgr2=0x7f78a41593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 shutdown_connections 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-10-06T03:18:13.915+0000 7f78a8fdf700 1 -- 172.21.15.82:0/3574992170 wait complete. 2023-10-06T03:18:13.917 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 32 2023-10-06T03:18:13.928 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T03:18:13.928 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T03:18:13.928 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:18:13.928 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:13.936 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:18:13.937 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:18:13.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:13.985 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:18:13.986 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:18:13.986 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:13.997 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:18:13.997 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:18:13.997 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.048 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:18:14.048 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T03:18:14.049 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T03:18:14.049 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.077 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T03:18:14.077 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T03:18:14.077 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.154 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T03:18:14.154 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T03:18:14.154 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.218 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T03:18:14.218 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T03:18:14.218 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.288 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T03:18:14.289 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T03:18:14.289 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.325 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T03:18:14.325 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T03:18:14.325 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.397 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T03:18:14.398 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T03:18:14.398 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.470 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T03:18:14.471 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T03:18:14.471 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.541 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T03:18:14.541 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T03:18:14.541 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T03:18:14.541 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.567 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T03:18:14.567 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T03:18:14.567 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.607 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T03:18:14.607 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T03:18:14.607 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T03:18:14.608 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.618 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T03:18:14.618 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T03:18:14.618 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.658 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T03:18:14.659 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T03:18:14.659 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:18:14.709 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T03:18:14.710 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T03:18:14.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:18:14.738 INFO:teuthology.orchestra.run.smithi082.stdout:1696562151.375133 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:18:14.738 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T03:18:14.738 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:18:14.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:18:14.873 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:18:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:1696562151.375133 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:18:14.940 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:18:14.940 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T03:18:15.158 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:18:15.158 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T03:18:15.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:18:15.264 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T03:18:15.334 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:18:15.334 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T03:18:15.405 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:18:15.405 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T03:18:15.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:18:15.574 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T03:18:15.649 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:18:15.649 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T03:18:15.729 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:18:15.730 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T03:18:15.791 INFO:tasks.ceph:Archiving mon data... 2023-10-06T03:18:15.792 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/data/mon.a.tgz 2023-10-06T03:18:15.792 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-10-06T03:18:15.808 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.0Xp1lunQuK 2023-10-06T03:18:15.808 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0Xp1lunQuK 2023-10-06T03:18:15.939 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.0Xp1lunQuK 2023-10-06T03:18:16.021 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.0Xp1lunQuK is 335KB 2023-10-06T03:18:16.115 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.0Xp1lunQuK 2023-10-06T03:18:16.129 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/data/mon.b.tgz 2023-10-06T03:18:16.129 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-10-06T03:18:16.143 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.7zG0tToRWp 2023-10-06T03:18:16.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7zG0tToRWp 2023-10-06T03:18:16.297 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.7zG0tToRWp 2023-10-06T03:18:16.380 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.7zG0tToRWp is 443KB 2023-10-06T03:18:16.477 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.7zG0tToRWp 2023-10-06T03:18:16.491 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/data/mon.c.tgz 2023-10-06T03:18:16.491 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-10-06T03:18:16.545 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.pazHJMZbl8 2023-10-06T03:18:16.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.pazHJMZbl8 2023-10-06T03:18:16.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.pazHJMZbl8 2023-10-06T03:18:16.769 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.pazHJMZbl8 is 443KB 2023-10-06T03:18:16.865 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.pazHJMZbl8 2023-10-06T03:18:16.879 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T03:18:16.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:18:16.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:18:16.943 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T03:18:16.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:18:16.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:18:16.969 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:18:17.008 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:18:17.014 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T03:18:17.016 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/remote/smithi082/crash 2023-10-06T03:18:17.017 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:18:17.041 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/remote/smithi134/crash 2023-10-06T03:18:17.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:18:17.079 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T03:18:17.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:18:17.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:18:17.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:18:17.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:18:17.223 INFO:tasks.ceph:Compressing logs... 2023-10-06T03:18:17.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:18:17.241 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:18:18.419 INFO:tasks.ceph:Archiving logs... 2023-10-06T03:18:18.419 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/remote/smithi082/log 2023-10-06T03:18:18.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:18:18.834 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/remote/smithi134/log 2023-10-06T03:18:18.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:18:19.026 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T03:18:19.046 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T03:18:19.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:18:19.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:18:19.132 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T03:18:19.142 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T03:18:19.142 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:18:19.144 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:18:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2023-10-06T03:18:19.158 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2023-10-06T03:18:19.159 INFO:teuthology.orchestra.run.smithi082.stdout:210 Number of sources = 4 2023-10-06T03:18:19.159 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:18:19.159 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2023-10-06T03:18:19.159 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 -364us[ -360us] +/- 99ms 2023-10-06T03:18:19.159 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv02.front.sepia.ceph.com 3 6 377 3 -327us[ -323us] +/- 56ms 2023-10-06T03:18:19.159 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +605us[ +609us] +/- 62ms 2023-10-06T03:18:19.159 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:18:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:210 Number of sources = 4 2023-10-06T03:18:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:18:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2023-10-06T03:18:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 3 -339us[ -339us] +/- 99ms 2023-10-06T03:18:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 377 5 -317us[ -308us] +/- 56ms 2023-10-06T03:18:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +617us[ +625us] +/- 62ms 2023-10-06T03:18:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:18:19.162 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T03:18:19.171 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T03:18:19.172 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T03:18:19.181 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:18:19.294 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:18:19.388 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:18:19.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:18:19.419 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:18:19.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:18:19.449 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T03:18:19.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T03:18:19.473 INFO:teuthology.task.internal:Duration was 824.032053 seconds 2023-10-06T03:18:19.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T03:18:19.488 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T03:18:19.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:18:19.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:18:19.533 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:18:19.535 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:18:19.804 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T03:18:19.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2023-10-06T03:18:19.804 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:18:19.863 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2023-10-06T03:18:19.863 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:18:19.882 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T03:18:19.883 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:18:19.906 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:18:19.961 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T03:18:19.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:18:19.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:18:20.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T03:18:20.088 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T03:18:20.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:18:20.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:18:20.137 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T03:18:20.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:18:20.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:18:20.177 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2023-10-06T03:18:20.201 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2023-10-06T03:18:20.214 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:18:20.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:18:20.244 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:18:20.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:18:20.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T03:18:20.279 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T03:18:20.281 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/remote/smithi082 2023-10-06T03:18:20.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:18:20.321 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187/remote/smithi134 2023-10-06T03:18:20.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:18:20.357 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T03:18:20.357 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:18:20.360 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:18:20.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T03:18:20.418 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T03:18:20.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T03:18:20.430 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T03:18:20.430 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:18:20.433 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:18:20.445 INFO:teuthology.orchestra.run.smithi082.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:18 /home/ubuntu/cephtest 2023-10-06T03:18:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:18 /home/ubuntu/cephtest 2023-10-06T03:18:20.461 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T03:18:20.472 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T03:18:20.491 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T03:18:20.517 DEBUG:teuthology.nuke:shortname: smithi082 2023-10-06T03:18:20.517 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:18:20.539 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:57:23.469678', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMy/QwPsuOe8hxxDl+5G9LNQRSwewKwbEWYrb0IuRgGltzsRGG9XVzJ8bncKi3DC7kgmnyuNgdHqcp2vTqc2c4U='} 2023-10-06T03:18:20.542 DEBUG:teuthology.nuke:shortname: smithi134 2023-10-06T03:18:20.543 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:18:20.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412187', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:57:23.471682', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKzgy/QeSyqY7bSn2aIcVHxWMgsDJfrpNbKgQ5X1o55HSoMVmaqDavwcj+YJO0eb97kDNvcKC6Zcl1SvGSRyWg='} 2023-10-06T03:18:20.596 INFO:teuthology.orchestra.console.smithi082:Power off 2023-10-06T03:18:20.596 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:18:20.620 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-10-06T03:18:20.620 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:18:20.635 INFO:teuthology.orchestra.console.smithi134:Power off 2023-10-06T03:18:20.635 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:18:20.645 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-10-06T03:18:20.658 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-10-06T03:18:20.659 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:18:20.680 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-10-06T03:18:24.647 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:18:24.681 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:18:24.756 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-10-06T03:18:24.793 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-10-06T03:18:28.758 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:18:28.794 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:18:28.869 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-10-06T03:18:28.904 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-10-06T03:18:28.970 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-10-06T03:18:32.906 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:18:33.017 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-10-06T03:18:33.117 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-10-06T03:18:33.222 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} duration: 824.0320534706116 failure_reason: '"1696562151.375133 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T03:18:33.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:18:33.304 INFO:teuthology.run:FAIL